-- Logs begin at Thu 2022-04-07 12:13:30 UTC, end at Thu 2022-04-07 13:49:04 UTC. -- Apr 07 12:46:50.723055 dv-cinder-836944-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 07 12:46:50.731861 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Apr 7 12:46:50 2022] *** Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: nodename: dv-cinder-836944-2-iscsi Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: machine: x86_64 Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: clock source: unix Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: pcre jit disabled Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: detected number of CPU cores: 4 Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: current working directory: / Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: detected binary path: /usr/bin/uwsgi-core Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: your processes number limit is 47680 Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: your memory page size is 4096 bytes Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: detected max file descriptor number: 2048 Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: lock engine: pthread robust mutexes Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: thunder lock: enabled Apr 07 12:46:50.734920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 07 12:46:50.735814 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 07 12:46:50.780568 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: Python main interpreter initialized at 0x55db959bc9c0 Apr 07 12:46:50.780568 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: python threads support enabled Apr 07 12:46:50.780568 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: your server socket listen backlog is limited to 100 connections Apr 07 12:46:50.780568 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: your mercy for graceful operations on workers is 90 seconds Apr 07 12:46:50.780920 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: mapped 403077 bytes (393 KB) for 2 cores Apr 07 12:46:50.781015 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: *** Operational MODE: preforking *** Apr 07 12:46:50.781224 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: *** uWSGI is running in multiple interpreter mode *** Apr 07 12:46:50.781224 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: spawned uWSGI master process (pid: 102481) Apr 07 12:46:50.781413 dv-cinder-836944-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 07 12:46:50.782865 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: spawned uWSGI worker 1 (pid: 102482, cores: 1) Apr 07 12:46:50.782865 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: spawned uWSGI worker 2 (pid: 102483, cores: 1) Apr 07 12:46:50.782865 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 07 12:46:52.011563 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 07 12:46:52.012473 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 07 12:46:52.868384 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 12:46:52.868384 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: from cryptography.utils import int_from_bytes Apr 07 12:46:52.868668 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 12:46:52.868668 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: from cryptography.utils import int_from_bytes Apr 07 12:46:52.868791 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 12:46:52.868791 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: from cryptography.utils import int_from_bytes Apr 07 12:46:52.868904 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 12:46:52.868904 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: from cryptography.utils import int_from_bytes Apr 07 12:46:55.438342 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 07 12:46:55.438918 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 07 12:46:55.439022 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 07 12:46:55.439392 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 07 12:46:55.439472 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 07 12:46:55.439557 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 07 12:46:55.439709 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 07 12:46:55.439823 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 07 12:46:55.440095 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.440212 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 07 12:46:55.440417 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 07 12:46:55.440504 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.440751 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.440844 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.441071 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.441163 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.441404 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.441507 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.441716 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.441800 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.442038 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.442122 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.442359 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.442444 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.442679 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.442760 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.442937 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.443017 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.443252 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.443344 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.443572 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.443661 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836944-2-iscsi {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.443892 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.443990 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.444314 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836944-2-iscsi {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.444423 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.444774 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.444877 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.444955 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.445051 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.445233 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.445335 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.445531 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.445626 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.445837 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.445934 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.446164 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.446396 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.446797 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.446931 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.447049 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.447172 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.447291 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.447399 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.447567 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.447739 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.447881 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.448058 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.448354 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.448471 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.448675 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.448809 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.448988 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.449119 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.449311 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.449453 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.449620 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.449757 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.449946 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.450083 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836944-2-iscsi {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.450261 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.450417 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.450621 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.450726 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836944-2-iscsi {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.450937 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.451118 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.451269 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.451352 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.451584 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.451682 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.451936 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.452031 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.452280 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.452381 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.452605 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.452698 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.452913 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.453008 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.453243 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.453345 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.453549 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.453643 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.453864 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.453948 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.454181 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.454273 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.454483 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.454574 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.454792 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.454891 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.455096 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.455180 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.455407 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.455491 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.455707 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.455790 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.456010 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.456102 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.456291 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.456376 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.456598 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.456692 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.456866 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.456963 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.457175 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.457260 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.457497 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.457587 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.457773 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.457886 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.458023 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.458116 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.458340 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.458432 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.458605 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.458730 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.458924 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.459016 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.459244 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.459338 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.459548 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.459650 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.459910 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.460018 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.460238 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.460339 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.460545 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.460639 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.460852 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.460942 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.461156 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.461251 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.461464 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.461548 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.461772 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.461856 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.462089 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.462184 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.462394 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.462477 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.462712 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.462795 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.463018 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.463110 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.463341 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.463437 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.463641 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.463731 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.463971 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.464055 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.464310 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.464398 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.464619 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.464701 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.464938 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.465024 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.465253 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.465336 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.465558 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.465641 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.465862 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.465947 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.466166 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.466249 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.466469 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.466558 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.466776 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.466863 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.467085 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.467175 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.467336 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.467433 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.467637 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.467728 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.467933 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.468025 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.468260 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.468362 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.468564 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.468648 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.468871 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.468956 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.469174 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.469265 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.469470 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.469597 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.469776 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.469859 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.470074 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.470170 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.470377 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.470461 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.470684 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.470770 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.470989 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.471072 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.471289 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.471371 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.471592 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.471673 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.471894 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.471982 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.472224 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.472309 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.472533 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.472625 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.472839 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.472925 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.473158 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.473242 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.473475 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.473559 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.473780 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.473874 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.474084 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.474166 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.474388 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.474480 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.474691 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.474781 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.474996 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.475079 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.475805 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.475943 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.476184 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.476309 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.476432 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.476554 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.476742 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.476826 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.477048 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.477133 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.477356 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.477439 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.477661 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.477750 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.477964 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.478048 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.478271 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.478354 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.478571 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.478663 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.478879 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.478971 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.479182 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.479265 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.479484 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.479575 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.479786 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.479872 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.480086 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.480221 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.480412 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.480506 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.480713 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.480807 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.481016 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.481101 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.481315 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.481407 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.481618 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.481700 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.481918 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.482008 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.482230 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.482315 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.482536 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.482619 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.482839 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.482922 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.483142 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.483225 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.483448 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.483575 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.483765 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:46:55.483850 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.484101 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.484205 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.484454 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.484537 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.484787 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.484871 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.485101 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.485185 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.485422 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.485504 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.485735 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.485826 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.486049 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.486133 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.486359 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.486442 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.486675 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.486772 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.486988 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.487080 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.487299 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.487390 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.487610 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.487702 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.487923 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.488013 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.488271 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.488382 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.488586 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.488678 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.488903 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.488988 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.489218 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.489308 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.489527 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.489619 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.489844 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.489934 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.490154 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.490242 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.490474 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.490567 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.490785 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.490867 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.491693 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.491783 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.492038 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.492114 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.492382 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.492478 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.492705 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.492790 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.493028 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.493113 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.493340 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.493424 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.493654 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.493737 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.493967 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.494053 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.494291 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.494381 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.494622 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.494706 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.494936 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.495021 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.495255 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.495339 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.495567 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.495660 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.495883 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.495975 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.496216 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.496304 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.496530 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.496634 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.496845 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.496935 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.497163 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.497246 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.497479 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.497574 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.497797 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.497879 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.498110 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.498194 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.498430 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.498521 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.498740 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.498831 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.499054 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.499138 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.499366 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.499528 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.499669 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.499752 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.499975 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.500060 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.500303 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.500388 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.500614 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.500696 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.500919 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.501001 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.501237 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.501331 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.501547 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.501639 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.501856 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.501939 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.502185 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.502269 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.502489 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.502579 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.502802 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.502886 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.503114 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.503199 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.503425 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.503507 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.503729 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.503820 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.504040 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.504216 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.504372 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.504456 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.504678 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.504771 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.504989 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.505080 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.505299 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.505384 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.505602 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.505698 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.505924 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.506007 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.506227 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.506309 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.506585 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.506710 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.506891 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.507022 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.507196 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.507312 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.507507 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.507589 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.507820 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.507913 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.508130 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.508231 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.508466 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.508552 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.508780 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.508870 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.509095 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.509178 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.509409 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.509501 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.509725 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.509808 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.510046 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.510136 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.510370 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.510461 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.510679 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.510769 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.510999 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.511091 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.511306 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.511389 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.511615 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.511709 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.511918 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.512018 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.512248 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.512338 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.512554 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.512638 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.512860 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.512952 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.513163 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.513246 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.513467 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.513550 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.513769 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.513861 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.514072 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.514162 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.514374 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.514465 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.514677 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.514760 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.514982 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.515072 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.515284 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.515366 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.515587 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.515673 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.515888 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.515973 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.516219 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.516304 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.516527 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.516612 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.516873 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.516964 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.517182 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.517274 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.517509 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.517592 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.517834 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.517967 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.518147 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.518241 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.518465 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.518549 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.518779 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.518879 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.519091 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.519184 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.519402 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.519486 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.519712 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.519796 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.520021 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.520200 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.520356 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.520440 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.520675 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.520757 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.520985 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.521117 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.521305 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.521388 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.521613 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.521695 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.521933 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.522018 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.522781 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.522877 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.523101 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.523183 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.523479 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.523562 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.523804 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.523893 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.524174 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.524287 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.524511 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.524607 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.524834 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.524936 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.525147 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.525238 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.525461 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.525594 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.525772 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.525854 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.526082 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.526167 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.526394 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.526479 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.526960 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.527049 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.527281 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.527373 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.527598 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.527683 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.527909 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.527993 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.528255 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.528355 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.528567 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.528674 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.528886 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.528970 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.529192 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.529347 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.529505 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.529589 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.529812 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.529893 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.530130 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.530262 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.530452 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.530536 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.530766 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.530852 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.531086 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.531213 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.531394 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.531478 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.531702 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.531786 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.532014 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.532106 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.532346 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.532431 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.532654 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.532766 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.532962 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.533046 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.533271 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.533354 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.533583 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.533666 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.533894 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.533979 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.534200 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.534283 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.534512 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.534603 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.534819 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.534912 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.535124 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.535208 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.535428 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.535525 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.535734 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.535824 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.536041 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.536131 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.536379 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.536476 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.536700 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.536806 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.537012 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.537096 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.537322 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.537421 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.537629 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.537713 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.538006 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.538141 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.538386 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.538468 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.538751 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.538836 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.539071 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.539201 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.539363 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.539448 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.539673 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.539765 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.539982 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.540066 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.540431 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.541208 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.541323 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.541403 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.541403 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.541546 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.541628 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.541628 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.541887 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.542208 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.542293 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.542523 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.542609 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.542839 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.542922 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.543165 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.543248 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.543484 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.543575 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.543798 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.543882 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.544114 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.544265 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.544450 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.544537 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.544762 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.544846 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.545075 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.545159 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.545391 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.545476 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.545701 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.545782 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.546015 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.546112 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.546327 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.546411 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.546632 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.546723 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.546937 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.547030 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.547252 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.547335 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.547573 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.547823 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.548163 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.548263 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.548490 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.548618 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.548809 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.548892 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.549131 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.549229 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.549454 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.549538 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.549774 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.549859 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.550106 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.550191 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.550437 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.550522 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.550779 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.550878 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.551090 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.551175 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.551403 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.551533 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.551713 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.551803 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.552019 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.552102 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.552352 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.552446 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.552661 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.552752 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.552970 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.553053 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.553278 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.553874 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.554171 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.554608 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.554707 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.554787 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.554940 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.555022 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.555099 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.555215 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.555307 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.555537 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.555631 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.555848 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.555932 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.556188 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.556290 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.556503 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.556597 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.556823 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.556907 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.557134 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.557221 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.557437 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.557530 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.557743 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.557836 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.558046 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.558131 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.558389 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.558475 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.558699 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.558782 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.559032 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.559116 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.559361 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.559450 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.559701 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.559787 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.560007 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.560096 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.560336 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.560422 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.560661 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.560744 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.560964 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.561055 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.561268 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.561359 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.561572 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.561698 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.561881 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.561975 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.562191 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.562274 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.562492 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.562575 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.562802 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.562894 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.563108 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.563192 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.563419 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.563502 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.563726 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.563818 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.564031 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.564115 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.564364 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.564459 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.564670 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.564761 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.564982 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.565066 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.565291 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.565375 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.565594 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.565681 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.565898 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.565988 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.566207 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.566290 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.566518 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.566604 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.566823 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.566906 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.567132 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.567216 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.567435 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.567521 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.567749 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.567834 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.568054 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.568167 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.568381 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.568465 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.568686 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.568813 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.569016 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.569731 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.570190 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.570279 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.570357 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.570443 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.570521 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.570608 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.570748 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.570916 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.571053 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.571228 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.571357 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.571537 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.571667 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.571856 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.571971 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.572194 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.572332 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.572508 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.572601 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.572824 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.572920 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.573151 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.573246 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.573474 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.573567 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.573782 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.573866 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.574085 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.574178 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.574392 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.574477 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.574697 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.574780 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.575001 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.575093 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.575303 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.575386 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.575609 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.575701 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.575916 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.576029 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.576246 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.576351 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.576546 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.576647 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.576857 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.576943 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.577170 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.577261 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.577477 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.577577 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.577784 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.577874 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.578085 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.578174 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.578388 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.578484 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.578784 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.578877 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.579026 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.579111 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.579373 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.579473 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.579681 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.579786 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.580004 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.580092 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.580340 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.580444 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.581003 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.581075 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.581150 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.581218 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.581297 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.581370 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.581552 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.581638 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.581867 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.581957 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.582183 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.582289 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.582483 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.582559 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.582787 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.582873 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.583092 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.583186 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.583405 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.583489 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.583716 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.583876 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.584030 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.584116 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.584375 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.584463 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.584730 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.585267 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.585372 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.585461 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.585540 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.585616 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.585692 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.585778 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.585940 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.586055 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.586250 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.586368 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.586562 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.586678 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.586872 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.586990 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.587186 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.587301 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.587501 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.587596 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.587816 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.587900 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.588130 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.588302 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.588465 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.588581 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.588777 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.588890 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.589091 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.589204 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.589403 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.589524 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.589712 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.589823 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.590053 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.590182 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.590331 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.590443 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.590636 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.590759 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.590939 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.591058 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.591245 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.591361 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.591545 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.591655 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.591854 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.591983 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.592296 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.592422 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.592611 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.592721 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.592916 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.593042 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.593222 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.593332 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.593529 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.593613 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.593839 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.593931 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.594152 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.594242 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.594458 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.594542 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.594764 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.594860 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.595174 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.595257 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.595485 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.595569 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.595797 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.595880 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.596098 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.596220 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.596425 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.596517 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.596729 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.596813 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.597042 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.597134 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.597342 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.597433 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.597647 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.597740 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.597950 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.598033 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.598255 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.598347 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.598566 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.598658 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.598877 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.598959 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.599201 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.599298 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.599587 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.599671 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.599894 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.599979 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.600249 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.600734 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.600734 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.600899 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.600984 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.601068 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.601278 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.601373 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.601604 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.601688 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.601935 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.602022 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.602262 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.602348 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.602570 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.602670 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.602883 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.602967 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.603194 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.603321 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.603522 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.603615 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.603836 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.603921 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.604164 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.604251 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.604479 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.604572 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.604784 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.604875 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.605111 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.605195 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.605426 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.605512 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.605742 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.605824 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.606066 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.606151 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.606461 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.606546 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.606774 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.606859 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.607093 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.607190 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.607417 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.607501 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.607723 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.607807 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.608030 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.608123 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.608360 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.608444 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.608669 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.608753 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.608976 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.609072 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.609286 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.609370 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.609588 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.609673 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.609900 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.609993 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.610217 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.610337 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.610528 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.610620 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.610834 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.610937 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.611138 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.611243 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.611441 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.611535 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.611751 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.611847 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.612066 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.612179 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.612405 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.612500 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.612722 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.612817 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.613042 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.613135 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.613425 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.613528 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.613661 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.613768 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.613969 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.614060 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.614274 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.614377 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.614580 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.614664 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.614881 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.614973 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.615187 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.615285 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.615518 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.615602 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.615828 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.616437 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.616932 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.617032 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.617032 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.617184 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.617317 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.617439 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.617654 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.617749 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.617984 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.618076 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.618303 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.618389 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.618626 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.618719 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.618957 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.619043 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.619267 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.619351 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.619576 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.619662 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.619889 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.619982 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.620220 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.620359 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.620533 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.620639 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.620838 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.620934 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.621144 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.621238 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.621448 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.621543 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.621755 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.621849 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.622058 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.622162 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.622366 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.622461 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.622675 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.622770 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.622985 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.623087 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.623294 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.623404 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.623675 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.623786 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.623906 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.624021 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.624263 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.624355 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.624538 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.624630 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.624875 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.624973 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.625184 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.625268 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.625513 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.625596 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.625833 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.625918 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.626159 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.626242 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.626471 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.626554 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.626793 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.626877 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.627110 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.627192 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.627427 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.627510 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.627743 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.627835 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.628060 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.628161 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.628403 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.628486 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.628718 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.628806 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.629034 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.629117 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.629343 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.629434 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.629657 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.629739 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.629970 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.630054 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.630285 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.630377 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.630611 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.630822 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.631148 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.631240 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.631558 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.631721 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.631844 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.631968 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.632167 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.632284 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.632576 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.632718 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.632895 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.632988 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.633211 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.633299 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.633527 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.633614 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.633838 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.633922 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.634152 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.634239 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.634469 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.634558 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.634792 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.634879 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.635116 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.635204 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.635445 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.635534 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.635762 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.635857 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.636079 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.636202 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.636423 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.636512 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.636744 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.636844 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.637064 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.637180 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.637420 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.637517 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.637714 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.637808 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.638022 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.638110 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.638337 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.638423 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.638653 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.638738 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.638970 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.639057 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.639284 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.639377 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.639596 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.639696 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.639911 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.639998 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.640245 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.640336 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.640561 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.640679 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.640874 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.640965 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.641189 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.641284 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.641507 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.641604 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.641835 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.641924 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.642160 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.642245 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.642477 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.642566 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.642811 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.642938 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.643107 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.643196 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.643426 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.643635 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.643952 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.644038 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.644295 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.644385 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.644630 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.644718 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.644956 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.645057 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.645277 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.645364 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.645598 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.645685 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.645922 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.646016 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.646228 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.646328 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.646536 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.646623 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.646842 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.646928 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.647691 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.647799 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.648008 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.648095 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.648409 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.648496 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.648742 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.649019 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.649121 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.649203 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.649357 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.649454 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.649669 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.649769 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.650086 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.650209 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.650565 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.650652 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.650889 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.650977 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.651218 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.651305 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.651547 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.651635 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.652135 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.652280 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.652467 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.652554 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.652796 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.652883 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.653106 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.653196 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.653415 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.653503 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.653721 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.653807 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.654036 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.654134 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.654344 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.654440 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.654649 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.654749 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.654958 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.655045 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.655270 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.655357 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.655578 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.655684 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.655884 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.655971 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.656218 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.656310 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.656525 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.656687 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.656843 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.656929 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.657153 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.657249 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.657460 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.657564 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.657770 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.657858 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.658074 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.658172 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.658380 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.658469 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.658685 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.658771 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.658989 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.659080 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.659293 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.659380 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.659601 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.659687 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.659905 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.659999 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.660230 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.660321 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.660539 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.660626 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.660842 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.660927 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.661148 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.661235 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.661460 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.661559 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.661812 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.661907 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.662119 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.662208 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.662424 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.662512 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.662740 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.663384 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.663579 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.663759 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.663894 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.664219 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.664323 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.664546 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.664644 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.664857 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.664943 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.665205 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.665292 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.665524 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.665612 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.666057 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.666144 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.666394 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.666492 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.666720 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.666807 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.667055 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.667141 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.667388 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.667482 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.667698 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.667785 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.668006 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.668092 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.668341 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.668442 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.668672 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.668767 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.668987 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.669075 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.669306 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.669403 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.669619 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.669715 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.669930 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.670025 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.670241 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.670337 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.670552 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.670640 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.670864 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.670952 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.671175 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.671270 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.671486 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.671572 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.671794 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.671880 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.672104 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.672226 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.672437 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.672532 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.672752 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.672849 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.673095 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.673183 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.673414 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.673542 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.673729 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.673825 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.674048 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.674181 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.674362 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.674451 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.674672 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.674767 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.674979 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.675066 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.675287 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.675377 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.675594 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.675725 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.675908 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.676008 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.676258 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.676352 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.676574 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.676662 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.676876 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.676964 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.677294 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.677380 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.677607 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.677695 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.677925 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.678012 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.678245 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.678341 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.678584 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.678692 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.678905 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.679015 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.679230 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.679332 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.679545 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.679633 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.679867 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.679963 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.680207 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.680315 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.680540 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.680628 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.680878 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.680965 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.681206 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.681296 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.681532 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.681621 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.681839 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.681927 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.682145 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.682243 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.682448 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.682535 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.682758 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.682845 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.683079 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.683167 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.683388 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.683473 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.683690 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.683783 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.683992 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.684080 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.684327 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.684417 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.684635 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.684734 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.684940 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.685034 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.685243 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.685329 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.685547 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.685646 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.685856 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.685952 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.686160 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.686246 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.686463 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.686562 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.686767 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.686853 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.687067 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.687152 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.687370 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.687466 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.687672 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.687760 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.687981 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.688069 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.688309 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.688449 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.688617 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.688704 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.688919 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.689006 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.689226 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.689328 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.689528 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.689614 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.689858 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.689953 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.690189 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.690277 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.690504 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.690591 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.690827 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.690927 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.691138 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.691224 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.691459 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.691556 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.691767 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.691866 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.692087 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.692224 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.692435 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.692522 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.692752 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.692848 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.693068 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.693157 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.693400 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.693486 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.693715 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.693874 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.694052 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.694139 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.694368 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.694509 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.694685 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.694777 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.695000 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.695095 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.695314 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.695401 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.695643 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.695731 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.695970 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.696056 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.696308 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.696397 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.696636 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.696725 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.696957 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.697045 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.697283 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.697379 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.697603 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.697699 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.697916 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.698014 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.698247 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.698344 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.698558 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.698645 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.698869 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.698955 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.699187 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.699289 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.699499 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.699585 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.699810 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.699897 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.700124 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.700258 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.700466 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.700552 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.700792 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.700878 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.701120 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.701208 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.701445 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.701531 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.701770 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.701876 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.702116 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.702213 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.702430 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.702518 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.702776 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.702864 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.703106 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.703194 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.703424 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.703510 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.703737 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.703833 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.704044 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.704158 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:46:55.704313 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 07 12:46:55.704403 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 07 12:46:55.727441 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_db.sqlalchemy.engines [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:46:55.728521 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG oslo_db.sqlalchemy.engines [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:46:55.790705 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.context [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6788c331-568d-4778-a900-8ed7ce0b05bf(cell1) {{(pid=102482) load_cells /opt/stack/nova/nova/context.py:464}} Apr 07 12:46:55.792208 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.context [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6788c331-568d-4778-a900-8ed7ce0b05bf(cell1) {{(pid=102483) load_cells /opt/stack/nova/nova/context.py:464}} Apr 07 12:46:55.796474 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:46:55.797912 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG oslo_concurrency.lockutils [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:46:55.798082 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:46:55.798860 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:46:55.799498 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG oslo_concurrency.lockutils [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:46:55.800324 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG oslo_concurrency.lockutils [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:46:55.800790 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:46:55.802212 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG oslo_concurrency.lockutils [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:46:55.813603 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_db.sqlalchemy.engines [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:46:55.814735 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_db.sqlalchemy.engines [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:46:55.817549 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG oslo_db.sqlalchemy.engines [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:46:55.820579 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG oslo_db.sqlalchemy.engines [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:46:55.978143 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_db.sqlalchemy.engines [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:46:55.980767 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG oslo_db.sqlalchemy.engines [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:46:56.433887 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: WARNING keystonemiddleware.auth_token [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 12:46:56.440456 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: WARNING keystonemiddleware.auth_token [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 12:46:56.440991 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: WARNING keystonemiddleware.auth_token [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 12:46:56.447632 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: WARNING keystonemiddleware.auth_token [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 12:46:56.662090 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: WARNING keystonemiddleware.auth_token [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 12:46:56.667915 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: WARNING keystonemiddleware.auth_token [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 12:46:56.673086 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db959bc9c0 pid: 102483 (default app) Apr 07 12:46:56.673761 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: WARNING keystonemiddleware.auth_token [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 12:46:56.675162 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:46:56.676346 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Apr 07 12:46:56.676758 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Thu Apr 7 12:46:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:46:56.679521 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: WARNING keystonemiddleware.auth_token [None req-162bfb7a-8279-422f-ad4b-1b4ef619047c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 12:46:56.684843 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db959bc9c0 pid: 102482 (default app) Apr 07 12:48:16.259704 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:16.261190 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Apr 07 12:48:16.261962 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:48:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:48:16.710709 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-a267c79e-6b47-4d0b-988a-6f0cbfda606e admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:16.742882 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-a267c79e-6b47-4d0b-988a-6f0cbfda606e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.469347 Apr 07 12:48:16.743614 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1291 bytes} [Thu Apr 7 12:48:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:48:19.118997 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:19.119993 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-571841bd-d319-4438-afc2-fdae27bc53d4 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Apr 07 12:48:19.120433 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:48:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:48:19.180828 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-e3b67ad5-733b-49dc-840d-6f7d1e3e6169 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:19.199347 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 12:48:19.199347 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: warnings.warn(msg) Apr 07 12:48:19.226302 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-e3b67ad5-733b-49dc-840d-6f7d1e3e6169 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.099915 Apr 07 12:48:19.226854 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Apr 7 12:48:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 12:48:19.452128 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-3faeef47-da85-49ff-bf4d-19c7afc035de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:19.454680 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 12:48:19.454680 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: warnings.warn(msg) Apr 07 12:48:19.513468 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-3faeef47-da85-49ff-bf4d-19c7afc035de admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278120 Apr 07 12:48:19.514834 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1335 bytes} [Thu Apr 7 12:48:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:48:21.862101 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-e3b67ad5-733b-49dc-840d-6f7d1e3e6169 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:21.863124 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-e3b67ad5-733b-49dc-840d-6f7d1e3e6169 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Apr 07 12:48:21.863522 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:48:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:48:21.972685 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-8bfbf83d-b521-41ee-af49-57172d65a85f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:21.997576 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 12:48:21.997576 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: warnings.warn(msg) Apr 07 12:48:22.020040 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-8bfbf83d-b521-41ee-af49-57172d65a85f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149873 Apr 07 12:48:22.020949 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Apr 7 12:48:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 12:48:22.032816 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-d1d6eed5-fed0-4e58-ae8a-218164853321 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:22.034302 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 12:48:22.034302 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: warnings.warn(msg) Apr 07 12:48:22.069465 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-d1d6eed5-fed0-4e58-ae8a-218164853321 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040230 Apr 07 12:48:22.070405 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1335 bytes} [Thu Apr 7 12:48:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:48:24.470321 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-8bfbf83d-b521-41ee-af49-57172d65a85f admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:24.471443 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-8bfbf83d-b521-41ee-af49-57172d65a85f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Apr 07 12:48:24.472114 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:48:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:48:24.537796 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-2d8fff44-5e41-4888-8d2b-04389c73588a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "id": "d2", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:24.560338 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-2d8fff44-5e41-4888-8d2b-04389c73588a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081878 Apr 07 12:48:24.564252 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Apr 7 12:48:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:48:24.573848 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-a821e817-5a61-4f89-9e69-6c173b7ca609 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:24.609266 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-a821e817-5a61-4f89-9e69-6c173b7ca609 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039295 Apr 07 12:48:24.620194 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1335 bytes} [Thu Apr 7 12:48:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:48:26.985185 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-2d8fff44-5e41-4888-8d2b-04389c73588a admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:26.986201 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-2d8fff44-5e41-4888-8d2b-04389c73588a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Apr 07 12:48:26.986599 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:48:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:48:27.053581 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-f94f3e64-7427-4576-8857-29d68c85e30d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "vcpus": 2, "swap": 0, "id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:27.071387 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-f94f3e64-7427-4576-8857-29d68c85e30d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078332 Apr 07 12:48:27.071930 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Apr 7 12:48:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:48:27.083745 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-b3fc3ee9-0606-4972-b2c7-f91718cef42d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:27.106410 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-b3fc3ee9-0606-4972-b2c7-f91718cef42d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026385 Apr 07 12:48:27.106985 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1335 bytes} [Thu Apr 7 12:48:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:48:29.478128 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-f94f3e64-7427-4576-8857-29d68c85e30d admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:29.479149 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-f94f3e64-7427-4576-8857-29d68c85e30d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Apr 07 12:48:29.479549 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:48:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:48:29.539589 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-d94ec103-9eaf-4003-a41c-f5aa70aa22be admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "id": "d4", "swap": 0, "name": "ds4G"}} {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:29.558511 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-d94ec103-9eaf-4003-a41c-f5aa70aa22be admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073237 Apr 07 12:48:29.559386 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Apr 7 12:48:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:48:29.571487 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-bd2cbb86-f334-461d-8f79-b230bcd3b80f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:29.601404 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-bd2cbb86-f334-461d-8f79-b230bcd3b80f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034141 Apr 07 12:48:29.602464 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1335 bytes} [Thu Apr 7 12:48:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:48:31.942205 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-d94ec103-9eaf-4003-a41c-f5aa70aa22be admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:31.943822 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-d94ec103-9eaf-4003-a41c-f5aa70aa22be admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Apr 07 12:48:31.944239 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:48:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:48:32.005111 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-4f5a620c-3e9b-4eff-8668-73fedc8fafbf admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:32.029309 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-4f5a620c-3e9b-4eff-8668-73fedc8fafbf admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077453 Apr 07 12:48:32.029993 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1291 bytes} [Thu Apr 7 12:48:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:48:34.602595 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-d94ec103-9eaf-4003-a41c-f5aa70aa22be admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:34.603608 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-d94ec103-9eaf-4003-a41c-f5aa70aa22be admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Apr 07 12:48:34.604016 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:48:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:48:34.664121 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-52d29d45-095e-4a77-9518-a91a155c7754 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.tiny", "ram": 512, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:34.683263 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-52d29d45-095e-4a77-9518-a91a155c7754 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073088 Apr 07 12:48:34.683840 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Apr 7 12:48:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:48:34.697994 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-569d5ad3-ba9e-430d-af06-f4c7f56b47b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:34.726640 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-569d5ad3-ba9e-430d-af06-f4c7f56b47b5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033921 Apr 07 12:48:34.727475 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1332 bytes} [Thu Apr 7 12:48:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:48:37.132001 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-52d29d45-095e-4a77-9518-a91a155c7754 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:37.133059 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-52d29d45-095e-4a77-9518-a91a155c7754 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 Apr 07 12:48:37.133438 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:48:37.194162 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-928ab193-7b12-4e4e-8848-62c7197cdf3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "name": "m1.small", "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:37.212902 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-928ab193-7b12-4e4e-8848-62c7197cdf3e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073483 Apr 07 12:48:37.213451 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Apr 7 12:48:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 12:48:37.226134 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-82ab0396-e2ee-4f69-aa5a-212806ebe0c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:37.249231 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-82ab0396-e2ee-4f69-aa5a-212806ebe0c9 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027793 Apr 07 12:48:37.249840 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1332 bytes} [Thu Apr 7 12:48:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:48:39.741423 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-928ab193-7b12-4e4e-8848-62c7197cdf3e admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:39.742547 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-928ab193-7b12-4e4e-8848-62c7197cdf3e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Apr 07 12:48:39.742939 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:48:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:48:39.801349 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-f0713500-2b84-43b6-b63f-762f0b2dc252 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:39.820310 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-f0713500-2b84-43b6-b63f-762f0b2dc252 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071641 Apr 07 12:48:39.821047 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Apr 7 12:48:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 12:48:39.832458 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-f0dbfee2-6b85-47e2-a46b-401009f7a608 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:39.855335 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-f0dbfee2-6b85-47e2-a46b-401009f7a608 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026578 Apr 07 12:48:39.855913 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1332 bytes} [Thu Apr 7 12:48:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:48:42.263057 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-f0713500-2b84-43b6-b63f-762f0b2dc252 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:42.264082 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-f0713500-2b84-43b6-b63f-762f0b2dc252 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Apr 07 12:48:42.264796 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:48:42.328110 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-aa8f7289-9f09-4448-bbdc-ed214d7cba25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "id": "4", "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:42.349780 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-aa8f7289-9f09-4448-bbdc-ed214d7cba25 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079417 Apr 07 12:48:42.350321 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Apr 7 12:48:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:48:42.361855 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-93683d77-cd37-4ab5-8460-97ce9088a7b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:42.386395 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-93683d77-cd37-4ab5-8460-97ce9088a7b3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028208 Apr 07 12:48:42.387244 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1332 bytes} [Thu Apr 7 12:48:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:48:44.790903 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-aa8f7289-9f09-4448-bbdc-ed214d7cba25 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:48:44.797363 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-aa8f7289-9f09-4448-bbdc-ed214d7cba25 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006846 Apr 07 12:48:44.797765 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:48:44.861031 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-7d841072-cadd-4a56-9253-d047a3db8e31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "id": "5", "rxtx_factor": 1.0, "swap": 0}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:44.880522 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-7d841072-cadd-4a56-9253-d047a3db8e31 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075305 Apr 07 12:48:44.881676 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1282 bytes} [Thu Apr 7 12:48:44 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 12:48:44.893396 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-af2491fa-ee66-42c6-b75d-749559af1bb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:48:44.922695 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-af2491fa-ee66-42c6-b75d-749559af1bb0 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033167 Apr 07 12:48:44.923610 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1332 bytes} [Thu Apr 7 12:48:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:49:08.484325 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-7d841072-cadd-4a56-9253-d047a3db8e31 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:08.485333 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-7d841072-cadd-4a56-9253-d047a3db8e31 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Apr 07 12:49:08.485747 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:49:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:49:08.542711 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-20f63895-fa11-4cc9-8e2b-4f7f1e4d18cd admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:08.559744 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-20f63895-fa11-4cc9-8e2b-4f7f1e4d18cd admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068077 Apr 07 12:49:08.560299 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1291 bytes} [Thu Apr 7 12:49:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:49:09.931339 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-7d841072-cadd-4a56-9253-d047a3db8e31 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:09.932368 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-7d841072-cadd-4a56-9253-d047a3db8e31 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Apr 07 12:49:09.932768 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Apr 7 12:49:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:49:10.138682 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-daec29c5-c675-400c-a5ca-79b0e8cefde5 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:10.144159 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.wsgi [None req-daec29c5-c675-400c-a5ca-79b0e8cefde5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 07 12:49:10.144684 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-daec29c5-c675-400c-a5ca-79b0e8cefde5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:49:10.145489 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-daec29c5-c675-400c-a5ca-79b0e8cefde5 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057538 Apr 07 12:49:10.145974 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Apr 7 12:49:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 07 12:49:10.155833 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-388562f9-c333-4285-8be9-d9ad8c705bd4 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:10.176506 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-388562f9-c333-4285-8be9-d9ad8c705bd4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024458 Apr 07 12:49:10.177051 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Apr 7 12:49:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:49:10.187164 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-11b83411-b7ee-4680-bf7c-a2f286a6255a admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:10.207745 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-11b83411-b7ee-4680-bf7c-a2f286a6255a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024144 Apr 07 12:49:10.208299 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Apr 7 12:49:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:49:10.217537 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-9e2f118b-842f-43ee-9b1e-21695a3d2f2d admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:10.223007 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.wsgi [None req-9e2f118b-842f-43ee-9b1e-21695a3d2f2d admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 07 12:49:10.223577 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-9e2f118b-842f-43ee-9b1e-21695a3d2f2d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:49:10.224391 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-9e2f118b-842f-43ee-9b1e-21695a3d2f2d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010399 Apr 07 12:49:10.224877 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Apr 7 12:49:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 07 12:49:11.517064 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-11b83411-b7ee-4680-bf7c-a2f286a6255a admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:11.518102 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-11b83411-b7ee-4680-bf7c-a2f286a6255a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Apr 07 12:49:11.518496 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Apr 7 12:49:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:49:11.706624 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-503942fd-980a-4b4a-8ab6-6d3782c38d2a admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:11.712768 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.wsgi [None req-503942fd-980a-4b4a-8ab6-6d3782c38d2a admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 07 12:49:11.713307 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-503942fd-980a-4b4a-8ab6-6d3782c38d2a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:49:11.714092 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-503942fd-980a-4b4a-8ab6-6d3782c38d2a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057151 Apr 07 12:49:11.714583 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Apr 7 12:49:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 07 12:49:11.723709 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-6e1eb527-4b1b-422b-b871-74a959fbe3d0 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:11.737436 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-6e1eb527-4b1b-422b-b871-74a959fbe3d0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017178 Apr 07 12:49:11.737906 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Apr 7 12:49:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:49:11.749979 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-e6f3136b-52bc-46de-9939-ed3546301c83 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:11.767453 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-e6f3136b-52bc-46de-9939-ed3546301c83 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023179 Apr 07 12:49:11.768019 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Apr 7 12:49:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:49:11.778291 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-df17f84f-12cc-4a75-912c-67da5d371200 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:11.783810 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.wsgi [None req-df17f84f-12cc-4a75-912c-67da5d371200 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 07 12:49:11.784807 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-df17f84f-12cc-4a75-912c-67da5d371200 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:49:11.785478 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-df17f84f-12cc-4a75-912c-67da5d371200 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011610 Apr 07 12:49:11.786083 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Apr 7 12:49:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 07 12:49:13.074298 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-e6f3136b-52bc-46de-9939-ed3546301c83 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:13.075350 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-e6f3136b-52bc-46de-9939-ed3546301c83 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Apr 07 12:49:13.075767 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Apr 7 12:49:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:49:13.262471 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-d27953c2-f8d8-4c65-85ca-a5ec1c22da59 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:13.267580 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.wsgi [None req-d27953c2-f8d8-4c65-85ca-a5ec1c22da59 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 07 12:49:13.268136 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-d27953c2-f8d8-4c65-85ca-a5ec1c22da59 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:49:13.268928 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-d27953c2-f8d8-4c65-85ca-a5ec1c22da59 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056642 Apr 07 12:49:13.269421 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Apr 7 12:49:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 07 12:49:13.279079 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-9bd01213-7145-4b2b-af08-4ed1978aec5c admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:13.292942 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-9bd01213-7145-4b2b-af08-4ed1978aec5c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017629 Apr 07 12:49:13.293400 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Apr 7 12:49:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:49:13.302859 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:13.316109 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017104 Apr 07 12:49:13.316648 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Apr 7 12:49:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:49:13.326434 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-48f14aec-b1ed-4fc6-9363-ddd3e4e79d39 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:13.331479 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.wsgi [None req-48f14aec-b1ed-4fc6-9363-ddd3e4e79d39 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 07 12:49:13.332056 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-48f14aec-b1ed-4fc6-9363-ddd3e4e79d39 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:49:13.332863 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-48f14aec-b1ed-4fc6-9363-ddd3e4e79d39 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009883 Apr 07 12:49:13.333346 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Apr 7 12:49:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 07 12:49:14.612329 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:14.613339 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Apr 07 12:49:14.613730 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Apr 7 12:49:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:49:14.804392 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-98f667dc-13a7-4370-9f08-8ad4e5897657 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:49:14.823165 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-98f667dc-13a7-4370-9f08-8ad4e5897657 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071446 Apr 07 12:49:14.823630 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Apr 7 12:49:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:49:16.092893 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:16.093889 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Apr 07 12:49:16.094282 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Apr 7 12:49:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:49:16.283158 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-afedb54f-52c9-4896-a26f-0832b4b7dc5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:49:16.299735 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-afedb54f-52c9-4896-a26f-0832b4b7dc5b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067365 Apr 07 12:49:16.300309 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Apr 7 12:49:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:49:17.569428 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:17.570419 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Apr 07 12:49:17.571957 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Apr 7 12:49:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:49:17.760959 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-678906a3-9195-4296-9414-d724ade8dfef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:49:17.777616 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-678906a3-9195-4296-9414-d724ade8dfef admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067069 Apr 07 12:49:17.778164 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Apr 7 12:49:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:49:19.055544 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:19.056601 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 Apr 07 12:49:19.057023 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Apr 7 12:49:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:49:19.244541 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-c9e28235-f12a-45c1-b5e3-485a436cff79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:49:19.262256 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-c9e28235-f12a-45c1-b5e3-485a436cff79 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068496 Apr 07 12:49:19.262778 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Apr 7 12:49:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:49:20.533190 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:20.534192 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Apr 07 12:49:20.534580 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Apr 7 12:49:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:49:20.721983 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-cefb32e8-f429-4df1-99a0-3e156c39ad1c admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:49:20.741317 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-cefb32e8-f429-4df1-99a0-3e156c39ad1c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069594 Apr 07 12:49:20.741843 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Thu Apr 7 12:49:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:50:24.683041 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:50:24.684029 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-fc3ca975-5ff9-4e22-ba1a-ebe040aa6242 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Apr 07 12:50:24.684448 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 930 bytes} [Thu Apr 7 12:50:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:50:24.740595 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-ffdf899a-da49-45ea-9e62-2880c82d6be5 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:50:24.759322 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-ffdf899a-da49-45ea-9e62-2880c82d6be5 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069177 Apr 07 12:50:24.759839 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1291 bytes} [Thu Apr 7 12:50:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:50:24.782879 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-47b98215-5746-4ab6-9a2f-94730bc50d14 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:50:24.791751 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-47b98215-5746-4ab6-9a2f-94730bc50d14 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013060 Apr 07 12:50:24.792483 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1282 bytes} [Thu Apr 7 12:50:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:50:24.804028 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-96d7fb82-3974-4fda-bc49-88d40dea9ea5 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:50:24.812637 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-96d7fb82-3974-4fda-bc49-88d40dea9ea5 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012128 Apr 07 12:50:24.813164 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1285 bytes} [Thu Apr 7 12:50:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:50:24.824979 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-8574583f-5f86-4358-a775-7aaafc5135d9 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:50:24.832586 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-8574583f-5f86-4358-a775-7aaafc5135d9 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011116 Apr 07 12:50:24.833042 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1285 bytes} [Thu Apr 7 12:50:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:50:24.844608 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-7541de19-1fee-429c-b59d-071fd20e5685 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:50:24.852792 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-7541de19-1fee-429c-b59d-071fd20e5685 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011737 Apr 07 12:50:24.853317 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1282 bytes} [Thu Apr 7 12:50:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:52:06.169286 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-24672973-b373-408e-96a4-9805cdbbb97a tempest-verify_tempest_config-882672778 tempest-verify_tempest_config-882672778-project] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:52:06.171289 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-24672973-b373-408e-96a4-9805cdbbb97a tempest-verify_tempest_config-882672778 tempest-verify_tempest_config-882672778-project] 10.222.0.15 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106985 Apr 07 12:52:06.171822 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 34/69] 10.222.0.15 () {58 vars in 1133 bytes} [Thu Apr 7 12:52:06 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:53:46.439408 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-7541de19-1fee-429c-b59d-071fd20e5685 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:53:46.441144 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-7541de19-1fee-429c-b59d-071fd20e5685 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002182 Apr 07 12:53:46.441531 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 36/70] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Apr 7 12:53:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:53:46.706955 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-c873c632-ad29-4f0b-b22e-86cbda6e6d81 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:53:46.708127 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 12:53:46.708127 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: warnings.warn(msg) Apr 07 12:53:46.709337 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-c873c632-ad29-4f0b-b22e-86cbda6e6d81 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:53:46.709779 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-c873c632-ad29-4f0b-b22e-86cbda6e6d81 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:53:46.710561 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-c873c632-ad29-4f0b-b22e-86cbda6e6d81 admin admin] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:53:46.710987 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-c873c632-ad29-4f0b-b22e-86cbda6e6d81 admin admin] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:53:46.745620 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-c873c632-ad29-4f0b-b22e-86cbda6e6d81 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148971 Apr 07 12:53:46.746175 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 35/71] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Apr 7 12:53:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:53:48.032055 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-7541de19-1fee-429c-b59d-071fd20e5685 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:53:48.033081 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-7541de19-1fee-429c-b59d-071fd20e5685 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Apr 07 12:53:48.033549 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 37/72] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Apr 7 12:53:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:53:48.223424 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-a546cf12-3a3d-4244-9acd-2d6039e65de6 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:53:48.224639 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 12:53:48.224639 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: warnings.warn(msg) Apr 07 12:53:48.225828 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-a546cf12-3a3d-4244-9acd-2d6039e65de6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:53:48.226274 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-a546cf12-3a3d-4244-9acd-2d6039e65de6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:53:48.227099 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-a546cf12-3a3d-4244-9acd-2d6039e65de6 admin admin] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:53:48.227534 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-a546cf12-3a3d-4244-9acd-2d6039e65de6 admin admin] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:53:48.246680 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-a546cf12-3a3d-4244-9acd-2d6039e65de6 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074697 Apr 07 12:53:48.247214 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 36/73] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Apr 7 12:53:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:53:59.935268 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-7541de19-1fee-429c-b59d-071fd20e5685 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:53:59.936329 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-7541de19-1fee-429c-b59d-071fd20e5685 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Apr 07 12:53:59.936727 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 38/74] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Apr 7 12:53:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:54:00.126701 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-964a449e-cdd0-40b0-8f5a-7196c3f98aa1 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:54:00.128722 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 12:54:00.128722 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: warnings.warn(msg) Apr 07 12:54:00.129943 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-964a449e-cdd0-40b0-8f5a-7196c3f98aa1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:54:00.130381 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-964a449e-cdd0-40b0-8f5a-7196c3f98aa1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:54:00.131157 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-964a449e-cdd0-40b0-8f5a-7196c3f98aa1 admin admin] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:54:00.131582 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-964a449e-cdd0-40b0-8f5a-7196c3f98aa1 admin admin] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:54:00.156281 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-964a449e-cdd0-40b0-8f5a-7196c3f98aa1 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079651 Apr 07 12:54:00.156760 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 37/75] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Apr 7 12:54:00 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:54:01.431740 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-7541de19-1fee-429c-b59d-071fd20e5685 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:54:01.432809 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-7541de19-1fee-429c-b59d-071fd20e5685 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Apr 07 12:54:01.433202 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 39/76] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Apr 7 12:54:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:54:01.621159 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG nova.api.openstack.wsgi [None req-51743a80-b79a-4cec-a12d-311fd90159d5 admin admin] Calling method '>' {{(pid=102482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:54:01.622323 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 12:54:01.622323 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: warnings.warn(msg) Apr 07 12:54:01.623508 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-51743a80-b79a-4cec-a12d-311fd90159d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:54:01.623984 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-51743a80-b79a-4cec-a12d-311fd90159d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:54:01.624793 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-51743a80-b79a-4cec-a12d-311fd90159d5 admin admin] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:54:01.625222 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: DEBUG oslo_concurrency.lockutils [None req-51743a80-b79a-4cec-a12d-311fd90159d5 admin admin] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:54:01.647142 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: INFO nova.api.openstack.requestlog [None req-51743a80-b79a-4cec-a12d-311fd90159d5 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076558 Apr 07 12:54:01.647613 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: [pid: 102482|app: 0|req: 38/77] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Apr 7 12:54:01 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:54:59.210070 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: Thu Apr 7 12:54:59 2022 - graceful shutdown triggered... Apr 07 12:54:59.210577 dv-cinder-836944-2-iscsi devstack@n-api.service[102482]: Gracefully killing worker 1 (pid: 102482)... Apr 07 12:54:59.210188 dv-cinder-836944-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 07 12:54:59.211444 dv-cinder-836944-2-iscsi devstack@n-api.service[102483]: Gracefully killing worker 2 (pid: 102483)... Apr 07 12:55:00.211012 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: worker 1 buried after 1 seconds Apr 07 12:55:00.211012 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: worker 2 buried after 1 seconds Apr 07 12:55:00.211012 dv-cinder-836944-2-iscsi devstack@n-api.service[102481]: goodbye to uWSGI. Apr 07 12:55:00.213329 dv-cinder-836944-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 07 12:55:00.213918 dv-cinder-836944-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 07 12:55:00.216689 dv-cinder-836944-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 07 12:55:00.243028 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Apr 7 12:55:00 2022] *** Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: nodename: dv-cinder-836944-2-iscsi Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: machine: x86_64 Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: clock source: unix Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: pcre jit disabled Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: detected number of CPU cores: 4 Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: current working directory: / Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: detected binary path: /usr/bin/uwsgi-core Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: your processes number limit is 47680 Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: your memory page size is 4096 bytes Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: detected max file descriptor number: 2048 Apr 07 12:55:00.262030 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: lock engine: pthread robust mutexes Apr 07 12:55:00.263198 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: thunder lock: enabled Apr 07 12:55:00.263198 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 07 12:55:00.263198 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 07 12:55:00.308622 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: Python main interpreter initialized at 0x55594cb449c0 Apr 07 12:55:00.308622 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: python threads support enabled Apr 07 12:55:00.308622 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: your server socket listen backlog is limited to 100 connections Apr 07 12:55:00.308622 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: your mercy for graceful operations on workers is 90 seconds Apr 07 12:55:00.309041 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: mapped 403077 bytes (393 KB) for 2 cores Apr 07 12:55:00.309041 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: *** Operational MODE: preforking *** Apr 07 12:55:00.309317 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: *** uWSGI is running in multiple interpreter mode *** Apr 07 12:55:00.309317 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: spawned uWSGI master process (pid: 116835) Apr 07 12:55:00.309509 dv-cinder-836944-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 07 12:55:00.310633 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: spawned uWSGI worker 1 (pid: 116892, cores: 1) Apr 07 12:55:00.310633 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: spawned uWSGI worker 2 (pid: 116893, cores: 1) Apr 07 12:55:00.310633 dv-cinder-836944-2-iscsi devstack@n-api.service[116835]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 07 12:55:01.524156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 07 12:55:01.581726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 07 12:55:02.446357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 12:55:02.446357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: from cryptography.utils import int_from_bytes Apr 07 12:55:02.446688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 12:55:02.446688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: from cryptography.utils import int_from_bytes Apr 07 12:55:02.462595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 12:55:02.462595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: from cryptography.utils import int_from_bytes Apr 07 12:55:02.462926 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 12:55:02.462926 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: from cryptography.utils import int_from_bytes Apr 07 12:55:04.890175 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 07 12:55:04.890823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 07 12:55:04.890968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 07 12:55:04.891337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 07 12:55:04.891598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 07 12:55:04.892621 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.892952 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.893290 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.893622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.893961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.894282 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.894611 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.894942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.895276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.895545 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.895869 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.896223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836944-2-iscsi {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.896573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.896871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.897191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.897522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.897837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.898176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.898494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.899002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.899462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.899782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.900103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.900475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.900802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.901123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.901449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.901768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.902099 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.902418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.902828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836944-2-iscsi {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.903157 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.903485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.903811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.904265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.904589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.904910 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.905241 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.905850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.906172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.906526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.906838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.907164 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.908135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.908483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.909135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.909135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.909432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.909747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.910066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.910326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.910642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.910975 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.911305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.911653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.911883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.912156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.912536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.912861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.913184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.913504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.913823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.914142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.914459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.914778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.915096 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.915415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.915745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.916068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.916421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.916741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.917071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.917486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.917750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.918069 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.918423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.918750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.919069 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.919401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.919740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.920056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.920397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.920717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.921051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.921398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.921713 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.922004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.922317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.922635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.923001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.923324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.923728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.924056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.924397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.924719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.925038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.925358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.925676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.925993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.926306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.926622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.926936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.927250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.927576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.927905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.928244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.928563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.928877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.929193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.929522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.929681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 07 12:55:04.930105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.930196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 07 12:55:04.930296 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.930454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.930561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 07 12:55:04.930767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.930859 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 07 12:55:04.931080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.931278 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 07 12:55:04.931409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.931518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.931729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.931842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.932043 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.932180 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.932402 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.932549 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.932713 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.932852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.933030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.933126 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.933357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.933449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.933672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.933762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.933987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.934088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.934285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.934586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.934689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.934907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.935021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836944-2-iscsi {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.935221 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.935319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.935536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.935628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.935848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.935948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.936183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.936319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.936501 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.936692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.936821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.936924 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.937135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.937227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.937455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.937646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.937781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.937969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.938080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.938284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.938398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.938645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.938850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.938993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.939262 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.939375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.939614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.939724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.939940 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.940040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.940287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.940384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.940623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.940730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.940944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.941043 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.941268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.941371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836944-2-iscsi {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.941592 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.941685 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.941930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.942021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.942253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.942358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.942573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.942666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.942894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.942994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.943225 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.943332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.943552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.943650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.943891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.943983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.944241 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.944347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.944570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.944669 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.944898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.944995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.945216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.945320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.945542 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.945634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.945866 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.946006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.946171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.946264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.946488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.946580 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.946815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.946916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.947129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.947221 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.947442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.947540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.947701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.947796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.948019 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.948114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.948378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.948482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.948708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.948818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.949038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.949134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.949299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.949399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.949558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.949696 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.949884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.950019 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.950212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.950347 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.950531 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.950669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.950852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.950993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.951173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.951313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.951491 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.951636 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.951807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.951959 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.952126 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.952331 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.952466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.952657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.952785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.952984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.953112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.953309 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.953436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.953635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.953765 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.953957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.954084 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.954803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.955093 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.955193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.955429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.955529 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.955744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.955849 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.956058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.956186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.956403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.956501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.956717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.956813 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.957046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.957146 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.957373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.957470 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.957687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.957779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.958016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.958115 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.958328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.958417 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.958645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.958738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.958968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.959066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.959285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.959386 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.959601 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.959702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.959860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.959950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.960192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.960302 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.960513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.960605 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.960840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.960940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.961160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.961265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.961477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.961568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.961794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.961892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.962107 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.962207 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.962417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.962521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.962732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.962824 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.963048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.963146 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.963363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.963454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.963679 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.963781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.963992 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.964089 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.964336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.964437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.964654 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.964753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.964970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.965068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.965296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.965389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.965630 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.965729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.965941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.966044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.966254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.966344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.966569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.966668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.966884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.967027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.967208 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.967298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.967525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.967640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.967841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.967942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.968176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.968291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.968494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.968596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.968806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.968898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.969123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.969214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.969437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.969536 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.969755 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.970506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.970758 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.970938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.971089 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.971181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.971275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.971367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.971562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.971669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.971884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.972001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.972227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.972329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.972543 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.972675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.972855 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.972956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.973167 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.973267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.973480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.973587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.973793 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.973885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.974104 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.974204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.974413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.974515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.974740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.974839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.975069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.975168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.975393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.975486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.975734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.975904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.976050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.976231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.976403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.976509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 12:55:04.976683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.976787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.977007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.977147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.977338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.977432 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.977661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.977754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.977996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.978097 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.978319 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.978422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.978651 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.978743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.978970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.979075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.979296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.979394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.979636 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.979729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.979962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.980068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.980315 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.980409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.980642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.980734 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.980964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.981108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.981291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.981386 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.981612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.981754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.981934 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.982035 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.982258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.982350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.982608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.982748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.982887 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.982976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.983200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.983298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.983527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.983619 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.983846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.983946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.984187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.984295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.984509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.984607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.984838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.984932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.985150 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.985250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.985501 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.985660 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.985818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.985939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.986160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.986260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.986479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.986579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.986802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.986893 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.987128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.987264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.987446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.987547 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.987767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.987858 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.988087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.988209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.988425 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.988610 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.988744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.988837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.989063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.989154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.989385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.989489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.989703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.989795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.990021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.990111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.990344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.990444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.990661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.990752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.990979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.991077 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.991291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.991392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.991604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.991695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.991923 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.992016 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.992257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.992356 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.992573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.992677 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.992887 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.992987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.993203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.993297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.993516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.993614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.993828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.993928 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.994156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.994248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.994475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.994566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.994790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.994904 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.995100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.995193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.995414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.995513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.995740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.995891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.996060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.996251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.996393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.996531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.996709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.996820 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.997031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.997134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.997351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.997451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.997665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.997766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.997983 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.998073 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.998303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.998398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.998616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.998709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.998948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.999113 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.999262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.999362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.999574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.999667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.999890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:04.999988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.000233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.000329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.000555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.000655 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.000876 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.000969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.001217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.001310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.001541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.001634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.001859 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.001950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.002170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.002318 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.002490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.002581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.002815 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.002918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.003130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.003395 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.003496 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.003737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.003829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.004064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.004169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.004417 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.004587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.004731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.004868 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.005044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.005182 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.005360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.005454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.005675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.005767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.005994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.006095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.006307 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.006412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.006621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.006771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.006935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.007081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.007247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.007339 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.007557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.007664 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.007877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.007969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.008215 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.008310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.008530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.008633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.008840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.008933 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.009155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.009256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.009492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.009584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.009806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.009906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.010116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.010206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.010440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.010533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.010753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.010845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.011077 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.011169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.011391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.011491 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.011724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.011824 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.012040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.012168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.012376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.012468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.012691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.012782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.013004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.013104 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.013331 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.013425 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.013652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.013743 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.013979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.014085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.014298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.014398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.014628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.014721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.014952 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.015059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.015267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.015366 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.015577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.015675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.015900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.016002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.016237 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.016334 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.016552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.016652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.017424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.017539 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.017750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.017846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.018068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.018160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.018387 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.018488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.018702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.018800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.019018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.019110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.019335 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.019435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.019645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.019743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.019964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.020070 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.020303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.020396 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.020628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.020732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.020944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.021112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.021259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.021352 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.021576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.021695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.021897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.022066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.022192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.022305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.022507 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.022609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.022824 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.022928 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.023136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.023235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.023460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.023555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.023773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.023869 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.024084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.024211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.024421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.024525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.024736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.024828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.025051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.025150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.025364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.025464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.025673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.025766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.025992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.026083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.026304 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.026401 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.026618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.026712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.026936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.027035 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.027248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.027339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.027562 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.027659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.027877 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.027967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.028213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.028331 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.028530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.028630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.028841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.028934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.029167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.029267 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.029482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.029574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.029796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.029894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.030110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.030214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.030423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.030770 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.030984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.031075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.031297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.031402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.031610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.031701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.031922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.032014 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.032260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.032439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.032631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.032723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.032981 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.033120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.033300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.033439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.033616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.033757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.033941 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.034071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.034271 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.034425 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.034590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.034739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.034911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.035230 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.035378 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.035554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.035703 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.035884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.036030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.036230 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.036386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.036551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.036708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.036870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.037032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.037190 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.037354 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.037531 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.037669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.037826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.037993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.038159 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.038315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.038478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.038640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.038799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.038986 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.039120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.039275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.039434 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.039607 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.039753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.039931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.040079 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.040278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.040614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.040717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.040949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.041050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.041283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.041376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.041599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.041691 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.041920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.042025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.042241 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.042369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.042560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.042653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.042881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.042984 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.043201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.043295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.043524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.043626 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.043847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.043938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.044192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.044300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.044521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.044622 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.044843 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.044944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.045162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.045262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.045481 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.045574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.045794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.045893 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.046107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.046256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.046418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.046517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.046732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.046825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.047045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.047146 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.047360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.047452 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.047674 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.047785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.048508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.048664 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.048836 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.049006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.049236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.049458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.049578 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.049784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.049885 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.050109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.050200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.050424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.050589 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.050747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.050846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.051071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.051170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.051398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.051565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.051720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.051813 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.052033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.052129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.052464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.052581 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.052784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.052926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.053099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.053200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.053418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.053519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.053733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.053831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.054044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.054141 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.054354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.054459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.054673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.054774 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.054987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.055077 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.055302 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.055401 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.055617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.055716 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.055935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.056025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.056281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.056603 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.056708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.056918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.057019 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.057238 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.057368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.057551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.057745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.057876 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.058004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.058198 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.058428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.058521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.058748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.058840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.059069 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.059222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.059408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.059508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.059727 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.059818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.060049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.060178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.060386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.060477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.060711 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.060811 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.061024 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.061124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.061341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.061443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.061656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.061756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.061978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.062080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.062295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.062397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.062608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.062707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.062939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.063049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.063258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.063350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.063592 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.063709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.064053 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.064212 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.064409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.064521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.064725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.064818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.065042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.065142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.065370 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.065463 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.065702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.065804 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.066029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.066129 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.066343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.066435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.066662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.066768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.066977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.067078 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.067290 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.067380 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.067606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.067707 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.067920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.068034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.068259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.068368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.068574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.068678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.068888 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.069018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.069199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.069285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.069508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.069609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.069838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.069936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.070154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.070246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.070465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.070563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.070779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.070879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.071091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.071184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.071428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.071527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.071742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.071842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.072071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.072184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.072467 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.072575 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.072739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.072835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.073064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.073201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.073375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.073518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.073734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.074015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.074120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.074335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.074438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.074665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.074756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.074987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.075080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.075316 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.075409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.075641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.075761 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.075940 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.076039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.076296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.076419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.076623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.076732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.076943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.077046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.077274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.077366 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.077586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.077677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.077919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.078024 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.078222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.078334 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.078537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.078643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.078851 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.078944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.079172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.079317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.079608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.079826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.079929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.080165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.080272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.080505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.080605 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.080834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.080927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.081160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.081253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.081485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.081576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.081801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.081900 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.082115 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.082222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.082431 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.082531 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.082747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.082920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.083075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.083292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.083449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.083602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.083751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.083892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.084038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.084219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.084362 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.084511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.084651 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.084789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.084927 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.085063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.085211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.085362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.085643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.085783 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.085962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.086113 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.086285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.086440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.086585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.086671 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.086905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.087049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.087226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.087365 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.087550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.087692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.087871 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.088011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.088227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.088324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.088535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.088626 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.088863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.088983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.089512 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.089684 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.089785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.089873 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.089957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.090040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.090133 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.090343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.090443 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.090664 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.090765 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.090987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.091080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.091310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.091402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.091629 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.091720 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.091948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.092049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.092295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.092423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.092620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.092724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.092955 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.093065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.093287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.093392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.093620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.093730 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.093965 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.094138 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.094291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.094384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.094616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.094767 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.095450 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.095649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.095783 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.095996 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.096242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.096359 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.096573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.096673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.096894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.097008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.097216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.097347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.097542 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.097634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.097866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.097958 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.098194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.098353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.098515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.098722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.098922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.099063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.099223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.099361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.099499 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.099599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.099762 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.099886 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.100082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.100221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.100432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.100533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.100765 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.100873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.101110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.101211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.101439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.101539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.101763 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.101879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.102087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.102188 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.102405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.102504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.102727 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.102931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.103069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.103256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.103358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.103598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.103761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.103933 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.104082 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.104292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.104433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.104615 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.104764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.104937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.105078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.105253 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.105417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.105566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.105784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.105926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.106063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.106210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.106349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.106504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.106644 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.106790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.106948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.107101 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.107245 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.107403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.107555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.107701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.107847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.108015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.108179 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.108463 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.108565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.108727 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.108889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.109044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.109251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.109385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.109591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.109761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.109909 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.110004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.110248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.110354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.110683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.110788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.111022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.111123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.111344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.111438 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.111689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.111790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.112020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.112119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.112374 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.112495 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.112699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.112796 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.113034 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.113180 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.113349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.113455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.113633 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.113728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.113953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.114060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.114276 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.114373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.114583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.114687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.114891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.114992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.115207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.115298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.115520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.115621 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.115834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.115937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.116170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.116277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.116489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.116588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.116802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.116905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.117114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.117214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.117430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.117530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.117741 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.117833 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.118055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.118148 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.118366 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.118524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.118666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.118758 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.118983 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.119078 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.119305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.119405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.119624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.119718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.119945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.120047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.120322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.120417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.120644 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.120745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.120977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.121078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.121288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.121395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.121612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.121713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.121933 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.122031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.122258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.122367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.122576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.122710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.122898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.122991 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.123226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.123332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.123546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.123647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.123870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.124098 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.124224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.124522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.124615 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.124863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.125055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.125213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.125397 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.125559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.125723 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.125876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.126055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.126723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.126924 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.127059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.127254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.127364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.127577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.127682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.127898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.128001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.128244 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.128342 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.128571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.128691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.128880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.129038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.129214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.129363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.129538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.129687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.129863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.130002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.130182 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.130319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.130502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.130654 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.130823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.130973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.131143 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.131285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.131465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.131607 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.131814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.131954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.132156 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.132297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.132482 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.132633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.132790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.132930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.133114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.133265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.133435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.133586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.133826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.133954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.134076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.134184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.134375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.134468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.134694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.134794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.135015 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.135119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.135335 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.135428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.135651 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.135743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.135970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.136329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.136439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.136674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.136767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.137002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.137103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.137323 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.137414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.137643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.137733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.137965 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.138065 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.138296 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.138492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.138619 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.138814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.138952 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.139155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.139275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.139490 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.139613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.139822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.139968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.140163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.140333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.140495 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.140669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.140829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.140988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.141144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.141304 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.141456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.141619 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.142556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.142779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.142916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.143021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.143201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.143302 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.143543 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.143652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.143884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.144024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.144209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.144307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.144531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.144625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.144848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.144940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.145162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.145393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.145500 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.145749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.145850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.146077 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.146181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.146387 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.146488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.146700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.146801 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.147014 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.147115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.147328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.147430 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.147642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.147737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.147961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.148063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.148298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.148398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.148612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.148717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.148926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.149021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.149237 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.149338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.149547 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.149638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.149865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.149966 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.150184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.150328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.150499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.150599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.150819 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.150921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.151134 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.151227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.151472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.151570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.151786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.151892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.152105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.152217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.152447 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.152539 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.152770 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.152873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.153083 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.153183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.153397 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.153495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.153711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.153821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.154025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.154154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.154344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.154446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.154654 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.154747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.154972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.155071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.155284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.155377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.155885 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.155985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.156222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.156319 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.156546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.156651 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.156879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.156972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.157211 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.157343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.157613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.157715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.157927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.158227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.158330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.158560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.158662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.158886 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.158996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.159223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.159332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.159547 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.159649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.159868 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.159968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.160220 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.160330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.160557 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.160653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.160887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.161103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.161226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.161449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.161549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.161783 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.161877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.162131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.162259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.162478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.162598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.162801 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.162921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.163123 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.163233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.163441 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.163534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.163773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.163875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.164096 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.164244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.164451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.164548 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.164730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 07 12:55:05.164832 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.165082 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.165404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.165724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.166045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.166364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.166683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.167002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.167328 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.167647 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.167970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.168345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.168677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.169005 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.169330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.169656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.169976 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.170296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.170614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.170930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.171256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.171603 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.171927 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.172269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.172702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.173060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.173693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.174040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.174367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.174706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.175043 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.175369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.175721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.176031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.176396 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.176751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.177093 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.177435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.177754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.178071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.178388 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.178710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.179039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.179361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.179674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.179988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.180334 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.180656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.180972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.181288 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.181602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.181922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.182236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.182550 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.183117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.183252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.183706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.183846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.184075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.184431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.184734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.185049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.185364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.185681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.186026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.186371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.186697 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.187032 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.187363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.187694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.187785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_db.sqlalchemy.engines [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:55:05.188012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.188371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.189227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.189830 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.190070 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.190431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.190760 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.191064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.191390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.191710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.192031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.192378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.192719 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.193056 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.193373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.193709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.194056 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.194366 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.194693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.195014 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.195353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.195677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.195997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.196350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.196674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.196997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.197322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.197647 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.197992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.198328 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.198665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.199002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.199361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.199686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.200040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.200405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.200729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.201057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.201371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 12:55:05.201622 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 07 12:55:05.224835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_db.sqlalchemy.engines [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:55:05.254321 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.context [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6788c331-568d-4778-a900-8ed7ce0b05bf(cell1) {{(pid=116893) load_cells /opt/stack/nova/nova/context.py:464}} Apr 07 12:55:05.258760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:55:05.260365 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:55:05.261183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:55:05.263132 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:55:05.275097 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_db.sqlalchemy.engines [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:55:05.276292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_db.sqlalchemy.engines [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:55:05.290289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.context [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6788c331-568d-4778-a900-8ed7ce0b05bf(cell1) {{(pid=116892) load_cells /opt/stack/nova/nova/context.py:464}} Apr 07 12:55:05.296227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:55:05.297797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:55:05.298688 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:55:05.300646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:55:05.311545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_db.sqlalchemy.engines [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:55:05.312421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_db.sqlalchemy.engines [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:55:05.442089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_db.sqlalchemy.engines [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:55:05.480259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_db.sqlalchemy.engines [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 12:55:05.883626 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: WARNING keystonemiddleware.auth_token [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 12:55:05.890144 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: WARNING keystonemiddleware.auth_token [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 12:55:05.926280 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: WARNING keystonemiddleware.auth_token [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 12:55:05.932846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: WARNING keystonemiddleware.auth_token [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 12:55:06.119195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: WARNING keystonemiddleware.auth_token [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 12:55:06.124407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: WARNING keystonemiddleware.auth_token [None req-a867cdd2-0f9e-4150-9d0a-21eb6afa5e2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 12:55:06.129872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55594cb449c0 pid: 116893 (default app) Apr 07 12:55:06.160899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: WARNING keystonemiddleware.auth_token [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 12:55:06.166112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: WARNING keystonemiddleware.auth_token [None req-c56d12b1-848c-4225-a0a7-a47e692461ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 12:55:06.171698 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55594cb449c0 pid: 116892 (default app) Apr 07 12:55:47.613940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ce0ee79d-fe70-4d1a-a6e5-1b1aa8dffbb6 tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] Action: 'create', calling method: .version_select at 0x7fde59b54820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1089142060", "metadata": {"Type": "work"}}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:55:49.583110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ce0ee79d-fe70-4d1a-a6e5-1b1aa8dffbb6 tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.994236 Apr 07 12:55:49.586039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1155 bytes} [Thu Apr 7 12:55:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2998 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 07 12:55:49.721500 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-03de76df-c5b6-4a47-989f-1d342f94b10d tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] Calling method '.version_select at 0x7fde59a25820>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:49.821000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-03de76df-c5b6-4a47-989f-1d342f94b10d tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f1f7c7ea-36b6-4518-b706-5db214829104" status: 200 len: 350 microversion: 2.1 time: 0.104552 Apr 07 12:55:49.821571 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 2/2] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 12:55:49 2022] GET /compute/v2.1/os-volumes/f1f7c7ea-36b6-4518-b706-5db214829104 => generated 350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 12:55:49.907563 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6dca5254-7f72-4337-bc6a-05ff22e6d001 tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] Calling method '.version_select at 0x7fde59b54550>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:50.578953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6dca5254-7f72-4337-bc6a-05ff22e6d001 tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2a846c73-e7fe-4f89-8378-0d0d236da59b" status: 200 len: 354 microversion: 2.1 time: 0.986114 Apr 07 12:55:50.579542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1/3] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 12:55:49 2022] GET /compute/v2.1/os-volumes/2a846c73-e7fe-4f89-8378-0d0d236da59b => generated 354 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 12:55:50.598354 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e560ab91-4321-4bb0-a3a5-9df2bff287a9 tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] Calling method '.version_select at 0x7fde59a258b0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:50.688665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e560ab91-4321-4bb0-a3a5-9df2bff287a9 tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2a846c73-e7fe-4f89-8378-0d0d236da59b" status: 200 len: 354 microversion: 2.1 time: 0.100525 Apr 07 12:55:50.692284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 3/4] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 12:55:50 2022] GET /compute/v2.1/os-volumes/2a846c73-e7fe-4f89-8378-0d0d236da59b => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:55:50.706459 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5555982d-7a5e-42a1-947e-9060d0fa69b8 tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] Calling method '.version_select at 0x7fde59a078b0>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:50.883367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5555982d-7a5e-42a1-947e-9060d0fa69b8 tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/2a846c73-e7fe-4f89-8378-0d0d236da59b" status: 202 len: 0 microversion: 2.1 time: 0.181547 Apr 07 12:55:50.883938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 2/5] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Apr 7 12:55:50 2022] DELETE /compute/v2.1/os-volumes/2a846c73-e7fe-4f89-8378-0d0d236da59b => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 12:55:50.893622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8d0ab3fe-defb-4800-a225-de22a18bd38b tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] Calling method '.version_select at 0x7fde59a3c040>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:50.973999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8d0ab3fe-defb-4800-a225-de22a18bd38b tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2a846c73-e7fe-4f89-8378-0d0d236da59b" status: 200 len: 353 microversion: 2.1 time: 0.085607 Apr 07 12:55:50.974783 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 4/6] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 12:55:50 2022] GET /compute/v2.1/os-volumes/2a846c73-e7fe-4f89-8378-0d0d236da59b => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:55:51.409475 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d66dbba8-ba64-4e4d-92c8-14c7b0b382a5 tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] Calling method '.version_select at 0x7fde59a07f70>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:51.554483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d66dbba8-ba64-4e4d-92c8-14c7b0b382a5 tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b83d779b-8e90-4ae7-9233-58dd4cf30182" status: 200 len: 350 microversion: 2.1 time: 0.151953 Apr 07 12:55:51.560736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 3/7] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 12:55:51 2022] GET /compute/v2.1/os-volumes/b83d779b-8e90-4ae7-9233-58dd4cf30182 => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:55:51.732105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-148131501", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "networks": [{"uuid": "155aa673-a8bd-4062-9f60-22f776573692"}]}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:55:51.955760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.network.neutron [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] validate_networks() for [('155aa673-a8bd-4062-9f60-22f776573692', None, None, None, None, None)] {{(pid=116893) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 12:55:51.988295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b38cdbbd-59c3-479e-a075-0e84cca40dac tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] Calling method '.version_select at 0x7fde59a07c10>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:52.040609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-b38cdbbd-59c3-479e-a075-0e84cca40dac tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] HTTP exception thrown: Volume 2a846c73-e7fe-4f89-8378-0d0d236da59b could not be found. Apr 07 12:55:52.041340 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b38cdbbd-59c3-479e-a075-0e84cca40dac tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] Returning 404 to user: Volume 2a846c73-e7fe-4f89-8378-0d0d236da59b could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:55:52.042465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b38cdbbd-59c3-479e-a075-0e84cca40dac tempest-VolumesGetTestJSON-592475552 tempest-VolumesGetTestJSON-592475552-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2a846c73-e7fe-4f89-8378-0d0d236da59b" status: 404 len: 109 microversion: 2.1 time: 0.059726 Apr 07 12:55:52.043197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 12:55:51 2022] GET /compute/v2.1/os-volumes/2a846c73-e7fe-4f89-8378-0d0d236da59b => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 07 12:55:53.334047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eea0d487-ff3b-4fb2-b238-17ab92731a35 tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] Calling method '.version_select at 0x7fde5a374040>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:53.393484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eea0d487-ff3b-4fb2-b238-17ab92731a35 tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/4219fa92-e656-48ba-b16d-a7e7049b5f79" status: 200 len: 350 microversion: 2.1 time: 0.064719 Apr 07 12:55:53.394381 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 5/9] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 12:55:53 2022] GET /compute/v2.1/os-volumes/4219fa92-e656-48ba-b16d-a7e7049b5f79 => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 12:55:53.412580 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-849afcb4-ac24-4756-ac8d-f6147689fbf6 tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] Calling method '.version_select at 0x7fde599dd0d0>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:53.602100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-849afcb4-ac24-4756-ac8d-f6147689fbf6 tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.198174 Apr 07 12:55:53.603932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 6/10] 10.222.0.15 () {58 vars in 1133 bytes} [Thu Apr 7 12:55:53 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:55:53.620136 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-89724fc9-3d5b-47d9-b18e-8b59443e1ec0 tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] Calling method '.version_select at 0x7fde599ddb80>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:53.806168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-89724fc9-3d5b-47d9-b18e-8b59443e1ec0 tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.191195 Apr 07 12:55:53.808026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 7/11] 10.222.0.15 () {58 vars in 1148 bytes} [Thu Apr 7 12:55:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:55:53.826310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-394bea3b-0ed2-4464-bf0f-381aff01a5cc tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] Calling method '.version_select at 0x7fde599dd940>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:53.988403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Flavor limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 12:55:53.989473 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Image limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 12:55:53.990121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Flavor pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 12:55:53.990797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Image pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 12:55:53.991365 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 12:55:54.015917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:55:54.016410 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:55:54.017215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:55:54.017650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:55:54.056985 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-394bea3b-0ed2-4464-bf0f-381aff01a5cc tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.235362 Apr 07 12:55:54.063867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 8/12] 10.222.0.15 () {58 vars in 1133 bytes} [Thu Apr 7 12:55:53 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:55:54.068894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-15b8a259-9f97-4229-8dbc-974e9a3dd1d8 tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] Calling method '.version_select at 0x7fde59a07af0>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:54.094643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Getting quotas for project 17fcd10b43a74230a4c4ede819d85b69. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:55:54.111480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Getting quotas for user daabde129e49478fba6478b7d25751c1 and project 17fcd10b43a74230a4c4ede819d85b69. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:55:54.131876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Going to run 1 instances... {{(pid=116893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 12:55:54.134739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 12:55:54.274067 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-15b8a259-9f97-4229-8dbc-974e9a3dd1d8 tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.209026 Apr 07 12:55:54.274639 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 9/13] 10.222.0.15 () {58 vars in 1166 bytes} [Thu Apr 7 12:55:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:55:54.287241 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-00c2617a-0b44-4e90-8bed-4893cce6f702 tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] Calling method '.version_select at 0x7fde599f51f0>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:54.289385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cbfbf38e-86fe-421f-ab92-830523caf606 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.799615 Apr 07 12:55:54.312591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 5/14] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 12:55:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 12:55:54.324731 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3725e29e-17f8-499f-ba38-a39e64de1461 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:54.325358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3725e29e-17f8-499f-ba38-a39e64de1461 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:55:54.506129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-00c2617a-0b44-4e90-8bed-4893cce6f702 tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.222488 Apr 07 12:55:54.507046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 10/15] 10.222.0.15 () {58 vars in 1169 bytes} [Thu Apr 7 12:55:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:55:54.519355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-802bd0bf-24e8-4821-b5cf-6db8045d7cdf tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] Calling method '.version_select at 0x7fde59a079d0>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:54.697672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-802bd0bf-24e8-4821-b5cf-6db8045d7cdf tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.182760 Apr 07 12:55:54.698528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 11/16] 10.222.0.15 () {58 vars in 1154 bytes} [Thu Apr 7 12:55:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:55:54.709635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-77812ea4-2445-456d-8a38-5900a76c880d tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] Calling method '.version_select at 0x7fde599dd430>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:54.754899 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3725e29e-17f8-499f-ba38-a39e64de1461 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:55:54.774000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3725e29e-17f8-499f-ba38-a39e64de1461 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1214 microversion: 2.1 time: 0.460018 Apr 07 12:55:54.776494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 6/17] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:55:54 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1214 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:55:54.915373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-77812ea4-2445-456d-8a38-5900a76c880d tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.209332 Apr 07 12:55:54.919335 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 12/18] 10.222.0.15 () {58 vars in 1187 bytes} [Thu Apr 7 12:55:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:55:54.931285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-82b35e9e-96ae-4d5b-8274-72ab441c306c tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] Calling method '.version_select at 0x7fde59938f70>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:55.198594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-82b35e9e-96ae-4d5b-8274-72ab441c306c tempest-VolumesTestJSON-1414800391 tempest-VolumesTestJSON-1414800391-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.271159 Apr 07 12:55:55.199896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 7/19] 10.222.0.15 () {58 vars in 1154 bytes} [Thu Apr 7 12:55:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:55:55.796846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-371b9b19-4e89-49b8-8b84-b0276534e6b4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:55.797780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-371b9b19-4e89-49b8-8b84-b0276534e6b4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:55:56.299998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-371b9b19-4e89-49b8-8b84-b0276534e6b4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:55:56.340854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-371b9b19-4e89-49b8-8b84-b0276534e6b4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1214 microversion: 2.1 time: 0.534447 Apr 07 12:55:56.346690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 13/20] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:55:55 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1214 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:55:57.365236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-67819131-c24a-41fd-af91-9ce81ad7916f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:57.365856 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-67819131-c24a-41fd-af91-9ce81ad7916f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:55:57.389564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-67819131-c24a-41fd-af91-9ce81ad7916f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:55:57.392586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-67819131-c24a-41fd-af91-9ce81ad7916f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:55:57.395022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-67819131-c24a-41fd-af91-9ce81ad7916f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:55:57.395608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-67819131-c24a-41fd-af91-9ce81ad7916f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:55:57.885125 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-67819131-c24a-41fd-af91-9ce81ad7916f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:55:57.909189 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-67819131-c24a-41fd-af91-9ce81ad7916f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1218 microversion: 2.1 time: 0.548561 Apr 07 12:55:57.911577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 8/21] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:55:57 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1218 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:55:58.926794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8bb36897-4fa4-4be9-b7e4-e5ad4d6f1fea tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:55:58.927985 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8bb36897-4fa4-4be9-b7e4-e5ad4d6f1fea tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:55:58.939218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8bb36897-4fa4-4be9-b7e4-e5ad4d6f1fea tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:55:58.940286 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8bb36897-4fa4-4be9-b7e4-e5ad4d6f1fea tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:55:58.942300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8bb36897-4fa4-4be9-b7e4-e5ad4d6f1fea tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:55:58.943101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8bb36897-4fa4-4be9-b7e4-e5ad4d6f1fea tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:55:59.170444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8bb36897-4fa4-4be9-b7e4-e5ad4d6f1fea tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:55:59.198350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8bb36897-4fa4-4be9-b7e4-e5ad4d6f1fea tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1284 microversion: 2.1 time: 0.274388 Apr 07 12:55:59.199717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 14/22] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:55:58 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:00.216392 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-40bf3bde-2d39-4c1d-b41d-be0c758cb7fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:00.217256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-40bf3bde-2d39-4c1d-b41d-be0c758cb7fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:00.231415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40bf3bde-2d39-4c1d-b41d-be0c758cb7fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:00.231873 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40bf3bde-2d39-4c1d-b41d-be0c758cb7fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:00.241745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40bf3bde-2d39-4c1d-b41d-be0c758cb7fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:00.242476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40bf3bde-2d39-4c1d-b41d-be0c758cb7fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:00.709656 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-40bf3bde-2d39-4c1d-b41d-be0c758cb7fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:00.724274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-40bf3bde-2d39-4c1d-b41d-be0c758cb7fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1272 microversion: 2.1 time: 0.511734 Apr 07 12:56:00.736916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 9/23] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:00 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1272 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:01.741629 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b479e996-d5c6-4f7a-8df0-2c11083f54e8 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:01.742256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b479e996-d5c6-4f7a-8df0-2c11083f54e8 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:01.753487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b479e996-d5c6-4f7a-8df0-2c11083f54e8 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:01.756123 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b479e996-d5c6-4f7a-8df0-2c11083f54e8 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:01.758812 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b479e996-d5c6-4f7a-8df0-2c11083f54e8 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:01.776739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b479e996-d5c6-4f7a-8df0-2c11083f54e8 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:02.069656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b479e996-d5c6-4f7a-8df0-2c11083f54e8 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:02.081735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b479e996-d5c6-4f7a-8df0-2c11083f54e8 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1272 microversion: 2.1 time: 0.343762 Apr 07 12:56:02.086038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 15/24] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:01 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1272 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:03.104569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5bbfb6ec-33b0-46e2-a6ba-0298010e5f88 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:03.106139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5bbfb6ec-33b0-46e2-a6ba-0298010e5f88 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:03.120522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bbfb6ec-33b0-46e2-a6ba-0298010e5f88 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:03.125377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bbfb6ec-33b0-46e2-a6ba-0298010e5f88 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:03.129181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bbfb6ec-33b0-46e2-a6ba-0298010e5f88 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:03.132179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bbfb6ec-33b0-46e2-a6ba-0298010e5f88 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:03.557334 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5bbfb6ec-33b0-46e2-a6ba-0298010e5f88 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:03.572974 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5bbfb6ec-33b0-46e2-a6ba-0298010e5f88 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1272 microversion: 2.1 time: 0.472344 Apr 07 12:56:03.585925 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 10/25] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:03 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1272 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:04.603108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-feb56362-f854-47e9-853b-2a5a484ca50d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:04.604828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-feb56362-f854-47e9-853b-2a5a484ca50d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:04.624535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-feb56362-f854-47e9-853b-2a5a484ca50d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:04.628390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-feb56362-f854-47e9-853b-2a5a484ca50d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:04.630642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-feb56362-f854-47e9-853b-2a5a484ca50d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:04.635022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-feb56362-f854-47e9-853b-2a5a484ca50d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:04.922794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-feb56362-f854-47e9-853b-2a5a484ca50d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:04.943207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-feb56362-f854-47e9-853b-2a5a484ca50d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1272 microversion: 2.1 time: 0.340807 Apr 07 12:56:04.946666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 16/26] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:04 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1272 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:05.971204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-50e6c2d5-1937-430d-9b46-37bf050f41a6 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:05.971899 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-50e6c2d5-1937-430d-9b46-37bf050f41a6 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:05.982491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50e6c2d5-1937-430d-9b46-37bf050f41a6 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:05.988686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50e6c2d5-1937-430d-9b46-37bf050f41a6 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:05.990643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50e6c2d5-1937-430d-9b46-37bf050f41a6 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:05.993824 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50e6c2d5-1937-430d-9b46-37bf050f41a6 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:07.524351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-297451530", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:07.837143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.network.neutron [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] validate_networks() for [('02be5230-dc72-46d8-8183-35a63cb29776', None, None, None, None, None)] {{(pid=116892) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 12:56:08.310507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-50e6c2d5-1937-430d-9b46-37bf050f41a6 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:08.335882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-50e6c2d5-1937-430d-9b46-37bf050f41a6 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 2.372612 Apr 07 12:56:08.342738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 11/27] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:05 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 2380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:09.362927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5a3cad18-df1b-49f7-a4c0-11bfeff37749 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:09.363628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5a3cad18-df1b-49f7-a4c0-11bfeff37749 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:09.375203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a3cad18-df1b-49f7-a4c0-11bfeff37749 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:09.375668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a3cad18-df1b-49f7-a4c0-11bfeff37749 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:09.380376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a3cad18-df1b-49f7-a4c0-11bfeff37749 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:09.380845 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a3cad18-df1b-49f7-a4c0-11bfeff37749 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:10.555924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5a3cad18-df1b-49f7-a4c0-11bfeff37749 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:10.575046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5a3cad18-df1b-49f7-a4c0-11bfeff37749 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 1.218175 Apr 07 12:56:10.576097 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 12/28] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:09 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:11.598772 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4e0b911e-bcaa-4519-801c-938a1f1372b4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:11.613365 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4e0b911e-bcaa-4519-801c-938a1f1372b4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:11.635798 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4e0b911e-bcaa-4519-801c-938a1f1372b4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:11.638890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4e0b911e-bcaa-4519-801c-938a1f1372b4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:11.647002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4e0b911e-bcaa-4519-801c-938a1f1372b4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:11.650165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4e0b911e-bcaa-4519-801c-938a1f1372b4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:12.056820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Flavor limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 12:56:12.057937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Image limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 12:56:12.058633 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Flavor pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 12:56:12.059257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Image pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 12:56:12.060447 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 12:56:12.096213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:12.097078 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:12.098162 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:12.098864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:12.146301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Getting quotas for project 551ec87d1b5e4245aa75e1990d2f3139. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:56:12.172055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Getting quotas for user 8802ee1876204b2c85b9e54ec50d30f1 and project 551ec87d1b5e4245aa75e1990d2f3139. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:56:12.239491 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Going to run 1 instances... {{(pid=116892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 12:56:12.251204 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 12:56:12.281764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4e0b911e-bcaa-4519-801c-938a1f1372b4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:12.322043 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4e0b911e-bcaa-4519-801c-938a1f1372b4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 0.720668 Apr 07 12:56:12.323012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 13/29] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:11 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:12.558148 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-04fdabd3-10fe-4615-a6b5-61fd0e12628e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.161595 Apr 07 12:56:12.559112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 17/30] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 12:56:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 6163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 07 12:56:12.573312 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-62367e79-8251-4ea2-b35b-c8627f807754 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:12.573967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-62367e79-8251-4ea2-b35b-c8627f807754 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:12.702667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-62367e79-8251-4ea2-b35b-c8627f807754 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:12.729227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-62367e79-8251-4ea2-b35b-c8627f807754 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1221 microversion: 2.1 time: 0.160032 Apr 07 12:56:12.729828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 18/31] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:12 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1221 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:13.610105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0a8f5e70-682c-43a0-941c-4440a276cd9c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Action: 'create', calling method: .version_select at 0x7fde587bd160>, body: {"keypair": {"name": "tempest-keypair-1082620730"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:13.705339 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-0a8f5e70-682c-43a0-941c-4440a276cd9c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Getting quotas for project ad6bab4269a84eae81e793309488d7dd. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:56:13.715223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-0a8f5e70-682c-43a0-941c-4440a276cd9c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Getting quotas for user 7a36496b3c774c2097534b5fcad47db8 and project ad6bab4269a84eae81e793309488d7dd. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:56:13.803871 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-82ad6433-3401-496c-97a9-34a9cd621fd1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Action: 'create', calling method: .version_select at 0x7fde58fd1c10>, body: {"keypair": {"name": "tempest-keypair-1737221470"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:13.898126 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-82ad6433-3401-496c-97a9-34a9cd621fd1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Getting quotas for project 5bd01388259c4fe2be6df63ac77c05c1. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:56:13.932409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-82ad6433-3401-496c-97a9-34a9cd621fd1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Getting quotas for user e1417845e6994b12a81febfff5e63ce2 and project 5bd01388259c4fe2be6df63ac77c05c1. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:56:14.474411 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-0a8f5e70-682c-43a0-941c-4440a276cd9c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Getting quotas for project ad6bab4269a84eae81e793309488d7dd. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:56:14.488204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-0a8f5e70-682c-43a0-941c-4440a276cd9c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Getting quotas for user 7a36496b3c774c2097534b5fcad47db8 and project ad6bab4269a84eae81e793309488d7dd. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:56:14.523139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0a8f5e70-682c-43a0-941c-4440a276cd9c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 2.063969 Apr 07 12:56:14.525652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 14/32] 10.222.0.15 () {60 vars in 1157 bytes} [Thu Apr 7 12:56:12 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:14.541730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cd1dfa0e-726d-4a50-873a-0a138e64b9ae tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:14.542535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cd1dfa0e-726d-4a50-873a-0a138e64b9ae tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:14.563969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cd1dfa0e-726d-4a50-873a-0a138e64b9ae tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:14.566343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cd1dfa0e-726d-4a50-873a-0a138e64b9ae tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:14.570304 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cd1dfa0e-726d-4a50-873a-0a138e64b9ae tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:14.570995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cd1dfa0e-726d-4a50-873a-0a138e64b9ae tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:14.810750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-82ad6433-3401-496c-97a9-34a9cd621fd1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Getting quotas for project 5bd01388259c4fe2be6df63ac77c05c1. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:56:14.841087 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-82ad6433-3401-496c-97a9-34a9cd621fd1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Getting quotas for user e1417845e6994b12a81febfff5e63ce2 and project 5bd01388259c4fe2be6df63ac77c05c1. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:56:14.886393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-82ad6433-3401-496c-97a9-34a9cd621fd1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 2.152040 Apr 07 12:56:14.887066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 19/33] 10.222.0.15 () {62 vars in 1198 bytes} [Thu Apr 7 12:56:12 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2157 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 07 12:56:14.902831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1956367846", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:15.027491 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.network.neutron [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] validate_networks() for [('02be5230-dc72-46d8-8183-35a63cb29776', None, None, None, None, None)] {{(pid=116892) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 12:56:15.854518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cd1dfa0e-726d-4a50-873a-0a138e64b9ae tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:15.868625 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cd1dfa0e-726d-4a50-873a-0a138e64b9ae tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 1.336918 Apr 07 12:56:15.869256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 15/34] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:14 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:16.313133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-18f79d93-42bf-4044-982d-b5da0b8ffb75 req-bfe61669-d420-449a-b500-27c63a6692d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8280810-53d2-4a3f-8bae-bdf653d6de32", "tag": "6fd76b8f-140a-4745-9cac-0e55a348d1ae"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:16.329322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-18f79d93-42bf-4044-982d-b5da0b8ffb75 req-bfe61669-d420-449a-b500-27c63a6692d8 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:16.332896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-18f79d93-42bf-4044-982d-b5da0b8ffb75 req-bfe61669-d420-449a-b500-27c63a6692d8 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:16.383653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-18f79d93-42bf-4044-982d-b5da0b8ffb75 req-bfe61669-d420-449a-b500-27c63a6692d8 service nova] Creating event network-changed:6fd76b8f-140a-4745-9cac-0e55a348d1ae for instance f8280810-53d2-4a3f-8bae-bdf653d6de32 on hv-cinder-83694 Apr 07 12:56:16.384485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-18f79d93-42bf-4044-982d-b5da0b8ffb75 req-bfe61669-d420-449a-b500-27c63a6692d8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116893) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 07 12:56:16.386216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b02404d3-29ea-4d74-ad42-f2d737bf4fbd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:16.386935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b02404d3-29ea-4d74-ad42-f2d737bf4fbd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:16.387926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b02404d3-29ea-4d74-ad42-f2d737bf4fbd None None] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:16.388570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b02404d3-29ea-4d74-ad42-f2d737bf4fbd None None] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:16.420095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.compute.rpcapi [None req-b02404d3-29ea-4d74-ad42-f2d737bf4fbd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 07 12:56:16.426750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b02404d3-29ea-4d74-ad42-f2d737bf4fbd None None] Releasing lock "compute-rpcapi-router" {{(pid=116893) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 07 12:56:16.468992 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b02404d3-29ea-4d74-ad42-f2d737bf4fbd None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.595728 Apr 07 12:56:16.469887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 16/35] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:56:16.492311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Flavor limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 12:56:16.492811 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Image limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 12:56:16.493304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Flavor pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 12:56:16.493740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Image pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 12:56:16.494227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 12:56:16.509343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:16.512064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:16.512064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:16.519327 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:16.660617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Getting quotas for project 551ec87d1b5e4245aa75e1990d2f3139. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:56:16.675914 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Getting quotas for user 8802ee1876204b2c85b9e54ec50d30f1 and project 551ec87d1b5e4245aa75e1990d2f3139. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:56:16.734494 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Going to run 1 instances... {{(pid=116892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 12:56:16.746566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 12:56:16.895719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e3c9957b-666e-4477-9e52-f9cab389554f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:16.897141 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e3c9957b-666e-4477-9e52-f9cab389554f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:16.929895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e3c9957b-666e-4477-9e52-f9cab389554f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:16.932969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e3c9957b-666e-4477-9e52-f9cab389554f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:16.934093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e3c9957b-666e-4477-9e52-f9cab389554f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:16.937394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e3c9957b-666e-4477-9e52-f9cab389554f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:16.937838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ddb0e7a3-c317-47cd-8385-3c0ff4936304 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.047686 Apr 07 12:56:16.942834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 20/36] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 12:56:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 12:56:16.973188 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dc795adc-cedd-4993-b02a-7c293cf823c3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:16.979291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dc795adc-cedd-4993-b02a-7c293cf823c3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:17.689675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dc795adc-cedd-4993-b02a-7c293cf823c3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:17.705041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dc795adc-cedd-4993-b02a-7c293cf823c3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1222 microversion: 2.1 time: 0.757100 Apr 07 12:56:17.712154 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 21/37] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:16 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1222 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:18.565724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e3c9957b-666e-4477-9e52-f9cab389554f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:18.585092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e3c9957b-666e-4477-9e52-f9cab389554f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 1.700925 Apr 07 12:56:18.585964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 17/38] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:16 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:18.725711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-92856c8d-1bf3-420e-a05c-b1101bbd9042 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:18.727190 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-92856c8d-1bf3-420e-a05c-b1101bbd9042 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:18.747750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-92856c8d-1bf3-420e-a05c-b1101bbd9042 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:18.752401 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-92856c8d-1bf3-420e-a05c-b1101bbd9042 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:18.756317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-92856c8d-1bf3-420e-a05c-b1101bbd9042 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:18.757247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-92856c8d-1bf3-420e-a05c-b1101bbd9042 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:18.958835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-92856c8d-1bf3-420e-a05c-b1101bbd9042 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:18.975042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-92856c8d-1bf3-420e-a05c-b1101bbd9042 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1282 microversion: 2.1 time: 0.256048 Apr 07 12:56:18.978282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 22/39] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:18 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1282 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:19.603247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-73291c78-5def-4ebc-99f3-447a67974980 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:19.604611 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-73291c78-5def-4ebc-99f3-447a67974980 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:19.612573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-73291c78-5def-4ebc-99f3-447a67974980 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:19.613041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-73291c78-5def-4ebc-99f3-447a67974980 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:19.613847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-73291c78-5def-4ebc-99f3-447a67974980 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:19.621541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-73291c78-5def-4ebc-99f3-447a67974980 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:19.997670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-036d9620-c0fa-4e77-b283-02364324b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:19.999839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-036d9620-c0fa-4e77-b283-02364324b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:20.013766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-036d9620-c0fa-4e77-b283-02364324b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:20.016112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-036d9620-c0fa-4e77-b283-02364324b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:20.022974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-036d9620-c0fa-4e77-b283-02364324b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:20.024832 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-036d9620-c0fa-4e77-b283-02364324b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:20.168591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-036d9620-c0fa-4e77-b283-02364324b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:20.179998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-036d9620-c0fa-4e77-b283-02364324b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1280 microversion: 2.1 time: 0.187139 Apr 07 12:56:20.183535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 23/40] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:19 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:20.666736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-73291c78-5def-4ebc-99f3-447a67974980 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:20.683280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-73291c78-5def-4ebc-99f3-447a67974980 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 1.082642 Apr 07 12:56:20.699176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 18/41] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:19 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:21.198283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e1c90ee5-baa3-43c8-bc4a-25bfe4798da1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:21.198910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e1c90ee5-baa3-43c8-bc4a-25bfe4798da1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:21.208930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1c90ee5-baa3-43c8-bc4a-25bfe4798da1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:21.210528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1c90ee5-baa3-43c8-bc4a-25bfe4798da1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:21.211357 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1c90ee5-baa3-43c8-bc4a-25bfe4798da1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:21.212227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1c90ee5-baa3-43c8-bc4a-25bfe4798da1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:21.236889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-841596015", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0e470bc-57ea-4197-b4ec-4fc63c4ef6b2"}], "security_groups": [{"name": "tempest-securitygroup--1528061662"}], "key_name": "tempest-keypair-1737221470", "user_data": "}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:21.342720 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e1c90ee5-baa3-43c8-bc4a-25bfe4798da1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:21.354416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e1c90ee5-baa3-43c8-bc4a-25bfe4798da1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1280 microversion: 2.1 time: 0.160130 Apr 07 12:56:21.359111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 24/42] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:21 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1280 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:21.534985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.network.neutron [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] validate_networks() for [('f0e470bc-57ea-4197-b4ec-4fc63c4ef6b2', None, None, None, None, None)] {{(pid=116893) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 12:56:21.703337 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3ae884cc-3f6c-44c3-bf40-29d592045d0e tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:21.703993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3ae884cc-3f6c-44c3-bf40-29d592045d0e tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:21.718475 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3ae884cc-3f6c-44c3-bf40-29d592045d0e tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:21.718994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3ae884cc-3f6c-44c3-bf40-29d592045d0e tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:21.720974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3ae884cc-3f6c-44c3-bf40-29d592045d0e tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:21.723567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3ae884cc-3f6c-44c3-bf40-29d592045d0e tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:22.550895 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3ae884cc-3f6c-44c3-bf40-29d592045d0e tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:22.558907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3ae884cc-3f6c-44c3-bf40-29d592045d0e tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 0.860096 Apr 07 12:56:22.568047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 25/43] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:21 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:22.720631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Flavor limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 12:56:22.723488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Image limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 12:56:22.725695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Flavor pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 12:56:22.726300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Image pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 12:56:22.727743 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 12:56:22.759275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:22.759741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:22.767018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:22.767487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:22.823037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Getting quotas for project 5bd01388259c4fe2be6df63ac77c05c1. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:56:22.839125 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Getting quotas for user e1417845e6994b12a81febfff5e63ce2 and project 5bd01388259c4fe2be6df63ac77c05c1. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:56:22.870901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Going to run 1 instances... {{(pid=116893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 12:56:22.878746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 12:56:23.033985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3f11eb84-7d0a-4d60-b63e-94a900b33853 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.805896 Apr 07 12:56:23.038996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 19/44] 10.222.0.15 () {62 vars in 1187 bytes} [Thu Apr 7 12:56:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 07 12:56:23.045401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f3270940-f776-423f-a473-806441b0a091 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:23.055131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f3270940-f776-423f-a473-806441b0a091 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:23.106829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f3270940-f776-423f-a473-806441b0a091 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:23.109518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f3270940-f776-423f-a473-806441b0a091 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:23.111900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f3270940-f776-423f-a473-806441b0a091 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:23.114527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f3270940-f776-423f-a473-806441b0a091 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:23.142450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-e172dd14-450c-420c-b431-4fee994a01e8 req-97120519-c9b0-4ceb-81d7-4800d0e25a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8280810-53d2-4a3f-8bae-bdf653d6de32", "name": "network-vif-plugged", "status": "completed", "tag": "6fd76b8f-140a-4745-9cac-0e55a348d1ae"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:23.179800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-e172dd14-450c-420c-b431-4fee994a01e8 req-97120519-c9b0-4ceb-81d7-4800d0e25a2a service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:23.182766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-e172dd14-450c-420c-b431-4fee994a01e8 req-97120519-c9b0-4ceb-81d7-4800d0e25a2a service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:23.255762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-e172dd14-450c-420c-b431-4fee994a01e8 req-97120519-c9b0-4ceb-81d7-4800d0e25a2a service nova] Creating event network-vif-plugged:6fd76b8f-140a-4745-9cac-0e55a348d1ae for instance f8280810-53d2-4a3f-8bae-bdf653d6de32 on hv-cinder-83694 Apr 07 12:56:23.256491 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-e172dd14-450c-420c-b431-4fee994a01e8 req-97120519-c9b0-4ceb-81d7-4800d0e25a2a service nova] Acquired lock "compute-rpcapi-router" {{(pid=116892) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 07 12:56:23.259810 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-73c044cc-eb7c-4092-b0da-eb6520d0e06f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:23.260391 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-73c044cc-eb7c-4092-b0da-eb6520d0e06f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:23.266535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-73c044cc-eb7c-4092-b0da-eb6520d0e06f None None] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:23.267125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-73c044cc-eb7c-4092-b0da-eb6520d0e06f None None] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:23.282937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.compute.rpcapi [None req-73c044cc-eb7c-4092-b0da-eb6520d0e06f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 07 12:56:23.298880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-73c044cc-eb7c-4092-b0da-eb6520d0e06f None None] Releasing lock "compute-rpcapi-router" {{(pid=116892) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 07 12:56:23.377941 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-73c044cc-eb7c-4092-b0da-eb6520d0e06f None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.808467 Apr 07 12:56:23.378569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 26/45] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:56:23.388003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2063588694", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c9d7c67-151c-4c9a-8243-50160558d5a2"}], "security_groups": [{"name": "tempest-securitygroup--1919583230"}], "key_name": "tempest-keypair-1082620730", "user_data": "}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:23.628672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f3270940-f776-423f-a473-806441b0a091 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:23.640640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f3270940-f776-423f-a473-806441b0a091 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.599257 Apr 07 12:56:23.653676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 20/46] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:23 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:23.659299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-14fee342-51ca-499b-a0aa-0bda396c44e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:23.669389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-14fee342-51ca-499b-a0aa-0bda396c44e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:23.860838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.network.neutron [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] validate_networks() for [('4c9d7c67-151c-4c9a-8243-50160558d5a2', None, None, None, None, None)] {{(pid=116892) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 12:56:23.880537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-14fee342-51ca-499b-a0aa-0bda396c44e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:23.888198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-14fee342-51ca-499b-a0aa-0bda396c44e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:23.892735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-14fee342-51ca-499b-a0aa-0bda396c44e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:23.896776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-14fee342-51ca-499b-a0aa-0bda396c44e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1281 microversion: 2.20 time: 0.239587 Apr 07 12:56:23.904632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 21/47] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:23 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1281 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:23.917685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5f75c0de-7a2a-4767-a2b5-3c325e20ac70 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:23.921769 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5f75c0de-7a2a-4767-a2b5-3c325e20ac70 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:23.954843 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5f75c0de-7a2a-4767-a2b5-3c325e20ac70 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:23.955441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5f75c0de-7a2a-4767-a2b5-3c325e20ac70 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:23.956479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5f75c0de-7a2a-4767-a2b5-3c325e20ac70 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:23.957120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5f75c0de-7a2a-4767-a2b5-3c325e20ac70 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:24.352915 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5f75c0de-7a2a-4767-a2b5-3c325e20ac70 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:24.361733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5f75c0de-7a2a-4767-a2b5-3c325e20ac70 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 0.455461 Apr 07 12:56:24.362975 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 22/48] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:23 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:24.646076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-881e5d02-d138-4af5-a967-a4e8321de2b3 req-eeebb67f-90d4-4d53-9d77-8f8b51e78e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9feccee-a82e-4fcb-9293-a464dc5601cc", "tag": "e3cb46e9-846c-4fff-b3fc-2991ef26b32f"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:24.657176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-881e5d02-d138-4af5-a967-a4e8321de2b3 req-eeebb67f-90d4-4d53-9d77-8f8b51e78e1a service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:24.657861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-881e5d02-d138-4af5-a967-a4e8321de2b3 req-eeebb67f-90d4-4d53-9d77-8f8b51e78e1a service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:24.670889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-881e5d02-d138-4af5-a967-a4e8321de2b3 req-eeebb67f-90d4-4d53-9d77-8f8b51e78e1a service nova] Creating event network-changed:e3cb46e9-846c-4fff-b3fc-2991ef26b32f for instance a9feccee-a82e-4fcb-9293-a464dc5601cc on hv-cinder-83694 Apr 07 12:56:24.671065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Flavor limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 12:56:24.671407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Image limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 12:56:24.672341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Flavor pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 12:56:24.673700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Image pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 12:56:24.674557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 12:56:24.680890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-881e5d02-d138-4af5-a967-a4e8321de2b3 req-eeebb67f-90d4-4d53-9d77-8f8b51e78e1a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315632 Apr 07 12:56:24.681749 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 23/49] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:56:24.689170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:24.690064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:24.691650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:24.692045 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-abaa56c2-f5bc-44e4-a186-696fc7c4c7cb req-b3a784f9-e20c-4656-8efa-a5e19c62d0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ac775a7-260a-4442-b7d0-b6d3c331cab3", "tag": "002ea713-425e-4572-a58f-da5d59ab058d"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:24.692207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:24.709080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-abaa56c2-f5bc-44e4-a186-696fc7c4c7cb req-b3a784f9-e20c-4656-8efa-a5e19c62d0f5 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:24.711383 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-abaa56c2-f5bc-44e4-a186-696fc7c4c7cb req-b3a784f9-e20c-4656-8efa-a5e19c62d0f5 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:24.714672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Getting quotas for project ad6bab4269a84eae81e793309488d7dd. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:56:24.719389 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Getting quotas for user 7a36496b3c774c2097534b5fcad47db8 and project ad6bab4269a84eae81e793309488d7dd. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:56:24.723740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-abaa56c2-f5bc-44e4-a186-696fc7c4c7cb req-b3a784f9-e20c-4656-8efa-a5e19c62d0f5 service nova] Creating event network-changed:002ea713-425e-4572-a58f-da5d59ab058d for instance 9ac775a7-260a-4442-b7d0-b6d3c331cab3 on hv-cinder-83694 Apr 07 12:56:24.729538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-abaa56c2-f5bc-44e4-a186-696fc7c4c7cb req-b3a784f9-e20c-4656-8efa-a5e19c62d0f5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044453 Apr 07 12:56:24.730453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 24/50] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:56:24.735521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Going to run 1 instances... {{(pid=116892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 12:56:24.738122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 12:56:24.739199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4b81eb6f-8d74-4932-9eea-9fd1335baf58 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:24.740212 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4b81eb6f-8d74-4932-9eea-9fd1335baf58 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:24.752574 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b81eb6f-8d74-4932-9eea-9fd1335baf58 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:24.753890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b81eb6f-8d74-4932-9eea-9fd1335baf58 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:24.754686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b81eb6f-8d74-4932-9eea-9fd1335baf58 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:24.755359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b81eb6f-8d74-4932-9eea-9fd1335baf58 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:24.860325 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-57a2a0a3-3c25-44d3-9d08-bcea41a57f0c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.476970 Apr 07 12:56:24.860979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 27/51] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 12:56:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 12:56:24.879749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-960090a8-c66b-42da-9594-c4db22470981 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:24.880681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-960090a8-c66b-42da-9594-c4db22470981 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:24.950181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-960090a8-c66b-42da-9594-c4db22470981 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:24.959227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-960090a8-c66b-42da-9594-c4db22470981 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1238 microversion: 2.1 time: 0.092202 Apr 07 12:56:24.960413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 28/52] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:24 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:24.970068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9df5c438-b256-419e-b78d-07aa3a4a787c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:24.970739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9df5c438-b256-419e-b78d-07aa3a4a787c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:24.989131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9df5c438-b256-419e-b78d-07aa3a4a787c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:24.990180 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9df5c438-b256-419e-b78d-07aa3a4a787c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:24.991802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9df5c438-b256-419e-b78d-07aa3a4a787c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:24.992472 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9df5c438-b256-419e-b78d-07aa3a4a787c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:25.087865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9df5c438-b256-419e-b78d-07aa3a4a787c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:25.090338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4b81eb6f-8d74-4932-9eea-9fd1335baf58 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:25.102406 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4b81eb6f-8d74-4932-9eea-9fd1335baf58 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.368070 Apr 07 12:56:25.104124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 25/53] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:24 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:25.109329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9df5c438-b256-419e-b78d-07aa3a4a787c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:25.110936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9df5c438-b256-419e-b78d-07aa3a4a787c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:25.112092 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9df5c438-b256-419e-b78d-07aa3a4a787c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1285 microversion: 2.20 time: 0.150689 Apr 07 12:56:25.114750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 29/54] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:24 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:25.379535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1b2e6d3d-0d20-4931-adcd-061640b1fecd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:25.380534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1b2e6d3d-0d20-4931-adcd-061640b1fecd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:25.387884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b2e6d3d-0d20-4931-adcd-061640b1fecd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:25.388429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b2e6d3d-0d20-4931-adcd-061640b1fecd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:25.391635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b2e6d3d-0d20-4931-adcd-061640b1fecd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:25.392351 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b2e6d3d-0d20-4931-adcd-061640b1fecd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:25.572985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1b2e6d3d-0d20-4931-adcd-061640b1fecd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:25.580767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1b2e6d3d-0d20-4931-adcd-061640b1fecd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 0.204947 Apr 07 12:56:25.581650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 26/55] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:25 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:25.976368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-863e1db9-a86b-45d7-b614-8858c0807e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:25.976991 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-863e1db9-a86b-45d7-b614-8858c0807e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:25.982783 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-863e1db9-a86b-45d7-b614-8858c0807e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:25.983239 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-863e1db9-a86b-45d7-b614-8858c0807e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:25.984032 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-863e1db9-a86b-45d7-b614-8858c0807e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:25.984495 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-863e1db9-a86b-45d7-b614-8858c0807e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:26.043103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-863e1db9-a86b-45d7-b614-8858c0807e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:26.050862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-863e1db9-a86b-45d7-b614-8858c0807e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1242 microversion: 2.1 time: 0.078251 Apr 07 12:56:26.051571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 30/56] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:25 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:26.130195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-543dceeb-1d85-4d4b-b870-b39515a0ddb6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:26.130685 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b7cd30ee-8997-4161-b144-2713e584ee79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:26.130973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-543dceeb-1d85-4d4b-b870-b39515a0ddb6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:26.131104 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b7cd30ee-8997-4161-b144-2713e584ee79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:26.137078 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7cd30ee-8997-4161-b144-2713e584ee79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:26.137604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7cd30ee-8997-4161-b144-2713e584ee79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:26.138074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-543dceeb-1d85-4d4b-b870-b39515a0ddb6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:26.139318 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-543dceeb-1d85-4d4b-b870-b39515a0ddb6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:26.139909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7cd30ee-8997-4161-b144-2713e584ee79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:26.140396 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7cd30ee-8997-4161-b144-2713e584ee79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:26.140677 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-543dceeb-1d85-4d4b-b870-b39515a0ddb6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:26.141259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-543dceeb-1d85-4d4b-b870-b39515a0ddb6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:26.206695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-543dceeb-1d85-4d4b-b870-b39515a0ddb6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:26.216837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-543dceeb-1d85-4d4b-b870-b39515a0ddb6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:26.218546 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-543dceeb-1d85-4d4b-b870-b39515a0ddb6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:26.219912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-543dceeb-1d85-4d4b-b870-b39515a0ddb6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1285 microversion: 2.20 time: 0.093783 Apr 07 12:56:26.220937 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 27/57] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:26 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:26.289250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b7cd30ee-8997-4161-b144-2713e584ee79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:26.297345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b7cd30ee-8997-4161-b144-2713e584ee79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.171080 Apr 07 12:56:26.298095 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 31/58] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:26 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:26.598728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-00275fa7-3fd2-443e-a87d-e2d8a6e5a6a5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:26.599320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-00275fa7-3fd2-443e-a87d-e2d8a6e5a6a5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:26.605219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-00275fa7-3fd2-443e-a87d-e2d8a6e5a6a5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:26.605659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-00275fa7-3fd2-443e-a87d-e2d8a6e5a6a5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:26.606404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-00275fa7-3fd2-443e-a87d-e2d8a6e5a6a5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:26.606828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-00275fa7-3fd2-443e-a87d-e2d8a6e5a6a5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:26.739203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-00275fa7-3fd2-443e-a87d-e2d8a6e5a6a5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:26.746566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-00275fa7-3fd2-443e-a87d-e2d8a6e5a6a5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 0.151791 Apr 07 12:56:26.747129 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 28/59] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:26 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:27.068865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a00609c5-5aec-4081-a0c3-8dde9fe78aa5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:27.069506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a00609c5-5aec-4081-a0c3-8dde9fe78aa5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:27.076961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a00609c5-5aec-4081-a0c3-8dde9fe78aa5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:27.077614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a00609c5-5aec-4081-a0c3-8dde9fe78aa5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:27.078744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a00609c5-5aec-4081-a0c3-8dde9fe78aa5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:27.079348 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a00609c5-5aec-4081-a0c3-8dde9fe78aa5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:27.152294 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a00609c5-5aec-4081-a0c3-8dde9fe78aa5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:27.160189 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a00609c5-5aec-4081-a0c3-8dde9fe78aa5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1234 microversion: 2.1 time: 0.096522 Apr 07 12:56:27.160780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 32/60] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:27 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1234 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:27.240001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cc63dc9e-73a3-4834-86ae-8591ec656f87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:27.240646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cc63dc9e-73a3-4834-86ae-8591ec656f87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:27.251993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cc63dc9e-73a3-4834-86ae-8591ec656f87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:27.252481 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cc63dc9e-73a3-4834-86ae-8591ec656f87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:27.253261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cc63dc9e-73a3-4834-86ae-8591ec656f87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:27.253694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cc63dc9e-73a3-4834-86ae-8591ec656f87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:27.316031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0d25005c-bdce-48db-a445-57ebc6daa4aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:27.316890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0d25005c-bdce-48db-a445-57ebc6daa4aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:27.328372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d25005c-bdce-48db-a445-57ebc6daa4aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:27.330068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d25005c-bdce-48db-a445-57ebc6daa4aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:27.331408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d25005c-bdce-48db-a445-57ebc6daa4aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:27.332441 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d25005c-bdce-48db-a445-57ebc6daa4aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:27.351929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cc63dc9e-73a3-4834-86ae-8591ec656f87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:27.363647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cc63dc9e-73a3-4834-86ae-8591ec656f87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:27.365570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cc63dc9e-73a3-4834-86ae-8591ec656f87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:27.366972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cc63dc9e-73a3-4834-86ae-8591ec656f87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1333 microversion: 2.20 time: 0.131067 Apr 07 12:56:27.367753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 29/61] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:27 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1333 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:27.496739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0d25005c-bdce-48db-a445-57ebc6daa4aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:27.517168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0d25005c-bdce-48db-a445-57ebc6daa4aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.206527 Apr 07 12:56:27.517822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 33/62] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:27 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:27.762647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f583ce13-0046-4dd4-bc6b-99225eeebfd0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:27.763276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f583ce13-0046-4dd4-bc6b-99225eeebfd0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:27.771284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f583ce13-0046-4dd4-bc6b-99225eeebfd0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:27.771732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f583ce13-0046-4dd4-bc6b-99225eeebfd0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:27.772713 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f583ce13-0046-4dd4-bc6b-99225eeebfd0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:27.773295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f583ce13-0046-4dd4-bc6b-99225eeebfd0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:27.986245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f583ce13-0046-4dd4-bc6b-99225eeebfd0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:27.994068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f583ce13-0046-4dd4-bc6b-99225eeebfd0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 0.235226 Apr 07 12:56:27.994629 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 30/63] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:27 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:28.177041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0c2a266f-c0ab-4f03-b44a-6e6310332467 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:28.178176 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0c2a266f-c0ab-4f03-b44a-6e6310332467 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:28.184301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0c2a266f-c0ab-4f03-b44a-6e6310332467 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:28.184738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0c2a266f-c0ab-4f03-b44a-6e6310332467 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:28.185719 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0c2a266f-c0ab-4f03-b44a-6e6310332467 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:28.186155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0c2a266f-c0ab-4f03-b44a-6e6310332467 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:28.270155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0c2a266f-c0ab-4f03-b44a-6e6310332467 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:28.277187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0c2a266f-c0ab-4f03-b44a-6e6310332467 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1298 microversion: 2.1 time: 0.103943 Apr 07 12:56:28.277743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 34/64] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:28 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:28.386663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-600de611-f4cc-4beb-9b2e-9f9e7a8a6eb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:28.387276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-600de611-f4cc-4beb-9b2e-9f9e7a8a6eb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:28.394196 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-600de611-f4cc-4beb-9b2e-9f9e7a8a6eb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:28.394642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-600de611-f4cc-4beb-9b2e-9f9e7a8a6eb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:28.395426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-600de611-f4cc-4beb-9b2e-9f9e7a8a6eb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:28.395841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-600de611-f4cc-4beb-9b2e-9f9e7a8a6eb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:28.455659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-600de611-f4cc-4beb-9b2e-9f9e7a8a6eb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:28.463396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-600de611-f4cc-4beb-9b2e-9f9e7a8a6eb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:28.464930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-600de611-f4cc-4beb-9b2e-9f9e7a8a6eb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:28.466029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-600de611-f4cc-4beb-9b2e-9f9e7a8a6eb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1341 microversion: 2.20 time: 0.083208 Apr 07 12:56:28.466602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 31/65] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:28 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1341 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:28.534120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-94e8bfb1-50cc-46b3-8689-b5810b2f1ce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:28.534660 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-94e8bfb1-50cc-46b3-8689-b5810b2f1ce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:28.540513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94e8bfb1-50cc-46b3-8689-b5810b2f1ce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:28.540964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94e8bfb1-50cc-46b3-8689-b5810b2f1ce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:28.541722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94e8bfb1-50cc-46b3-8689-b5810b2f1ce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:28.542154 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94e8bfb1-50cc-46b3-8689-b5810b2f1ce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:28.674739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-94e8bfb1-50cc-46b3-8689-b5810b2f1ce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:28.681975 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-94e8bfb1-50cc-46b3-8689-b5810b2f1ce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.152325 Apr 07 12:56:28.682542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 35/66] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:28 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:29.011478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ffb94e0d-c1d9-4e27-be3f-6628004946cd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:29.012088 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ffb94e0d-c1d9-4e27-be3f-6628004946cd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:29.018462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffb94e0d-c1d9-4e27-be3f-6628004946cd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:29.018910 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffb94e0d-c1d9-4e27-be3f-6628004946cd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:29.019665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffb94e0d-c1d9-4e27-be3f-6628004946cd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:29.020095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffb94e0d-c1d9-4e27-be3f-6628004946cd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:29.159585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ffb94e0d-c1d9-4e27-be3f-6628004946cd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:29.166967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ffb94e0d-c1d9-4e27-be3f-6628004946cd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 0.159236 Apr 07 12:56:29.167537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 32/67] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:29 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:29.294694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-442faf7c-f550-4fde-83ac-493fffdc6ff1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:29.295614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-442faf7c-f550-4fde-83ac-493fffdc6ff1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:29.301205 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-442faf7c-f550-4fde-83ac-493fffdc6ff1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:29.301677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-442faf7c-f550-4fde-83ac-493fffdc6ff1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:29.302429 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-442faf7c-f550-4fde-83ac-493fffdc6ff1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:29.302857 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-442faf7c-f550-4fde-83ac-493fffdc6ff1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:29.360038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-442faf7c-f550-4fde-83ac-493fffdc6ff1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:29.367076 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-442faf7c-f550-4fde-83ac-493fffdc6ff1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1298 microversion: 2.1 time: 0.076110 Apr 07 12:56:29.367630 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 36/68] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:29 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1298 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:29.484901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-80005599-dae6-4148-ad64-7e76806df66b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:29.485511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-80005599-dae6-4148-ad64-7e76806df66b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:29.491345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80005599-dae6-4148-ad64-7e76806df66b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:29.491791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80005599-dae6-4148-ad64-7e76806df66b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:29.492577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80005599-dae6-4148-ad64-7e76806df66b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:29.493013 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80005599-dae6-4148-ad64-7e76806df66b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:29.553481 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-80005599-dae6-4148-ad64-7e76806df66b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:29.561746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-80005599-dae6-4148-ad64-7e76806df66b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:29.563233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-80005599-dae6-4148-ad64-7e76806df66b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:29.564368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-80005599-dae6-4148-ad64-7e76806df66b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1341 microversion: 2.20 time: 0.083853 Apr 07 12:56:29.564917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 33/69] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:29 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1341 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:29.698706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cf6e424f-a0b5-43c3-84d2-7a85e9c4e140 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:29.699251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cf6e424f-a0b5-43c3-84d2-7a85e9c4e140 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:29.705154 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf6e424f-a0b5-43c3-84d2-7a85e9c4e140 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:29.705602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf6e424f-a0b5-43c3-84d2-7a85e9c4e140 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:29.706352 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf6e424f-a0b5-43c3-84d2-7a85e9c4e140 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:29.706780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf6e424f-a0b5-43c3-84d2-7a85e9c4e140 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:29.836908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cf6e424f-a0b5-43c3-84d2-7a85e9c4e140 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:29.844789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cf6e424f-a0b5-43c3-84d2-7a85e9c4e140 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.149959 Apr 07 12:56:29.845368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 37/70] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:29 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:30.183162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8446c6ff-7a7a-40c3-acb9-b487589cc25c tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:30.183876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8446c6ff-7a7a-40c3-acb9-b487589cc25c tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:30.192409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8446c6ff-7a7a-40c3-acb9-b487589cc25c tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:30.193145 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8446c6ff-7a7a-40c3-acb9-b487589cc25c tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:30.194053 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8446c6ff-7a7a-40c3-acb9-b487589cc25c tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:30.194485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8446c6ff-7a7a-40c3-acb9-b487589cc25c tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:30.333850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8446c6ff-7a7a-40c3-acb9-b487589cc25c tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:30.341160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8446c6ff-7a7a-40c3-acb9-b487589cc25c tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1314 microversion: 2.1 time: 0.161875 Apr 07 12:56:30.341795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 34/71] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:30 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:30.384010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a2f099cd-7978-4efb-9d9e-c72b03ac45c5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:30.384658 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a2f099cd-7978-4efb-9d9e-c72b03ac45c5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:30.391174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a2f099cd-7978-4efb-9d9e-c72b03ac45c5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:30.391632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a2f099cd-7978-4efb-9d9e-c72b03ac45c5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:30.392423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a2f099cd-7978-4efb-9d9e-c72b03ac45c5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:30.392867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a2f099cd-7978-4efb-9d9e-c72b03ac45c5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:30.453484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a2f099cd-7978-4efb-9d9e-c72b03ac45c5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:30.460690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a2f099cd-7978-4efb-9d9e-c72b03ac45c5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1298 microversion: 2.1 time: 0.080447 Apr 07 12:56:30.461256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 38/72] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:30 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1298 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:30.585073 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a9d8caee-5782-4057-9a2e-4a43bab3e1ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:30.586044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a9d8caee-5782-4057-9a2e-4a43bab3e1ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:30.592745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9d8caee-5782-4057-9a2e-4a43bab3e1ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:30.593194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9d8caee-5782-4057-9a2e-4a43bab3e1ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:30.593962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9d8caee-5782-4057-9a2e-4a43bab3e1ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:30.594396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9d8caee-5782-4057-9a2e-4a43bab3e1ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:30.651486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a9d8caee-5782-4057-9a2e-4a43bab3e1ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:30.659482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a9d8caee-5782-4057-9a2e-4a43bab3e1ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:30.661003 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a9d8caee-5782-4057-9a2e-4a43bab3e1ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:30.662100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a9d8caee-5782-4057-9a2e-4a43bab3e1ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1341 microversion: 2.20 time: 0.082957 Apr 07 12:56:30.662658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 35/73] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:30 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1341 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:30.861480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-25867fa7-f448-42ba-a5d9-269f14b7ab98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:30.862100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-25867fa7-f448-42ba-a5d9-269f14b7ab98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:30.868661 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25867fa7-f448-42ba-a5d9-269f14b7ab98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:30.869120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25867fa7-f448-42ba-a5d9-269f14b7ab98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:30.869912 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25867fa7-f448-42ba-a5d9-269f14b7ab98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:30.870353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25867fa7-f448-42ba-a5d9-269f14b7ab98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:31.003829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-25867fa7-f448-42ba-a5d9-269f14b7ab98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:31.011462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-25867fa7-f448-42ba-a5d9-269f14b7ab98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.153754 Apr 07 12:56:31.012029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 39/74] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:30 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:31.358080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3d704892-7e3f-489e-871c-edd0e145adb4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:31.358973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3d704892-7e3f-489e-871c-edd0e145adb4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:31.365564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d704892-7e3f-489e-871c-edd0e145adb4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:31.366020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d704892-7e3f-489e-871c-edd0e145adb4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:31.366809 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d704892-7e3f-489e-871c-edd0e145adb4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:31.370254 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d704892-7e3f-489e-871c-edd0e145adb4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:31.478343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b723997e-22e9-4545-9e59-9cadb3edc55f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:31.479590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b723997e-22e9-4545-9e59-9cadb3edc55f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:31.486274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b723997e-22e9-4545-9e59-9cadb3edc55f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:31.486999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b723997e-22e9-4545-9e59-9cadb3edc55f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:31.488013 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b723997e-22e9-4545-9e59-9cadb3edc55f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:31.488677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b723997e-22e9-4545-9e59-9cadb3edc55f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:31.554525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b723997e-22e9-4545-9e59-9cadb3edc55f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:31.562465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b723997e-22e9-4545-9e59-9cadb3edc55f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1308 microversion: 2.1 time: 0.087903 Apr 07 12:56:31.563548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 40/75] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:31 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:31.680664 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dd4d2d75-3971-4a98-ab98-cc5e4b9c1a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:31.681462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dd4d2d75-3971-4a98-ab98-cc5e4b9c1a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:31.689825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd4d2d75-3971-4a98-ab98-cc5e4b9c1a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:31.690957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd4d2d75-3971-4a98-ab98-cc5e4b9c1a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:31.691952 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd4d2d75-3971-4a98-ab98-cc5e4b9c1a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:31.692627 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd4d2d75-3971-4a98-ab98-cc5e4b9c1a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:31.726314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3d704892-7e3f-489e-871c-edd0e145adb4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:31.738180 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3d704892-7e3f-489e-871c-edd0e145adb4 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1498 microversion: 2.1 time: 0.384105 Apr 07 12:56:31.744850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 36/76] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:31 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1498 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:31.908661 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dd4d2d75-3971-4a98-ab98-cc5e4b9c1a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:31.922917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dd4d2d75-3971-4a98-ab98-cc5e4b9c1a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:31.927424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dd4d2d75-3971-4a98-ab98-cc5e4b9c1a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:31.931550 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dd4d2d75-3971-4a98-ab98-cc5e4b9c1a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1351 microversion: 2.20 time: 0.254067 Apr 07 12:56:31.945180 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 41/77] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:31 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1351 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:56:32.031813 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-54e5fa7c-3a55-492a-be75-df25e33696a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:32.032732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-54e5fa7c-3a55-492a-be75-df25e33696a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:32.051716 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-54e5fa7c-3a55-492a-be75-df25e33696a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:32.052212 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-54e5fa7c-3a55-492a-be75-df25e33696a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:32.057706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-54e5fa7c-3a55-492a-be75-df25e33696a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:32.058201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-54e5fa7c-3a55-492a-be75-df25e33696a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:32.580333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1e00de1c-e373-4506-801d-ee36d60df884 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:32.580966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1e00de1c-e373-4506-801d-ee36d60df884 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:32.590921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e00de1c-e373-4506-801d-ee36d60df884 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:32.591385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e00de1c-e373-4506-801d-ee36d60df884 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:32.592313 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e00de1c-e373-4506-801d-ee36d60df884 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:32.592926 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e00de1c-e373-4506-801d-ee36d60df884 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:32.605028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-54e5fa7c-3a55-492a-be75-df25e33696a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:32.613466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-54e5fa7c-3a55-492a-be75-df25e33696a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.589192 Apr 07 12:56:32.615603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 37/78] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:32 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:32.722037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1e00de1c-e373-4506-801d-ee36d60df884 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:32.735443 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1e00de1c-e373-4506-801d-ee36d60df884 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1296 microversion: 2.1 time: 0.159056 Apr 07 12:56:32.736554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 42/79] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:32 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1296 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:32.956527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7f65c394-2ca0-4e8a-ac38-a3e697c6d9ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:32.957050 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7f65c394-2ca0-4e8a-ac38-a3e697c6d9ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:32.969444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f65c394-2ca0-4e8a-ac38-a3e697c6d9ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:32.972265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f65c394-2ca0-4e8a-ac38-a3e697c6d9ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:32.977563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f65c394-2ca0-4e8a-ac38-a3e697c6d9ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:32.978623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f65c394-2ca0-4e8a-ac38-a3e697c6d9ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:33.153443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7f65c394-2ca0-4e8a-ac38-a3e697c6d9ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:33.170083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7f65c394-2ca0-4e8a-ac38-a3e697c6d9ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:33.177217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7f65c394-2ca0-4e8a-ac38-a3e697c6d9ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:33.178416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7f65c394-2ca0-4e8a-ac38-a3e697c6d9ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1339 microversion: 2.20 time: 0.226358 Apr 07 12:56:33.186974 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 38/80] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:32 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:33.554634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-039e322f-975d-41e5-82d1-57b60062d5df tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fd56ab3-4a0f-489f-afcb-9c1f71293e7e"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:33.556700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-039e322f-975d-41e5-82d1-57b60062d5df tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:33.579845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-039e322f-975d-41e5-82d1-57b60062d5df tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:33.580707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-039e322f-975d-41e5-82d1-57b60062d5df tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:33.582346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-039e322f-975d-41e5-82d1-57b60062d5df tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:33.583066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-039e322f-975d-41e5-82d1-57b60062d5df tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:33.633777 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-57ebe2c2-ee2e-4c21-9d18-fcd2600174d8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:33.634398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-57ebe2c2-ee2e-4c21-9d18-fcd2600174d8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:33.665467 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-57ebe2c2-ee2e-4c21-9d18-fcd2600174d8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:33.666136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-57ebe2c2-ee2e-4c21-9d18-fcd2600174d8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:33.667769 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-57ebe2c2-ee2e-4c21-9d18-fcd2600174d8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:33.668411 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-57ebe2c2-ee2e-4c21-9d18-fcd2600174d8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:34.089662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-57ebe2c2-ee2e-4c21-9d18-fcd2600174d8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:34.100238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-57ebe2c2-ee2e-4c21-9d18-fcd2600174d8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.470732 Apr 07 12:56:34.112950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 39/81] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:33 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:34.124072 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-45fb3dab-21af-454e-88c6-e6e2fd9a73f0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:34.124753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-45fb3dab-21af-454e-88c6-e6e2fd9a73f0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:34.140930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45fb3dab-21af-454e-88c6-e6e2fd9a73f0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:34.141435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45fb3dab-21af-454e-88c6-e6e2fd9a73f0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:34.142262 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45fb3dab-21af-454e-88c6-e6e2fd9a73f0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:34.142706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45fb3dab-21af-454e-88c6-e6e2fd9a73f0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:34.205675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-039e322f-975d-41e5-82d1-57b60062d5df tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "POST /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.652217 Apr 07 12:56:34.208235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 43/82] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Apr 7 12:56:33 2022] POST /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:56:34.237001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f26aaa86-08c2-4778-a3e5-236f9be73118 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:34.241180 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f26aaa86-08c2-4778-a3e5-236f9be73118 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:34.250173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f26aaa86-08c2-4778-a3e5-236f9be73118 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:34.250806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f26aaa86-08c2-4778-a3e5-236f9be73118 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:34.251764 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f26aaa86-08c2-4778-a3e5-236f9be73118 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:34.252427 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f26aaa86-08c2-4778-a3e5-236f9be73118 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:34.484906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-45fb3dab-21af-454e-88c6-e6e2fd9a73f0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:34.497599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-45fb3dab-21af-454e-88c6-e6e2fd9a73f0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.382454 Apr 07 12:56:34.498927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 40/83] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:34 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:35.129673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5a1aa557-0f0f-4bc0-961e-297d83ff8724 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:35.130363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5a1aa557-0f0f-4bc0-961e-297d83ff8724 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:35.156649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a1aa557-0f0f-4bc0-961e-297d83ff8724 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:35.157422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a1aa557-0f0f-4bc0-961e-297d83ff8724 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:35.159303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a1aa557-0f0f-4bc0-961e-297d83ff8724 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:35.160234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a1aa557-0f0f-4bc0-961e-297d83ff8724 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:35.312870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f26aaa86-08c2-4778-a3e5-236f9be73118 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:35.332100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f26aaa86-08c2-4778-a3e5-236f9be73118 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:35.334506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f26aaa86-08c2-4778-a3e5-236f9be73118 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:35.336191 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f26aaa86-08c2-4778-a3e5-236f9be73118 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 1.122092 Apr 07 12:56:35.337897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 44/84] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:34 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:35.515153 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-563ba0cc-407a-48e9-9c79-8aee15e7f650 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:35.516402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-563ba0cc-407a-48e9-9c79-8aee15e7f650 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:35.523438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-563ba0cc-407a-48e9-9c79-8aee15e7f650 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:35.523897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-563ba0cc-407a-48e9-9c79-8aee15e7f650 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:35.531552 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-563ba0cc-407a-48e9-9c79-8aee15e7f650 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:35.532018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-563ba0cc-407a-48e9-9c79-8aee15e7f650 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:35.579721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5a1aa557-0f0f-4bc0-961e-297d83ff8724 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:35.589636 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5a1aa557-0f0f-4bc0-961e-297d83ff8724 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.463738 Apr 07 12:56:35.601945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 41/85] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:35 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:36.080758 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-e7816fbd-aa1e-4bc2-be9b-5484a1b9bb1a req-82c9654c-8319-4bf1-905c-edc1eb7252e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c9a464-496a-4aa9-80dd-f9ec66f515ae", "tag": "b25fac27-5301-4311-8e84-5721b8cac04c"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:36.103243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-e7816fbd-aa1e-4bc2-be9b-5484a1b9bb1a req-82c9654c-8319-4bf1-905c-edc1eb7252e0 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:36.104673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-e7816fbd-aa1e-4bc2-be9b-5484a1b9bb1a req-82c9654c-8319-4bf1-905c-edc1eb7252e0 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:36.149210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-e7816fbd-aa1e-4bc2-be9b-5484a1b9bb1a req-82c9654c-8319-4bf1-905c-edc1eb7252e0 service nova] Creating event network-changed:b25fac27-5301-4311-8e84-5721b8cac04c for instance 58c9a464-496a-4aa9-80dd-f9ec66f515ae on hv-cinder-83694 Apr 07 12:56:36.161649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-e7816fbd-aa1e-4bc2-be9b-5484a1b9bb1a req-82c9654c-8319-4bf1-905c-edc1eb7252e0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085478 Apr 07 12:56:36.165894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 42/86] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:56:36.277319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-563ba0cc-407a-48e9-9c79-8aee15e7f650 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:36.284056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-85e48daf-e42e-4b4a-8eee-91e66cb03ead req-15af7477-4e52-4c0d-8f6d-a49274ede617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9feccee-a82e-4fcb-9293-a464dc5601cc", "name": "network-vif-plugged", "status": "completed", "tag": "e3cb46e9-846c-4fff-b3fc-2991ef26b32f"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:36.298480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-563ba0cc-407a-48e9-9c79-8aee15e7f650 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.787202 Apr 07 12:56:36.303956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 45/87] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:35 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:36.311441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-85e48daf-e42e-4b4a-8eee-91e66cb03ead req-15af7477-4e52-4c0d-8f6d-a49274ede617 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:36.313630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-85e48daf-e42e-4b4a-8eee-91e66cb03ead req-15af7477-4e52-4c0d-8f6d-a49274ede617 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:36.342735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-85e48daf-e42e-4b4a-8eee-91e66cb03ead req-15af7477-4e52-4c0d-8f6d-a49274ede617 service nova] Creating event network-vif-plugged:e3cb46e9-846c-4fff-b3fc-2991ef26b32f for instance a9feccee-a82e-4fcb-9293-a464dc5601cc on hv-cinder-83694 Apr 07 12:56:36.357410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-33bb3ae3-cc20-4ded-be17-0bae8f78985f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:36.358672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-33bb3ae3-cc20-4ded-be17-0bae8f78985f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:36.368632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-85e48daf-e42e-4b4a-8eee-91e66cb03ead req-15af7477-4e52-4c0d-8f6d-a49274ede617 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093777 Apr 07 12:56:36.371135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-33bb3ae3-cc20-4ded-be17-0bae8f78985f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:36.382821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 43/88] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:56:36.384713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-33bb3ae3-cc20-4ded-be17-0bae8f78985f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:36.387572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-33bb3ae3-cc20-4ded-be17-0bae8f78985f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:36.388528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-33bb3ae3-cc20-4ded-be17-0bae8f78985f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:36.610505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d98f1a52-1157-4dbe-bdd3-ef73504e4765 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:36.611310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d98f1a52-1157-4dbe-bdd3-ef73504e4765 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:36.627452 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d98f1a52-1157-4dbe-bdd3-ef73504e4765 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:36.630201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d98f1a52-1157-4dbe-bdd3-ef73504e4765 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:36.630916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d98f1a52-1157-4dbe-bdd3-ef73504e4765 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:36.631369 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d98f1a52-1157-4dbe-bdd3-ef73504e4765 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:37.017736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d98f1a52-1157-4dbe-bdd3-ef73504e4765 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:37.028970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d98f1a52-1157-4dbe-bdd3-ef73504e4765 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.423855 Apr 07 12:56:37.030093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 44/89] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:36 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:37.070694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-33bb3ae3-cc20-4ded-be17-0bae8f78985f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:37.088249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-33bb3ae3-cc20-4ded-be17-0bae8f78985f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:37.092424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-33bb3ae3-cc20-4ded-be17-0bae8f78985f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:37.097875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-33bb3ae3-cc20-4ded-be17-0bae8f78985f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.744052 Apr 07 12:56:37.105057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 46/90] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:36 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:56:37.325691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-91da7154-30d4-4d98-b1c6-5f5644ad2ffb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:37.327009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-91da7154-30d4-4d98-b1c6-5f5644ad2ffb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:37.338175 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91da7154-30d4-4d98-b1c6-5f5644ad2ffb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:37.338890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91da7154-30d4-4d98-b1c6-5f5644ad2ffb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:37.340558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91da7154-30d4-4d98-b1c6-5f5644ad2ffb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:37.342901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91da7154-30d4-4d98-b1c6-5f5644ad2ffb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:37.564562 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-91da7154-30d4-4d98-b1c6-5f5644ad2ffb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:37.598738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-91da7154-30d4-4d98-b1c6-5f5644ad2ffb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.279172 Apr 07 12:56:37.604773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 45/91] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:37 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:38.047626 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1b456685-1db6-4565-b2b3-b5dfa793b31c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:38.051397 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1b456685-1db6-4565-b2b3-b5dfa793b31c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:38.062875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b456685-1db6-4565-b2b3-b5dfa793b31c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:38.063609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b456685-1db6-4565-b2b3-b5dfa793b31c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:38.066992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b456685-1db6-4565-b2b3-b5dfa793b31c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:38.069718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b456685-1db6-4565-b2b3-b5dfa793b31c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:38.119514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9a390137-ebb1-4538-8e50-4115777896ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:38.120131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9a390137-ebb1-4538-8e50-4115777896ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:38.127474 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a390137-ebb1-4538-8e50-4115777896ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:38.128261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a390137-ebb1-4538-8e50-4115777896ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:38.129221 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a390137-ebb1-4538-8e50-4115777896ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:38.129854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a390137-ebb1-4538-8e50-4115777896ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:38.304515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9a390137-ebb1-4538-8e50-4115777896ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:38.308906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9a390137-ebb1-4538-8e50-4115777896ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:38.311557 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9a390137-ebb1-4538-8e50-4115777896ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:38.312783 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9a390137-ebb1-4538-8e50-4115777896ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.198835 Apr 07 12:56:38.313393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 46/92] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:38 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:56:38.313882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1b456685-1db6-4565-b2b3-b5dfa793b31c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:38.327025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1b456685-1db6-4565-b2b3-b5dfa793b31c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.283947 Apr 07 12:56:38.327874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 47/93] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:38 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:38.332032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-8daf286c-0cca-45d8-882a-5b2fe682befb req-2dbf6640-d2f3-4f9d-bddc-11b400841ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34baf697-0c75-496f-a1fe-fef1314f1a9a", "tag": "4c467477-c161-40fe-bb4a-d23378671576"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:38.342825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-8daf286c-0cca-45d8-882a-5b2fe682befb req-2dbf6640-d2f3-4f9d-bddc-11b400841ddd service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:38.343531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-8daf286c-0cca-45d8-882a-5b2fe682befb req-2dbf6640-d2f3-4f9d-bddc-11b400841ddd service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:38.357188 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-8daf286c-0cca-45d8-882a-5b2fe682befb req-2dbf6640-d2f3-4f9d-bddc-11b400841ddd service nova] Creating event network-changed:4c467477-c161-40fe-bb4a-d23378671576 for instance 34baf697-0c75-496f-a1fe-fef1314f1a9a on hv-cinder-83694 Apr 07 12:56:38.365290 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-8daf286c-0cca-45d8-882a-5b2fe682befb req-2dbf6640-d2f3-4f9d-bddc-11b400841ddd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050093 Apr 07 12:56:38.366510 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 47/94] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:56:38.424713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-b1bd18cb-a74e-4ce1-b5d0-7b9871c9c897 req-7d431ac5-7163-4317-a359-1202b20bb2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac775a7-260a-4442-b7d0-b6d3c331cab3", "name": "network-vif-plugged", "status": "completed", "tag": "002ea713-425e-4572-a58f-da5d59ab058d"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:38.434818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-b1bd18cb-a74e-4ce1-b5d0-7b9871c9c897 req-7d431ac5-7163-4317-a359-1202b20bb2d2 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:38.434818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-b1bd18cb-a74e-4ce1-b5d0-7b9871c9c897 req-7d431ac5-7163-4317-a359-1202b20bb2d2 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:38.444795 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-b1bd18cb-a74e-4ce1-b5d0-7b9871c9c897 req-7d431ac5-7163-4317-a359-1202b20bb2d2 service nova] Creating event network-vif-plugged:002ea713-425e-4572-a58f-da5d59ab058d for instance 9ac775a7-260a-4442-b7d0-b6d3c331cab3 on hv-cinder-83694 Apr 07 12:56:38.449979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-b1bd18cb-a74e-4ce1-b5d0-7b9871c9c897 req-7d431ac5-7163-4317-a359-1202b20bb2d2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029749 Apr 07 12:56:38.450666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 48/95] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:56:38.621403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-485b641d-6e43-484b-b8a0-1e6d86f65864 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:38.622123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-485b641d-6e43-484b-b8a0-1e6d86f65864 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:38.628700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-485b641d-6e43-484b-b8a0-1e6d86f65864 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:38.629148 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-485b641d-6e43-484b-b8a0-1e6d86f65864 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:38.630105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-485b641d-6e43-484b-b8a0-1e6d86f65864 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:38.630627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-485b641d-6e43-484b-b8a0-1e6d86f65864 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:38.781735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-485b641d-6e43-484b-b8a0-1e6d86f65864 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:38.788932 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-485b641d-6e43-484b-b8a0-1e6d86f65864 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.171705 Apr 07 12:56:38.789954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 48/96] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:38 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:39.331649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8cd627c8-b2bb-4d7b-abeb-1aff2b2844f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:39.333105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8cd627c8-b2bb-4d7b-abeb-1aff2b2844f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:39.340820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8cd627c8-b2bb-4d7b-abeb-1aff2b2844f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:39.341860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8cd627c8-b2bb-4d7b-abeb-1aff2b2844f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:39.342830 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8cd627c8-b2bb-4d7b-abeb-1aff2b2844f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:39.343435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8cd627c8-b2bb-4d7b-abeb-1aff2b2844f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:39.346257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-65bf065c-ae43-47f0-8396-583251181cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:39.347122 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-65bf065c-ae43-47f0-8396-583251181cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:39.354213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65bf065c-ae43-47f0-8396-583251181cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:39.354779 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65bf065c-ae43-47f0-8396-583251181cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:39.355713 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65bf065c-ae43-47f0-8396-583251181cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:39.356299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65bf065c-ae43-47f0-8396-583251181cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:39.511719 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8cd627c8-b2bb-4d7b-abeb-1aff2b2844f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:39.512878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-65bf065c-ae43-47f0-8396-583251181cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:39.520886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-65bf065c-ae43-47f0-8396-583251181cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.180587 Apr 07 12:56:39.521758 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 49/97] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:39 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:39.526707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8cd627c8-b2bb-4d7b-abeb-1aff2b2844f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:39.528604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8cd627c8-b2bb-4d7b-abeb-1aff2b2844f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:39.530099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8cd627c8-b2bb-4d7b-abeb-1aff2b2844f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.203767 Apr 07 12:56:39.531149 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 49/98] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:39 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:39.806413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d2b60f19-0b8b-432a-b75d-502836bc6a5a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:39.807344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d2b60f19-0b8b-432a-b75d-502836bc6a5a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:39.827744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2b60f19-0b8b-432a-b75d-502836bc6a5a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:39.827744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2b60f19-0b8b-432a-b75d-502836bc6a5a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:39.827744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2b60f19-0b8b-432a-b75d-502836bc6a5a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:39.827744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2b60f19-0b8b-432a-b75d-502836bc6a5a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:40.032376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d2b60f19-0b8b-432a-b75d-502836bc6a5a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:40.044217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d2b60f19-0b8b-432a-b75d-502836bc6a5a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.239639 Apr 07 12:56:40.045718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 50/99] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:39 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:40.538153 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-76a60ef7-b059-4ae3-8c30-b199aa726e1c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:40.538776 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-76a60ef7-b059-4ae3-8c30-b199aa726e1c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:40.549537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0218c855-45a5-47b3-beff-a025138505c3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:40.550156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0218c855-45a5-47b3-beff-a025138505c3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:40.556452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76a60ef7-b059-4ae3-8c30-b199aa726e1c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:40.556907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76a60ef7-b059-4ae3-8c30-b199aa726e1c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:40.559556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76a60ef7-b059-4ae3-8c30-b199aa726e1c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:40.561339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76a60ef7-b059-4ae3-8c30-b199aa726e1c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:40.561495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0218c855-45a5-47b3-beff-a025138505c3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:40.562344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0218c855-45a5-47b3-beff-a025138505c3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:40.566182 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0218c855-45a5-47b3-beff-a025138505c3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:40.566807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0218c855-45a5-47b3-beff-a025138505c3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:40.778977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-76a60ef7-b059-4ae3-8c30-b199aa726e1c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:40.799397 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-76a60ef7-b059-4ae3-8c30-b199aa726e1c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.263286 Apr 07 12:56:40.799874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 50/100] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:40 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:40.826693 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0218c855-45a5-47b3-beff-a025138505c3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:40.834727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0218c855-45a5-47b3-beff-a025138505c3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:40.836231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0218c855-45a5-47b3-beff-a025138505c3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:40.837342 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0218c855-45a5-47b3-beff-a025138505c3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.292579 Apr 07 12:56:40.838252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 51/101] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:40 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:41.064861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-803ca2ee-8c7d-4ebf-b69e-7b910a2e335a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:41.065483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-803ca2ee-8c7d-4ebf-b69e-7b910a2e335a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:41.072739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-803ca2ee-8c7d-4ebf-b69e-7b910a2e335a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:41.073493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-803ca2ee-8c7d-4ebf-b69e-7b910a2e335a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:41.074581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-803ca2ee-8c7d-4ebf-b69e-7b910a2e335a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:41.075234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-803ca2ee-8c7d-4ebf-b69e-7b910a2e335a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:41.258263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-803ca2ee-8c7d-4ebf-b69e-7b910a2e335a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:41.270493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-803ca2ee-8c7d-4ebf-b69e-7b910a2e335a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.212047 Apr 07 12:56:41.271484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 51/102] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:41 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:41.817214 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e573cfce-d979-4493-a9ee-d6b14cc40c7c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:41.818137 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e573cfce-d979-4493-a9ee-d6b14cc40c7c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:41.825198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e573cfce-d979-4493-a9ee-d6b14cc40c7c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:41.825649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e573cfce-d979-4493-a9ee-d6b14cc40c7c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:41.826610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e573cfce-d979-4493-a9ee-d6b14cc40c7c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:41.827164 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e573cfce-d979-4493-a9ee-d6b14cc40c7c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:41.857113 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5453737f-1f08-4e82-8e2d-a87032b21b20 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:41.858842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5453737f-1f08-4e82-8e2d-a87032b21b20 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:41.869377 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5453737f-1f08-4e82-8e2d-a87032b21b20 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:41.875719 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5453737f-1f08-4e82-8e2d-a87032b21b20 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:41.876817 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5453737f-1f08-4e82-8e2d-a87032b21b20 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:41.877419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5453737f-1f08-4e82-8e2d-a87032b21b20 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:42.056689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5453737f-1f08-4e82-8e2d-a87032b21b20 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:42.065471 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5453737f-1f08-4e82-8e2d-a87032b21b20 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:42.067354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5453737f-1f08-4e82-8e2d-a87032b21b20 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:42.068772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5453737f-1f08-4e82-8e2d-a87032b21b20 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.215492 Apr 07 12:56:42.069568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 52/103] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:41 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:56:42.192253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e573cfce-d979-4493-a9ee-d6b14cc40c7c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:42.203677 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e573cfce-d979-4493-a9ee-d6b14cc40c7c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.391378 Apr 07 12:56:42.204672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 52/104] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:41 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:42.289209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-96381c7b-f43a-45d5-90e9-3930cff90d53 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:42.289943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-96381c7b-f43a-45d5-90e9-3930cff90d53 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:42.296489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-96381c7b-f43a-45d5-90e9-3930cff90d53 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:42.297069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-96381c7b-f43a-45d5-90e9-3930cff90d53 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:42.297955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-96381c7b-f43a-45d5-90e9-3930cff90d53 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:42.298500 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-96381c7b-f43a-45d5-90e9-3930cff90d53 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:42.450392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-96381c7b-f43a-45d5-90e9-3930cff90d53 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:42.464671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-96381c7b-f43a-45d5-90e9-3930cff90d53 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.179937 Apr 07 12:56:42.465600 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 53/105] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:42 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:43.087407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-99836164-e7c9-402f-9e63-db35c3f9fd99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:43.088124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-99836164-e7c9-402f-9e63-db35c3f9fd99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:43.094121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-99836164-e7c9-402f-9e63-db35c3f9fd99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:43.094579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-99836164-e7c9-402f-9e63-db35c3f9fd99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:43.095347 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-99836164-e7c9-402f-9e63-db35c3f9fd99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:43.095970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-99836164-e7c9-402f-9e63-db35c3f9fd99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:43.221036 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e55809a0-4127-41b9-8cb2-901badf6e865 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:43.221748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e55809a0-4127-41b9-8cb2-901badf6e865 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:43.228035 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e55809a0-4127-41b9-8cb2-901badf6e865 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:43.232958 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e55809a0-4127-41b9-8cb2-901badf6e865 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:43.235492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e55809a0-4127-41b9-8cb2-901badf6e865 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:43.237511 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e55809a0-4127-41b9-8cb2-901badf6e865 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:43.274724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-99836164-e7c9-402f-9e63-db35c3f9fd99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:43.287553 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-99836164-e7c9-402f-9e63-db35c3f9fd99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:43.293843 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-99836164-e7c9-402f-9e63-db35c3f9fd99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:43.296879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-99836164-e7c9-402f-9e63-db35c3f9fd99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.213415 Apr 07 12:56:43.297623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 53/106] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:43 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:43.472559 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e55809a0-4127-41b9-8cb2-901badf6e865 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:43.480930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e55809a0-4127-41b9-8cb2-901badf6e865 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.263956 Apr 07 12:56:43.481739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 54/107] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:43 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:43.482895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4e2af664-58b3-4b68-8576-0ec08c8eb35c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:43.483611 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4e2af664-58b3-4b68-8576-0ec08c8eb35c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:43.489483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4e2af664-58b3-4b68-8576-0ec08c8eb35c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:43.490028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4e2af664-58b3-4b68-8576-0ec08c8eb35c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:43.490900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4e2af664-58b3-4b68-8576-0ec08c8eb35c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:43.491429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4e2af664-58b3-4b68-8576-0ec08c8eb35c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:43.645015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4e2af664-58b3-4b68-8576-0ec08c8eb35c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:43.653038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4e2af664-58b3-4b68-8576-0ec08c8eb35c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.174670 Apr 07 12:56:43.663343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 54/108] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:43 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:44.315506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-706c7f1c-48bf-4c42-b5eb-8c2d63825e35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:44.316314 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-706c7f1c-48bf-4c42-b5eb-8c2d63825e35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:44.323193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-706c7f1c-48bf-4c42-b5eb-8c2d63825e35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:44.323883 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-706c7f1c-48bf-4c42-b5eb-8c2d63825e35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:44.325410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-706c7f1c-48bf-4c42-b5eb-8c2d63825e35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:44.326709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-706c7f1c-48bf-4c42-b5eb-8c2d63825e35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:44.480475 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-706c7f1c-48bf-4c42-b5eb-8c2d63825e35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:44.490062 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-706c7f1c-48bf-4c42-b5eb-8c2d63825e35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:44.491874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-706c7f1c-48bf-4c42-b5eb-8c2d63825e35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:44.493494 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-706c7f1c-48bf-4c42-b5eb-8c2d63825e35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.182834 Apr 07 12:56:44.494140 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 55/109] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:44 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:44.497844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-80dee09b-2678-412f-86f6-3b6e580ca323 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:44.498985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-80dee09b-2678-412f-86f6-3b6e580ca323 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:44.504895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80dee09b-2678-412f-86f6-3b6e580ca323 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:44.505332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80dee09b-2678-412f-86f6-3b6e580ca323 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:44.506075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80dee09b-2678-412f-86f6-3b6e580ca323 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:44.506552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80dee09b-2678-412f-86f6-3b6e580ca323 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:44.659238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-80dee09b-2678-412f-86f6-3b6e580ca323 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:44.666695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-80dee09b-2678-412f-86f6-3b6e580ca323 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.172767 Apr 07 12:56:44.667669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 55/110] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:44 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:44.676702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-48bee200-9ccf-4f19-857e-863f42271c09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:44.676702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-48bee200-9ccf-4f19-857e-863f42271c09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:44.681277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48bee200-9ccf-4f19-857e-863f42271c09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:44.682033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48bee200-9ccf-4f19-857e-863f42271c09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:44.682907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48bee200-9ccf-4f19-857e-863f42271c09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:44.683446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48bee200-9ccf-4f19-857e-863f42271c09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:44.897282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-48bee200-9ccf-4f19-857e-863f42271c09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:44.905743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-48bee200-9ccf-4f19-857e-863f42271c09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.238733 Apr 07 12:56:44.906348 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 56/111] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:44 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:45.343433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-89a47281-e1f5-497d-95ca-45855219d286 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:45.344023 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-89a47281-e1f5-497d-95ca-45855219d286 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:45.349940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89a47281-e1f5-497d-95ca-45855219d286 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:45.350456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89a47281-e1f5-497d-95ca-45855219d286 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:45.351309 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89a47281-e1f5-497d-95ca-45855219d286 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:45.351813 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89a47281-e1f5-497d-95ca-45855219d286 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:45.381112 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-89a47281-e1f5-497d-95ca-45855219d286 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 12:56:45.519476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d66d45d7-bc72-4e23-8cc8-8bf4ef092228 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:45.520194 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d66d45d7-bc72-4e23-8cc8-8bf4ef092228 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:45.528168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d66d45d7-bc72-4e23-8cc8-8bf4ef092228 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:45.529142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d66d45d7-bc72-4e23-8cc8-8bf4ef092228 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:45.530628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d66d45d7-bc72-4e23-8cc8-8bf4ef092228 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:45.531272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d66d45d7-bc72-4e23-8cc8-8bf4ef092228 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:45.556816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-89a47281-e1f5-497d-95ca-45855219d286 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 204 len: 0 microversion: 2.1 time: 0.216876 Apr 07 12:56:45.557459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 56/112] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 12:56:45 2022] DELETE /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 12:56:45.567654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-874a5ab2-568b-4f2b-b47a-3f8fb0bfcacc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:45.568387 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-874a5ab2-568b-4f2b-b47a-3f8fb0bfcacc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:45.582541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-874a5ab2-568b-4f2b-b47a-3f8fb0bfcacc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:45.583000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-874a5ab2-568b-4f2b-b47a-3f8fb0bfcacc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:45.583775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-874a5ab2-568b-4f2b-b47a-3f8fb0bfcacc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:45.584247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-874a5ab2-568b-4f2b-b47a-3f8fb0bfcacc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:45.730356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d66d45d7-bc72-4e23-8cc8-8bf4ef092228 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:45.739249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d66d45d7-bc72-4e23-8cc8-8bf4ef092228 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:45.740850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d66d45d7-bc72-4e23-8cc8-8bf4ef092228 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:45.742032 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d66d45d7-bc72-4e23-8cc8-8bf4ef092228 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.227700 Apr 07 12:56:45.742588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 57/113] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:45 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:56:45.750418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-874a5ab2-568b-4f2b-b47a-3f8fb0bfcacc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:45.757698 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c7f25527-7927-4ec8-838e-a95f8f109270 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:45.758324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c7f25527-7927-4ec8-838e-a95f8f109270 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:45.759121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-874a5ab2-568b-4f2b-b47a-3f8fb0bfcacc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1550 microversion: 2.1 time: 0.196355 Apr 07 12:56:45.759967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 57/114] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:45 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1550 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:45.773009 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7f25527-7927-4ec8-838e-a95f8f109270 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:45.773453 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7f25527-7927-4ec8-838e-a95f8f109270 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:45.774301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7f25527-7927-4ec8-838e-a95f8f109270 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:45.774788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7f25527-7927-4ec8-838e-a95f8f109270 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:45.917120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c7f25527-7927-4ec8-838e-a95f8f109270 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:45.925690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-80391f32-8440-46f1-aff2-eaedaa644789 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:45.926310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-80391f32-8440-46f1-aff2-eaedaa644789 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:45.927318 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c7f25527-7927-4ec8-838e-a95f8f109270 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.179068 Apr 07 12:56:45.932919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80391f32-8440-46f1-aff2-eaedaa644789 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:45.933643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80391f32-8440-46f1-aff2-eaedaa644789 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:45.934770 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80391f32-8440-46f1-aff2-eaedaa644789 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:45.936252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80391f32-8440-46f1-aff2-eaedaa644789 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:45.938155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 58/115] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:45 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:46.093663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-80391f32-8440-46f1-aff2-eaedaa644789 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:46.100996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-80391f32-8440-46f1-aff2-eaedaa644789 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.182177 Apr 07 12:56:46.101572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 58/116] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:45 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:46.761394 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2f4351b3-0198-43ad-88c4-4fe99db9f4c1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:46.762000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2f4351b3-0198-43ad-88c4-4fe99db9f4c1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:46.768852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f4351b3-0198-43ad-88c4-4fe99db9f4c1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:46.769299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f4351b3-0198-43ad-88c4-4fe99db9f4c1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:46.770053 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f4351b3-0198-43ad-88c4-4fe99db9f4c1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:46.770479 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f4351b3-0198-43ad-88c4-4fe99db9f4c1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:46.777105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b2fa8863-c6e2-4729-bea3-bb06b6334bc5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:46.777717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b2fa8863-c6e2-4729-bea3-bb06b6334bc5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:46.784678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b2fa8863-c6e2-4729-bea3-bb06b6334bc5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:46.785062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b2fa8863-c6e2-4729-bea3-bb06b6334bc5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:46.785831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b2fa8863-c6e2-4729-bea3-bb06b6334bc5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:46.786264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b2fa8863-c6e2-4729-bea3-bb06b6334bc5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:46.910597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2f4351b3-0198-43ad-88c4-4fe99db9f4c1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:46.917741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b2fa8863-c6e2-4729-bea3-bb06b6334bc5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:46.918324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2f4351b3-0198-43ad-88c4-4fe99db9f4c1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:46.920091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2f4351b3-0198-43ad-88c4-4fe99db9f4c1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:46.921299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2f4351b3-0198-43ad-88c4-4fe99db9f4c1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.164032 Apr 07 12:56:46.921865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 59/117] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:46 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:46.925503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b2fa8863-c6e2-4729-bea3-bb06b6334bc5 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1550 microversion: 2.1 time: 0.152218 Apr 07 12:56:46.926131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 59/118] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:46 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:46.944394 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f040e963-631d-4f33-8378-34e706093dd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:46.945149 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f040e963-631d-4f33-8378-34e706093dd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:46.951571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f040e963-631d-4f33-8378-34e706093dd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:46.952016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f040e963-631d-4f33-8378-34e706093dd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:46.952818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f040e963-631d-4f33-8378-34e706093dd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:46.953247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f040e963-631d-4f33-8378-34e706093dd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:47.082212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f040e963-631d-4f33-8378-34e706093dd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:47.089561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f040e963-631d-4f33-8378-34e706093dd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.148999 Apr 07 12:56:47.090116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 60/119] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:46 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:47.118318 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bf0704bd-2ba0-43ab-acc2-f1a515c6bdc0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:47.118936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bf0704bd-2ba0-43ab-acc2-f1a515c6bdc0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:47.125246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bf0704bd-2ba0-43ab-acc2-f1a515c6bdc0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:47.125701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bf0704bd-2ba0-43ab-acc2-f1a515c6bdc0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:47.126465 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bf0704bd-2ba0-43ab-acc2-f1a515c6bdc0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:47.126901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bf0704bd-2ba0-43ab-acc2-f1a515c6bdc0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:47.258999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bf0704bd-2ba0-43ab-acc2-f1a515c6bdc0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:47.267266 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bf0704bd-2ba0-43ab-acc2-f1a515c6bdc0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.152757 Apr 07 12:56:47.267839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 60/120] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:47 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:47.938856 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a8ea878c-bfa1-454c-a654-b8cb8c0833a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:47.939574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a8ea878c-bfa1-454c-a654-b8cb8c0833a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:47.941328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0696cd79-1a9b-4609-a84f-af87649859e0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:47.941943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0696cd79-1a9b-4609-a84f-af87649859e0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:47.945913 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a8ea878c-bfa1-454c-a654-b8cb8c0833a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:47.946354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a8ea878c-bfa1-454c-a654-b8cb8c0833a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:47.947116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a8ea878c-bfa1-454c-a654-b8cb8c0833a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:47.947546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a8ea878c-bfa1-454c-a654-b8cb8c0833a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:47.947875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0696cd79-1a9b-4609-a84f-af87649859e0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:47.948377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0696cd79-1a9b-4609-a84f-af87649859e0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:47.949140 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0696cd79-1a9b-4609-a84f-af87649859e0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:47.949575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0696cd79-1a9b-4609-a84f-af87649859e0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:48.096402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a8ea878c-bfa1-454c-a654-b8cb8c0833a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:48.098697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0696cd79-1a9b-4609-a84f-af87649859e0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:48.107739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0696cd79-1a9b-4609-a84f-af87649859e0 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1550 microversion: 2.1 time: 0.169415 Apr 07 12:56:48.108317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 61/121] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:47 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:48.110839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a8ea878c-bfa1-454c-a654-b8cb8c0833a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:48.112418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a8ea878c-bfa1-454c-a654-b8cb8c0833a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:48.113043 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5098ff52-0d8e-48b8-8fae-62416afa098a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:48.113585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a8ea878c-bfa1-454c-a654-b8cb8c0833a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.178669 Apr 07 12:56:48.113687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5098ff52-0d8e-48b8-8fae-62416afa098a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:48.114140 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 61/122] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:47 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:48.119821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5098ff52-0d8e-48b8-8fae-62416afa098a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:48.120377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5098ff52-0d8e-48b8-8fae-62416afa098a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:48.121203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5098ff52-0d8e-48b8-8fae-62416afa098a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:48.121717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5098ff52-0d8e-48b8-8fae-62416afa098a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:48.250723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5098ff52-0d8e-48b8-8fae-62416afa098a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:48.257804 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5098ff52-0d8e-48b8-8fae-62416afa098a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.148322 Apr 07 12:56:48.258367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 62/123] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:48 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:48.284933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b6013eea-0b5d-4af2-8c46-9326b6b2e52f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:48.285612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b6013eea-0b5d-4af2-8c46-9326b6b2e52f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:48.292490 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6013eea-0b5d-4af2-8c46-9326b6b2e52f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:48.292949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6013eea-0b5d-4af2-8c46-9326b6b2e52f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:48.293738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6013eea-0b5d-4af2-8c46-9326b6b2e52f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:48.294179 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6013eea-0b5d-4af2-8c46-9326b6b2e52f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:48.432489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b6013eea-0b5d-4af2-8c46-9326b6b2e52f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:48.440208 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b6013eea-0b5d-4af2-8c46-9326b6b2e52f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.159816 Apr 07 12:56:48.440790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 62/124] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:48 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:49.124492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-51a67a48-3025-4597-be2b-9eb90a40d8b9 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:49.125110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-51a67a48-3025-4597-be2b-9eb90a40d8b9 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:49.131767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51a67a48-3025-4597-be2b-9eb90a40d8b9 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:49.132344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51a67a48-3025-4597-be2b-9eb90a40d8b9 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:49.132734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-aabefc07-3655-4fc6-ba5a-cc15f2f690ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:49.133261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51a67a48-3025-4597-be2b-9eb90a40d8b9 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:49.133549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51a67a48-3025-4597-be2b-9eb90a40d8b9 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:49.134136 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-aabefc07-3655-4fc6-ba5a-cc15f2f690ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:49.145546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aabefc07-3655-4fc6-ba5a-cc15f2f690ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:49.146971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aabefc07-3655-4fc6-ba5a-cc15f2f690ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:49.147850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aabefc07-3655-4fc6-ba5a-cc15f2f690ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:49.148397 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aabefc07-3655-4fc6-ba5a-cc15f2f690ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:49.274404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-51a67a48-3025-4597-be2b-9eb90a40d8b9 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:49.283967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-51a67a48-3025-4597-be2b-9eb90a40d8b9 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1550 microversion: 2.1 time: 0.163213 Apr 07 12:56:49.284576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 63/125] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:49 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:49.285563 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-aabefc07-3655-4fc6-ba5a-cc15f2f690ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:49.291987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-95f676b6-80a0-4e8b-99cf-d55317250669 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:49.292617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-95f676b6-80a0-4e8b-99cf-d55317250669 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:49.293432 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-aabefc07-3655-4fc6-ba5a-cc15f2f690ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:49.294971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-aabefc07-3655-4fc6-ba5a-cc15f2f690ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:49.296207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-aabefc07-3655-4fc6-ba5a-cc15f2f690ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.167545 Apr 07 12:56:49.296764 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 63/126] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:49 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:56:49.298912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-95f676b6-80a0-4e8b-99cf-d55317250669 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:49.299367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-95f676b6-80a0-4e8b-99cf-d55317250669 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:49.300123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-95f676b6-80a0-4e8b-99cf-d55317250669 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:49.300574 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-95f676b6-80a0-4e8b-99cf-d55317250669 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:49.432556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-95f676b6-80a0-4e8b-99cf-d55317250669 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:49.439801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-95f676b6-80a0-4e8b-99cf-d55317250669 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.154125 Apr 07 12:56:49.440416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 64/127] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:49 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:49.456605 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d0ead9c8-4f3d-4cf9-9509-2064ca296edf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:49.457216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d0ead9c8-4f3d-4cf9-9509-2064ca296edf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:49.462983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0ead9c8-4f3d-4cf9-9509-2064ca296edf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:49.463433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0ead9c8-4f3d-4cf9-9509-2064ca296edf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:49.464221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0ead9c8-4f3d-4cf9-9509-2064ca296edf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:49.464662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0ead9c8-4f3d-4cf9-9509-2064ca296edf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:49.595905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d0ead9c8-4f3d-4cf9-9509-2064ca296edf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:49.603166 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d0ead9c8-4f3d-4cf9-9509-2064ca296edf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.150321 Apr 07 12:56:49.603721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 64/128] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:49 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:50.301974 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-20c53a09-a770-4538-b84c-a810156972e2 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:50.302576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-20c53a09-a770-4538-b84c-a810156972e2 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:50.308468 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20c53a09-a770-4538-b84c-a810156972e2 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:50.308916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20c53a09-a770-4538-b84c-a810156972e2 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:50.309665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20c53a09-a770-4538-b84c-a810156972e2 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:50.310092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20c53a09-a770-4538-b84c-a810156972e2 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:50.314410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cd8bf8dc-1399-4e37-a0ad-3b74f460c4cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:50.315014 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cd8bf8dc-1399-4e37-a0ad-3b74f460c4cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:50.321233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cd8bf8dc-1399-4e37-a0ad-3b74f460c4cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:50.321682 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cd8bf8dc-1399-4e37-a0ad-3b74f460c4cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:50.322443 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cd8bf8dc-1399-4e37-a0ad-3b74f460c4cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:50.322871 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cd8bf8dc-1399-4e37-a0ad-3b74f460c4cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:50.467480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-20c53a09-a770-4538-b84c-a810156972e2 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:50.468231 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cd8bf8dc-1399-4e37-a0ad-3b74f460c4cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:50.476560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-20c53a09-a770-4538-b84c-a810156972e2 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1550 microversion: 2.1 time: 0.178322 Apr 07 12:56:50.477149 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cd8bf8dc-1399-4e37-a0ad-3b74f460c4cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:50.477281 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 65/129] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:50 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1550 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:50.478646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cd8bf8dc-1399-4e37-a0ad-3b74f460c4cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:50.479787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cd8bf8dc-1399-4e37-a0ad-3b74f460c4cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.169663 Apr 07 12:56:50.480605 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 65/130] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:50 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:50.481914 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-630bf49d-7214-47bd-aa57-9f62ea642ea4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:50.482520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-630bf49d-7214-47bd-aa57-9f62ea642ea4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:50.489920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-630bf49d-7214-47bd-aa57-9f62ea642ea4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:50.490382 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-630bf49d-7214-47bd-aa57-9f62ea642ea4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:50.491148 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-630bf49d-7214-47bd-aa57-9f62ea642ea4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:50.491583 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-630bf49d-7214-47bd-aa57-9f62ea642ea4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:50.620347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-52924ca3-5e88-4bd6-ae04-e41f8f4848a4 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:50.620963 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-52924ca3-5e88-4bd6-ae04-e41f8f4848a4 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:50.623134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-630bf49d-7214-47bd-aa57-9f62ea642ea4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:50.627558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-52924ca3-5e88-4bd6-ae04-e41f8f4848a4 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:50.628006 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-52924ca3-5e88-4bd6-ae04-e41f8f4848a4 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:50.628799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-52924ca3-5e88-4bd6-ae04-e41f8f4848a4 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:50.629274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-52924ca3-5e88-4bd6-ae04-e41f8f4848a4 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:50.631284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-630bf49d-7214-47bd-aa57-9f62ea642ea4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.153044 Apr 07 12:56:50.631874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 66/131] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:50 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:50.775145 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-52924ca3-5e88-4bd6-ae04-e41f8f4848a4 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:50.783884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-52924ca3-5e88-4bd6-ae04-e41f8f4848a4 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.167302 Apr 07 12:56:50.784495 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 66/132] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:50 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:51.495022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-641821ba-5770-4042-abbb-bfe0e343dc80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:51.495795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-641821ba-5770-4042-abbb-bfe0e343dc80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:51.497865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f8a6aaa0-7caa-4063-a28c-2edb40726c98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:51.498484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f8a6aaa0-7caa-4063-a28c-2edb40726c98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:51.502528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-641821ba-5770-4042-abbb-bfe0e343dc80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:51.503204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-641821ba-5770-4042-abbb-bfe0e343dc80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:51.504084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-641821ba-5770-4042-abbb-bfe0e343dc80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:51.504678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-641821ba-5770-4042-abbb-bfe0e343dc80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:51.505428 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f8a6aaa0-7caa-4063-a28c-2edb40726c98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:51.505876 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f8a6aaa0-7caa-4063-a28c-2edb40726c98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:51.506645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f8a6aaa0-7caa-4063-a28c-2edb40726c98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:51.507080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f8a6aaa0-7caa-4063-a28c-2edb40726c98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:51.636051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-641821ba-5770-4042-abbb-bfe0e343dc80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:51.638346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f8a6aaa0-7caa-4063-a28c-2edb40726c98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:51.644967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-641821ba-5770-4042-abbb-bfe0e343dc80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1550 microversion: 2.1 time: 0.153798 Apr 07 12:56:51.654716 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 67/133] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:51 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:51.659786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f8a6aaa0-7caa-4063-a28c-2edb40726c98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:51.660740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-404cc3d2-a062-4ef7-9e89-8aea5b4f9c29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:51.661307 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f8a6aaa0-7caa-4063-a28c-2edb40726c98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:51.661415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-404cc3d2-a062-4ef7-9e89-8aea5b4f9c29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:51.662416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f8a6aaa0-7caa-4063-a28c-2edb40726c98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.168429 Apr 07 12:56:51.662976 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 67/134] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:51 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:56:51.667706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-404cc3d2-a062-4ef7-9e89-8aea5b4f9c29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:51.668150 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-404cc3d2-a062-4ef7-9e89-8aea5b4f9c29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:51.668933 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-404cc3d2-a062-4ef7-9e89-8aea5b4f9c29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:51.669370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-404cc3d2-a062-4ef7-9e89-8aea5b4f9c29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:51.803107 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-20a4e1b4-262c-4b48-90bf-eed6168516b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:51.804046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-20a4e1b4-262c-4b48-90bf-eed6168516b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:51.810720 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-20a4e1b4-262c-4b48-90bf-eed6168516b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:51.811197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-20a4e1b4-262c-4b48-90bf-eed6168516b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:51.812440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-20a4e1b4-262c-4b48-90bf-eed6168516b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:51.813033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-20a4e1b4-262c-4b48-90bf-eed6168516b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:51.848947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-404cc3d2-a062-4ef7-9e89-8aea5b4f9c29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:51.856546 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-404cc3d2-a062-4ef7-9e89-8aea5b4f9c29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1322 microversion: 2.1 time: 0.199358 Apr 07 12:56:51.866665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 68/135] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:51 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:51.970845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-20a4e1b4-262c-4b48-90bf-eed6168516b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:51.978245 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-20a4e1b4-262c-4b48-90bf-eed6168516b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.179731 Apr 07 12:56:51.978814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 68/136] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:51 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:52.122259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-7f3390b2-5656-4f19-ae01-78021c980f55 req-0b158dce-1832-45ca-8927-5727fd0d9bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34baf697-0c75-496f-a1fe-fef1314f1a9a", "name": "network-vif-plugged", "status": "completed", "tag": "4c467477-c161-40fe-bb4a-d23378671576"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:52.131515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-7f3390b2-5656-4f19-ae01-78021c980f55 req-0b158dce-1832-45ca-8927-5727fd0d9bba service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:52.131817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-7f3390b2-5656-4f19-ae01-78021c980f55 req-0b158dce-1832-45ca-8927-5727fd0d9bba service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:52.146150 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-7f3390b2-5656-4f19-ae01-78021c980f55 req-0b158dce-1832-45ca-8927-5727fd0d9bba service nova] Creating event network-vif-plugged:4c467477-c161-40fe-bb4a-d23378671576 for instance 34baf697-0c75-496f-a1fe-fef1314f1a9a on hv-cinder-83694 Apr 07 12:56:52.151597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-7f3390b2-5656-4f19-ae01-78021c980f55 req-0b158dce-1832-45ca-8927-5727fd0d9bba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033315 Apr 07 12:56:52.152219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 69/137] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 12:56:52.663470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-55e17a53-1d1f-4ef7-b5c3-cebba28a6b3f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:52.664423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-55e17a53-1d1f-4ef7-b5c3-cebba28a6b3f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:52.672482 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-55e17a53-1d1f-4ef7-b5c3-cebba28a6b3f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:52.673376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-55e17a53-1d1f-4ef7-b5c3-cebba28a6b3f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:52.674247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-55e17a53-1d1f-4ef7-b5c3-cebba28a6b3f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:52.678133 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-55e17a53-1d1f-4ef7-b5c3-cebba28a6b3f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:52.685460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-46a2d347-4335-4430-99da-d867dcc4aecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:52.686587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-46a2d347-4335-4430-99da-d867dcc4aecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:52.703007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46a2d347-4335-4430-99da-d867dcc4aecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:52.714256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46a2d347-4335-4430-99da-d867dcc4aecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:52.715596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46a2d347-4335-4430-99da-d867dcc4aecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:52.716204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46a2d347-4335-4430-99da-d867dcc4aecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:52.937987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-46a2d347-4335-4430-99da-d867dcc4aecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:52.949490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-46a2d347-4335-4430-99da-d867dcc4aecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:52.951315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-46a2d347-4335-4430-99da-d867dcc4aecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:52.953325 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-46a2d347-4335-4430-99da-d867dcc4aecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.274299 Apr 07 12:56:52.954432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 70/138] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:52 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:56:52.959213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-eac60667-166c-420c-9851-9916b5c5397f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:52.960063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-eac60667-166c-420c-9851-9916b5c5397f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:52.962845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-55e17a53-1d1f-4ef7-b5c3-cebba28a6b3f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:52.972972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-55e17a53-1d1f-4ef7-b5c3-cebba28a6b3f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1550 microversion: 2.1 time: 0.314293 Apr 07 12:56:52.974282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 69/139] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:52 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1550 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:52.977138 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eac60667-166c-420c-9851-9916b5c5397f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:52.977607 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eac60667-166c-420c-9851-9916b5c5397f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:52.978406 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eac60667-166c-420c-9851-9916b5c5397f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:52.978853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eac60667-166c-420c-9851-9916b5c5397f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:52.994627 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fba6f52f-a3fb-42de-a23e-2deb80307513 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:52.995503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fba6f52f-a3fb-42de-a23e-2deb80307513 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:53.002488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fba6f52f-a3fb-42de-a23e-2deb80307513 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:53.003363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fba6f52f-a3fb-42de-a23e-2deb80307513 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:53.004709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fba6f52f-a3fb-42de-a23e-2deb80307513 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:53.005620 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fba6f52f-a3fb-42de-a23e-2deb80307513 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:53.169511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-eac60667-166c-420c-9851-9916b5c5397f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:53.171038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fba6f52f-a3fb-42de-a23e-2deb80307513 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:53.177927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-eac60667-166c-420c-9851-9916b5c5397f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1515 microversion: 2.1 time: 0.222268 Apr 07 12:56:53.178848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 71/140] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:52 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:53.179891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fba6f52f-a3fb-42de-a23e-2deb80307513 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.188950 Apr 07 12:56:53.180724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 70/141] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:52 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:53.196611 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9e1b99c6-d83c-4d3b-bc36-076871af9b46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:53.197790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9e1b99c6-d83c-4d3b-bc36-076871af9b46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:53.204702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e1b99c6-d83c-4d3b-bc36-076871af9b46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:53.205229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e1b99c6-d83c-4d3b-bc36-076871af9b46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:53.206133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e1b99c6-d83c-4d3b-bc36-076871af9b46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:53.206662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e1b99c6-d83c-4d3b-bc36-076871af9b46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:53.230284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-9e1b99c6-d83c-4d3b-bc36-076871af9b46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'flavor' on Instance uuid 9ac775a7-260a-4442-b7d0-b6d3c331cab3 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 12:56:53.352521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9e1b99c6-d83c-4d3b-bc36-076871af9b46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "POST /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3/action" status: 200 len: 32 microversion: 2.1 time: 0.159673 Apr 07 12:56:53.353478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 72/142] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 12:56:53 2022] POST /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 07 12:56:53.361986 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-82b73ae2-e727-4e36-9154-c80607ce97b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:53.362607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-82b73ae2-e727-4e36-9154-c80607ce97b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:53.368721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-82b73ae2-e727-4e36-9154-c80607ce97b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:53.369187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-82b73ae2-e727-4e36-9154-c80607ce97b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:53.370401 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-82b73ae2-e727-4e36-9154-c80607ce97b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:53.370521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-82b73ae2-e727-4e36-9154-c80607ce97b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:53.567046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-82b73ae2-e727-4e36-9154-c80607ce97b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:53.580220 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-82b73ae2-e727-4e36-9154-c80607ce97b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.221950 Apr 07 12:56:53.580973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 71/143] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:53 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:53.972889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9ef2a9d6-3049-4f63-8429-95cd7acb8794 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:53.973602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9ef2a9d6-3049-4f63-8429-95cd7acb8794 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:53.979907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9ef2a9d6-3049-4f63-8429-95cd7acb8794 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:53.980386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9ef2a9d6-3049-4f63-8429-95cd7acb8794 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:53.981217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9ef2a9d6-3049-4f63-8429-95cd7acb8794 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:53.981654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9ef2a9d6-3049-4f63-8429-95cd7acb8794 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:53.994843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0b0ccf29-72b3-4f22-845c-2750f8f2904f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:54.002811 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0b0ccf29-72b3-4f22-845c-2750f8f2904f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:54.013688 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0b0ccf29-72b3-4f22-845c-2750f8f2904f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:54.014132 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0b0ccf29-72b3-4f22-845c-2750f8f2904f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:54.014910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0b0ccf29-72b3-4f22-845c-2750f8f2904f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:54.016018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0b0ccf29-72b3-4f22-845c-2750f8f2904f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:54.159186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9ef2a9d6-3049-4f63-8429-95cd7acb8794 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:54.176445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9ef2a9d6-3049-4f63-8429-95cd7acb8794 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:54.177939 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9ef2a9d6-3049-4f63-8429-95cd7acb8794 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:54.179057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9ef2a9d6-3049-4f63-8429-95cd7acb8794 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.210515 Apr 07 12:56:54.179608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 73/144] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:53 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:54.184436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-3a6647b2-0a57-4221-9ee3-8f693a84038c req-2719aacc-c56d-4593-89be-7bfa28e02e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c9a464-496a-4aa9-80dd-f9ec66f515ae", "name": "network-vif-plugged", "status": "completed", "tag": "b25fac27-5301-4311-8e84-5721b8cac04c"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:54.194884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-3a6647b2-0a57-4221-9ee3-8f693a84038c req-2719aacc-c56d-4593-89be-7bfa28e02e40 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:54.195540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-3a6647b2-0a57-4221-9ee3-8f693a84038c req-2719aacc-c56d-4593-89be-7bfa28e02e40 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:54.198833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0b0ccf29-72b3-4f22-845c-2750f8f2904f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:54.207288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-3a6647b2-0a57-4221-9ee3-8f693a84038c req-2719aacc-c56d-4593-89be-7bfa28e02e40 service nova] Creating event network-vif-plugged:b25fac27-5301-4311-8e84-5721b8cac04c for instance 58c9a464-496a-4aa9-80dd-f9ec66f515ae on hv-cinder-83694 Apr 07 12:56:54.207489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0b0ccf29-72b3-4f22-845c-2750f8f2904f tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1550 microversion: 2.1 time: 0.219563 Apr 07 12:56:54.208034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 72/145] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:53 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1550 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:54.212260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-3a6647b2-0a57-4221-9ee3-8f693a84038c req-2719aacc-c56d-4593-89be-7bfa28e02e40 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031333 Apr 07 12:56:54.213339 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 74/146] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:56:54.216653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dd06fef8-9bd7-467a-b246-788f1d6cb9bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:54.217392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dd06fef8-9bd7-467a-b246-788f1d6cb9bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:54.223523 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd06fef8-9bd7-467a-b246-788f1d6cb9bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:54.224004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd06fef8-9bd7-467a-b246-788f1d6cb9bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:54.224908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd06fef8-9bd7-467a-b246-788f1d6cb9bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:54.225342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd06fef8-9bd7-467a-b246-788f1d6cb9bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:54.369197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dd06fef8-9bd7-467a-b246-788f1d6cb9bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:54.377690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dd06fef8-9bd7-467a-b246-788f1d6cb9bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.168237 Apr 07 12:56:54.378472 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 73/147] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:54 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:54.600023 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-104d6b04-80df-442c-a7e8-16a71e98c954 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:54.600905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-104d6b04-80df-442c-a7e8-16a71e98c954 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:54.607626 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-104d6b04-80df-442c-a7e8-16a71e98c954 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:54.608391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-104d6b04-80df-442c-a7e8-16a71e98c954 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:54.610919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-104d6b04-80df-442c-a7e8-16a71e98c954 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:54.611519 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-104d6b04-80df-442c-a7e8-16a71e98c954 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:54.876247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-104d6b04-80df-442c-a7e8-16a71e98c954 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:54.884766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-104d6b04-80df-442c-a7e8-16a71e98c954 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.291171 Apr 07 12:56:54.885750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 75/148] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:54 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:55.199958 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c1302369-4f38-4140-8e1a-b8ae69c9dca0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:55.200683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c1302369-4f38-4140-8e1a-b8ae69c9dca0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:55.211892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1302369-4f38-4140-8e1a-b8ae69c9dca0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:55.212494 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1302369-4f38-4140-8e1a-b8ae69c9dca0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:55.213125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1302369-4f38-4140-8e1a-b8ae69c9dca0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:55.213556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1302369-4f38-4140-8e1a-b8ae69c9dca0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:55.225659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ae49e0a4-f6b4-45e5-96b1-229ec704eebd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:55.226422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ae49e0a4-f6b4-45e5-96b1-229ec704eebd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:55.233689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae49e0a4-f6b4-45e5-96b1-229ec704eebd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:55.234430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae49e0a4-f6b4-45e5-96b1-229ec704eebd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:55.236589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae49e0a4-f6b4-45e5-96b1-229ec704eebd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:55.237545 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae49e0a4-f6b4-45e5-96b1-229ec704eebd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:55.398567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c1302369-4f38-4140-8e1a-b8ae69c9dca0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:55.416551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c1302369-4f38-4140-8e1a-b8ae69c9dca0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:55.418636 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c1302369-4f38-4140-8e1a-b8ae69c9dca0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:55.420007 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c1302369-4f38-4140-8e1a-b8ae69c9dca0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.225862 Apr 07 12:56:55.420607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 74/149] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:55 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:56:55.425732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e12e7125-3fb8-4a63-a293-5a298a61eec2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:55.426558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e12e7125-3fb8-4a63-a293-5a298a61eec2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:55.435507 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e12e7125-3fb8-4a63-a293-5a298a61eec2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:55.436361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e12e7125-3fb8-4a63-a293-5a298a61eec2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:55.437706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e12e7125-3fb8-4a63-a293-5a298a61eec2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:55.437971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e12e7125-3fb8-4a63-a293-5a298a61eec2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:55.539595 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ae49e0a4-f6b4-45e5-96b1-229ec704eebd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:55.550586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ae49e0a4-f6b4-45e5-96b1-229ec704eebd tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1550 microversion: 2.1 time: 0.328845 Apr 07 12:56:55.551791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 76/150] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:55 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1550 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:55.607392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e12e7125-3fb8-4a63-a293-5a298a61eec2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:55.616608 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e12e7125-3fb8-4a63-a293-5a298a61eec2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.194465 Apr 07 12:56:55.618151 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 75/151] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:55 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:55.734718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-8e7155c9-ac5a-45be-8eba-61e4d3366ade req-61513908-c5d4-41b6-b01f-d36bc92bf84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8280810-53d2-4a3f-8bae-bdf653d6de32", "name": "network-vif-deleted", "tag": "6fd76b8f-140a-4745-9cac-0e55a348d1ae"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:56:55.743554 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-8e7155c9-ac5a-45be-8eba-61e4d3366ade req-61513908-c5d4-41b6-b01f-d36bc92bf84d service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:55.744255 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-8e7155c9-ac5a-45be-8eba-61e4d3366ade req-61513908-c5d4-41b6-b01f-d36bc92bf84d service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:55.755552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-8e7155c9-ac5a-45be-8eba-61e4d3366ade req-61513908-c5d4-41b6-b01f-d36bc92bf84d service nova] Creating event network-vif-deleted:6fd76b8f-140a-4745-9cac-0e55a348d1ae for instance f8280810-53d2-4a3f-8bae-bdf653d6de32 on hv-cinder-83694 Apr 07 12:56:55.761259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-8e7155c9-ac5a-45be-8eba-61e4d3366ade req-61513908-c5d4-41b6-b01f-d36bc92bf84d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036842 Apr 07 12:56:55.762340 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 77/152] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:56:55.903670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9dd3c767-d74e-4b92-b9c5-b1c4f98059ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:55.904669 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9dd3c767-d74e-4b92-b9c5-b1c4f98059ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:55.911819 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9dd3c767-d74e-4b92-b9c5-b1c4f98059ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:55.912310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9dd3c767-d74e-4b92-b9c5-b1c4f98059ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:55.913077 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9dd3c767-d74e-4b92-b9c5-b1c4f98059ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:55.913504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9dd3c767-d74e-4b92-b9c5-b1c4f98059ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:56.371599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9dd3c767-d74e-4b92-b9c5-b1c4f98059ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:56.380423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9dd3c767-d74e-4b92-b9c5-b1c4f98059ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.481178 Apr 07 12:56:56.381262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 76/153] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:55 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:56.442135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-32b448e1-82d0-4672-8f63-83f4c0aad83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:56.442832 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-32b448e1-82d0-4672-8f63-83f4c0aad83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:56.448926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32b448e1-82d0-4672-8f63-83f4c0aad83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:56.449386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32b448e1-82d0-4672-8f63-83f4c0aad83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:56.450147 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32b448e1-82d0-4672-8f63-83f4c0aad83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:56.450588 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32b448e1-82d0-4672-8f63-83f4c0aad83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:56.568993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5d2bad22-7369-4cfe-acfe-dd77b38e538d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:56.569605 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5d2bad22-7369-4cfe-acfe-dd77b38e538d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:56.575453 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d2bad22-7369-4cfe-acfe-dd77b38e538d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:56.576043 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d2bad22-7369-4cfe-acfe-dd77b38e538d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:56.576852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d2bad22-7369-4cfe-acfe-dd77b38e538d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:56.577293 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d2bad22-7369-4cfe-acfe-dd77b38e538d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:56.586037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-32b448e1-82d0-4672-8f63-83f4c0aad83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:56.595028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-32b448e1-82d0-4672-8f63-83f4c0aad83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:56.596750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-32b448e1-82d0-4672-8f63-83f4c0aad83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:56.597849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-32b448e1-82d0-4672-8f63-83f4c0aad83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.160506 Apr 07 12:56:56.598403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 78/154] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:56 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:56.633926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-62f326cc-efe8-478e-b9d4-5a362469fffd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:56.634535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-62f326cc-efe8-478e-b9d4-5a362469fffd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:56.636128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5d2bad22-7369-4cfe-acfe-dd77b38e538d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:56.640501 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62f326cc-efe8-478e-b9d4-5a362469fffd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:56.640951 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62f326cc-efe8-478e-b9d4-5a362469fffd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:56.641747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62f326cc-efe8-478e-b9d4-5a362469fffd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:56.642180 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62f326cc-efe8-478e-b9d4-5a362469fffd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:56.643981 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5d2bad22-7369-4cfe-acfe-dd77b38e538d tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1345 microversion: 2.1 time: 0.078760 Apr 07 12:56:56.644581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 77/155] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:56 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:56.773897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-62f326cc-efe8-478e-b9d4-5a362469fffd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:56.782080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-62f326cc-efe8-478e-b9d4-5a362469fffd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.151914 Apr 07 12:56:56.782644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 79/156] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:56 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:56:57.397189 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d2c16bd5-86be-49c1-be5c-7ceec872ee49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:57.397836 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d2c16bd5-86be-49c1-be5c-7ceec872ee49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:57.404111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d2c16bd5-86be-49c1-be5c-7ceec872ee49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:57.404608 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d2c16bd5-86be-49c1-be5c-7ceec872ee49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:57.406340 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d2c16bd5-86be-49c1-be5c-7ceec872ee49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:57.406700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d2c16bd5-86be-49c1-be5c-7ceec872ee49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:57.538792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d2c16bd5-86be-49c1-be5c-7ceec872ee49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:57.546010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d2c16bd5-86be-49c1-be5c-7ceec872ee49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.152591 Apr 07 12:56:57.546785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 78/157] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:57 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:57.614618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-719bbeed-2286-4f50-94d1-2ec05f828928 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:57.615229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-719bbeed-2286-4f50-94d1-2ec05f828928 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:57.621126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-719bbeed-2286-4f50-94d1-2ec05f828928 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:57.621575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-719bbeed-2286-4f50-94d1-2ec05f828928 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:57.622332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-719bbeed-2286-4f50-94d1-2ec05f828928 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:57.622765 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-719bbeed-2286-4f50-94d1-2ec05f828928 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:57.661095 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4a29a54c-d76b-426b-94e7-9f6e89ea218b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:57.662058 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4a29a54c-d76b-426b-94e7-9f6e89ea218b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:57.668472 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4a29a54c-d76b-426b-94e7-9f6e89ea218b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:57.669200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4a29a54c-d76b-426b-94e7-9f6e89ea218b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:57.670127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4a29a54c-d76b-426b-94e7-9f6e89ea218b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:57.670734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4a29a54c-d76b-426b-94e7-9f6e89ea218b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:57.731319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4a29a54c-d76b-426b-94e7-9f6e89ea218b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:57.740545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4a29a54c-d76b-426b-94e7-9f6e89ea218b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1345 microversion: 2.1 time: 0.083162 Apr 07 12:56:57.741131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 79/158] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:57 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:57.761140 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-719bbeed-2286-4f50-94d1-2ec05f828928 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:57.769751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-719bbeed-2286-4f50-94d1-2ec05f828928 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:57.771252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-719bbeed-2286-4f50-94d1-2ec05f828928 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:57.772418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-719bbeed-2286-4f50-94d1-2ec05f828928 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.161542 Apr 07 12:56:57.772984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 80/159] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:57 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:56:57.798849 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4fcc6f01-2ad2-4e69-ae74-470bedce222f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:57.799485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4fcc6f01-2ad2-4e69-ae74-470bedce222f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:57.805287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fcc6f01-2ad2-4e69-ae74-470bedce222f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:57.805730 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fcc6f01-2ad2-4e69-ae74-470bedce222f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:57.806477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fcc6f01-2ad2-4e69-ae74-470bedce222f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:57.806904 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fcc6f01-2ad2-4e69-ae74-470bedce222f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:57.936609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4fcc6f01-2ad2-4e69-ae74-470bedce222f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:57.944404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4fcc6f01-2ad2-4e69-ae74-470bedce222f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.149534 Apr 07 12:56:57.944968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 80/160] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:57 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:58.562493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cf36630e-e563-4fd3-9bc1-c09f8e067324 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:58.563097 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cf36630e-e563-4fd3-9bc1-c09f8e067324 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:58.568914 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cf36630e-e563-4fd3-9bc1-c09f8e067324 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:58.569355 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cf36630e-e563-4fd3-9bc1-c09f8e067324 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:58.570103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cf36630e-e563-4fd3-9bc1-c09f8e067324 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:58.570529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cf36630e-e563-4fd3-9bc1-c09f8e067324 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:58.698887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cf36630e-e563-4fd3-9bc1-c09f8e067324 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:58.706666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cf36630e-e563-4fd3-9bc1-c09f8e067324 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.147861 Apr 07 12:56:58.707228 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 81/161] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:58 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:58.757238 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-aba85cf8-157d-452a-b6f1-e6c8c9c3b1fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:58.757850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-aba85cf8-157d-452a-b6f1-e6c8c9c3b1fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:58.764599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aba85cf8-157d-452a-b6f1-e6c8c9c3b1fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:58.765838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aba85cf8-157d-452a-b6f1-e6c8c9c3b1fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:58.767028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aba85cf8-157d-452a-b6f1-e6c8c9c3b1fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:58.767705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aba85cf8-157d-452a-b6f1-e6c8c9c3b1fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:58.790514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fcda9bf8-90f0-494f-92f5-b642f3123909 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:58.791238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fcda9bf8-90f0-494f-92f5-b642f3123909 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:58.797496 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fcda9bf8-90f0-494f-92f5-b642f3123909 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:58.797938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fcda9bf8-90f0-494f-92f5-b642f3123909 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:58.798710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fcda9bf8-90f0-494f-92f5-b642f3123909 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:58.799122 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fcda9bf8-90f0-494f-92f5-b642f3123909 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:58.829636 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-aba85cf8-157d-452a-b6f1-e6c8c9c3b1fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:58.837772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-aba85cf8-157d-452a-b6f1-e6c8c9c3b1fc tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1345 microversion: 2.1 time: 0.084338 Apr 07 12:56:58.838343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 81/162] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:58 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:58.934961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fcda9bf8-90f0-494f-92f5-b642f3123909 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:58.943061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fcda9bf8-90f0-494f-92f5-b642f3123909 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:58.944589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fcda9bf8-90f0-494f-92f5-b642f3123909 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:58.945686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fcda9bf8-90f0-494f-92f5-b642f3123909 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.158954 Apr 07 12:56:58.946345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 82/163] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:58 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:56:58.961309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1de9c91c-4187-4f9f-b292-956c8b50e993 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:58.961926 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1de9c91c-4187-4f9f-b292-956c8b50e993 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:58.967724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1de9c91c-4187-4f9f-b292-956c8b50e993 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:58.968890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1de9c91c-4187-4f9f-b292-956c8b50e993 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:58.969653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1de9c91c-4187-4f9f-b292-956c8b50e993 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:58.970087 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1de9c91c-4187-4f9f-b292-956c8b50e993 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:59.106693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1de9c91c-4187-4f9f-b292-956c8b50e993 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:59.114409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1de9c91c-4187-4f9f-b292-956c8b50e993 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.156863 Apr 07 12:56:59.114964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 82/164] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:58 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:59.723532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-644dff7c-2eb9-4a1c-a094-1988d0054aae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:59.724179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-644dff7c-2eb9-4a1c-a094-1988d0054aae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:59.730249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-644dff7c-2eb9-4a1c-a094-1988d0054aae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:59.730688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-644dff7c-2eb9-4a1c-a094-1988d0054aae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:59.731437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-644dff7c-2eb9-4a1c-a094-1988d0054aae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:59.731863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-644dff7c-2eb9-4a1c-a094-1988d0054aae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:59.858721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0f58d963-ef8b-4081-9036-576627258c25 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:59.861276 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0f58d963-ef8b-4081-9036-576627258c25 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:59.872393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f58d963-ef8b-4081-9036-576627258c25 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:59.873103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f58d963-ef8b-4081-9036-576627258c25 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:59.874003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f58d963-ef8b-4081-9036-576627258c25 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:59.874512 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f58d963-ef8b-4081-9036-576627258c25 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:59.875275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-644dff7c-2eb9-4a1c-a094-1988d0054aae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:59.883520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-644dff7c-2eb9-4a1c-a094-1988d0054aae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.164426 Apr 07 12:56:59.884448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 83/165] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:59 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:56:59.925873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f58d963-ef8b-4081-9036-576627258c25 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:59.926634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f58d963-ef8b-4081-9036-576627258c25 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:59.927396 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-0f58d963-ef8b-4081-9036-576627258c25 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lazy-loading 'fault' on Instance uuid f8280810-53d2-4a3f-8bae-bdf653d6de32 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 12:56:59.965027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f669c205-9776-4c9a-9577-68f963b244a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:56:59.965640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f669c205-9776-4c9a-9577-68f963b244a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:56:59.972302 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f669c205-9776-4c9a-9577-68f963b244a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:59.972753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f669c205-9776-4c9a-9577-68f963b244a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:59.973519 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f669c205-9776-4c9a-9577-68f963b244a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:56:59.973958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f669c205-9776-4c9a-9577-68f963b244a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:56:59.979608 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0f58d963-ef8b-4081-9036-576627258c25 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:56:59.989660 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0f58d963-ef8b-4081-9036-576627258c25 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1350 microversion: 2.1 time: 0.138182 Apr 07 12:56:59.990444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 83/166] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:56:59 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:00.131102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6260a245-7f81-43a6-8305-1725bb57ba86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:00.131971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6260a245-7f81-43a6-8305-1725bb57ba86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:00.138231 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6260a245-7f81-43a6-8305-1725bb57ba86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:00.138786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6260a245-7f81-43a6-8305-1725bb57ba86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:00.139667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6260a245-7f81-43a6-8305-1725bb57ba86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:00.140135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6260a245-7f81-43a6-8305-1725bb57ba86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:00.149664 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f669c205-9776-4c9a-9577-68f963b244a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:00.166449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f669c205-9776-4c9a-9577-68f963b244a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:00.168234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f669c205-9776-4c9a-9577-68f963b244a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:00.169525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f669c205-9776-4c9a-9577-68f963b244a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.208546 Apr 07 12:57:00.170262 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 84/167] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:56:59 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:57:00.327405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6260a245-7f81-43a6-8305-1725bb57ba86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:00.335758 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6260a245-7f81-43a6-8305-1725bb57ba86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1364 microversion: 2.1 time: 0.208531 Apr 07 12:57:00.336344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 84/168] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:00 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:00.900551 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9cbdd8a8-3eb5-41ad-bd52-d859fb5a8383 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:00.901193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9cbdd8a8-3eb5-41ad-bd52-d859fb5a8383 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:00.908234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9cbdd8a8-3eb5-41ad-bd52-d859fb5a8383 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:00.908613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9cbdd8a8-3eb5-41ad-bd52-d859fb5a8383 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:00.909552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9cbdd8a8-3eb5-41ad-bd52-d859fb5a8383 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:00.909992 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9cbdd8a8-3eb5-41ad-bd52-d859fb5a8383 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:01.007790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b5c06e57-6938-4954-9d64-f2f3104edc44 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:01.008513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b5c06e57-6938-4954-9d64-f2f3104edc44 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:01.017643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5c06e57-6938-4954-9d64-f2f3104edc44 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:01.018414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5c06e57-6938-4954-9d64-f2f3104edc44 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:01.019695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5c06e57-6938-4954-9d64-f2f3104edc44 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:01.020477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5c06e57-6938-4954-9d64-f2f3104edc44 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:01.054846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9cbdd8a8-3eb5-41ad-bd52-d859fb5a8383 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:01.062095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9cbdd8a8-3eb5-41ad-bd52-d859fb5a8383 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.165369 Apr 07 12:57:01.063416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 85/169] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:00 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:01.066763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5c06e57-6938-4954-9d64-f2f3104edc44 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:01.067434 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5c06e57-6938-4954-9d64-f2f3104edc44 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:01.068105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-b5c06e57-6938-4954-9d64-f2f3104edc44 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lazy-loading 'fault' on Instance uuid f8280810-53d2-4a3f-8bae-bdf653d6de32 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 12:57:01.108445 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b5c06e57-6938-4954-9d64-f2f3104edc44 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:01.117402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b5c06e57-6938-4954-9d64-f2f3104edc44 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1350 microversion: 2.1 time: 0.113492 Apr 07 12:57:01.117983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 85/170] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:01 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:01.186630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-40d817a3-db42-4e2f-9ea2-ef91cdf654bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:01.187349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-40d817a3-db42-4e2f-9ea2-ef91cdf654bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:01.193871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40d817a3-db42-4e2f-9ea2-ef91cdf654bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:01.194318 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40d817a3-db42-4e2f-9ea2-ef91cdf654bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:01.195069 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40d817a3-db42-4e2f-9ea2-ef91cdf654bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:01.195501 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40d817a3-db42-4e2f-9ea2-ef91cdf654bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:01.327596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-40d817a3-db42-4e2f-9ea2-ef91cdf654bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:01.336299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-40d817a3-db42-4e2f-9ea2-ef91cdf654bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:01.337778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-40d817a3-db42-4e2f-9ea2-ef91cdf654bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:01.338860 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-40d817a3-db42-4e2f-9ea2-ef91cdf654bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.156089 Apr 07 12:57:01.339411 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 86/171] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:57:01 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:57:01.352963 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4c8b72c0-d804-4912-96e9-c6179abb569c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:01.353564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4c8b72c0-d804-4912-96e9-c6179abb569c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:01.359724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c8b72c0-d804-4912-96e9-c6179abb569c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:01.360245 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c8b72c0-d804-4912-96e9-c6179abb569c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:01.361023 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c8b72c0-d804-4912-96e9-c6179abb569c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:01.361464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c8b72c0-d804-4912-96e9-c6179abb569c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:01.505039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4c8b72c0-d804-4912-96e9-c6179abb569c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:01.512289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4c8b72c0-d804-4912-96e9-c6179abb569c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1550 microversion: 2.1 time: 0.163058 Apr 07 12:57:01.512862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 86/172] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:01 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:57:01.529670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-33c85b2e-0da4-4279-b690-0c17aba3b3b9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:01.530201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-33c85b2e-0da4-4279-b690-0c17aba3b3b9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:01.536469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33c85b2e-0da4-4279-b690-0c17aba3b3b9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:01.536920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33c85b2e-0da4-4279-b690-0c17aba3b3b9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:01.537682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33c85b2e-0da4-4279-b690-0c17aba3b3b9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:01.538117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33c85b2e-0da4-4279-b690-0c17aba3b3b9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:01.619122 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-33c85b2e-0da4-4279-b690-0c17aba3b3b9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093489 Apr 07 12:57:01.619713 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 87/173] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Apr 7 12:57:01 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:57:02.080122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-18b9d33c-97c4-454e-a1c6-b3528c179b2a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:02.080775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-18b9d33c-97c4-454e-a1c6-b3528c179b2a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:02.087021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-18b9d33c-97c4-454e-a1c6-b3528c179b2a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:02.087475 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-18b9d33c-97c4-454e-a1c6-b3528c179b2a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:02.088275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-18b9d33c-97c4-454e-a1c6-b3528c179b2a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:02.088719 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-18b9d33c-97c4-454e-a1c6-b3528c179b2a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:02.137126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e4bc404e-cfb4-4bb8-b09b-db6806a6b361 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:02.137690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e4bc404e-cfb4-4bb8-b09b-db6806a6b361 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:02.144755 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e4bc404e-cfb4-4bb8-b09b-db6806a6b361 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:02.145208 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e4bc404e-cfb4-4bb8-b09b-db6806a6b361 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:02.145975 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e4bc404e-cfb4-4bb8-b09b-db6806a6b361 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:02.146408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e4bc404e-cfb4-4bb8-b09b-db6806a6b361 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:02.176639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e4bc404e-cfb4-4bb8-b09b-db6806a6b361 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:02.177097 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e4bc404e-cfb4-4bb8-b09b-db6806a6b361 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:02.177546 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-e4bc404e-cfb4-4bb8-b09b-db6806a6b361 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lazy-loading 'fault' on Instance uuid f8280810-53d2-4a3f-8bae-bdf653d6de32 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 12:57:02.228854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-18b9d33c-97c4-454e-a1c6-b3528c179b2a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:02.233061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e4bc404e-cfb4-4bb8-b09b-db6806a6b361 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:02.237284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-18b9d33c-97c4-454e-a1c6-b3528c179b2a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.161025 Apr 07 12:57:02.237860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 87/174] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:02 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:02.244016 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e4bc404e-cfb4-4bb8-b09b-db6806a6b361 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1350 microversion: 2.1 time: 0.111681 Apr 07 12:57:02.255035 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 88/175] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:02 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:57:02.357006 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-28dea1cc-335e-45f6-9b6b-44a156984bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:02.357613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-28dea1cc-335e-45f6-9b6b-44a156984bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:02.365076 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-28dea1cc-335e-45f6-9b6b-44a156984bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:02.365524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-28dea1cc-335e-45f6-9b6b-44a156984bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:02.366285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-28dea1cc-335e-45f6-9b6b-44a156984bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:02.366716 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-28dea1cc-335e-45f6-9b6b-44a156984bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:02.497608 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-28dea1cc-335e-45f6-9b6b-44a156984bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:02.505436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-28dea1cc-335e-45f6-9b6b-44a156984bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:02.506926 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-28dea1cc-335e-45f6-9b6b-44a156984bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:02.508047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-28dea1cc-335e-45f6-9b6b-44a156984bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.154868 Apr 07 12:57:02.508645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 88/176] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:57:02 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:57:03.019897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-bd1cb4a2-2952-4049-bb0e-a6156620259f req-a12e7e39-64e1-48fd-8242-fa811abb8a5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34baf697-0c75-496f-a1fe-fef1314f1a9a", "tag": "4c467477-c161-40fe-bb4a-d23378671576"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:57:03.027887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-bd1cb4a2-2952-4049-bb0e-a6156620259f req-a12e7e39-64e1-48fd-8242-fa811abb8a5b service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:03.028380 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-bd1cb4a2-2952-4049-bb0e-a6156620259f req-a12e7e39-64e1-48fd-8242-fa811abb8a5b service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:03.043411 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-bd1cb4a2-2952-4049-bb0e-a6156620259f req-a12e7e39-64e1-48fd-8242-fa811abb8a5b service nova] Creating event network-changed:4c467477-c161-40fe-bb4a-d23378671576 for instance 34baf697-0c75-496f-a1fe-fef1314f1a9a on hv-cinder-83694 Apr 07 12:57:03.048837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-bd1cb4a2-2952-4049-bb0e-a6156620259f req-a12e7e39-64e1-48fd-8242-fa811abb8a5b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038781 Apr 07 12:57:03.050119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 89/177] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:57:03.254794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b6c8640f-c285-4645-8ea8-7f6f4b13937c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:03.255965 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b6c8640f-c285-4645-8ea8-7f6f4b13937c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:03.261634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-013b6b90-a892-44f3-9051-b01a47bccb80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:03.262343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-013b6b90-a892-44f3-9051-b01a47bccb80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:03.262447 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6c8640f-c285-4645-8ea8-7f6f4b13937c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:03.262881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6c8640f-c285-4645-8ea8-7f6f4b13937c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:03.263685 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6c8640f-c285-4645-8ea8-7f6f4b13937c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:03.264127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6c8640f-c285-4645-8ea8-7f6f4b13937c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:03.273422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-013b6b90-a892-44f3-9051-b01a47bccb80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:03.273889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-013b6b90-a892-44f3-9051-b01a47bccb80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:03.274931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-013b6b90-a892-44f3-9051-b01a47bccb80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:03.275538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-013b6b90-a892-44f3-9051-b01a47bccb80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:03.311846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-013b6b90-a892-44f3-9051-b01a47bccb80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:03.313020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-013b6b90-a892-44f3-9051-b01a47bccb80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:03.313586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-013b6b90-a892-44f3-9051-b01a47bccb80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lazy-loading 'fault' on Instance uuid f8280810-53d2-4a3f-8bae-bdf653d6de32 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 12:57:03.355533 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-013b6b90-a892-44f3-9051-b01a47bccb80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:03.371444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-013b6b90-a892-44f3-9051-b01a47bccb80 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1350 microversion: 2.1 time: 0.114094 Apr 07 12:57:03.372181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 90/178] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:03 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:03.416846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b6c8640f-c285-4645-8ea8-7f6f4b13937c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:03.425206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b6c8640f-c285-4645-8ea8-7f6f4b13937c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.174996 Apr 07 12:57:03.425779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 89/179] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:03 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:03.537289 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-64dad09e-28b1-4630-b327-025bfdf38750 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:03.538433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-64dad09e-28b1-4630-b327-025bfdf38750 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:03.549280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-64dad09e-28b1-4630-b327-025bfdf38750 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:03.550102 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-64dad09e-28b1-4630-b327-025bfdf38750 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:03.551481 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-64dad09e-28b1-4630-b327-025bfdf38750 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:03.552275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-64dad09e-28b1-4630-b327-025bfdf38750 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:03.699015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-64dad09e-28b1-4630-b327-025bfdf38750 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:03.709412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-64dad09e-28b1-4630-b327-025bfdf38750 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:03.711423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-64dad09e-28b1-4630-b327-025bfdf38750 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:03.712606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-64dad09e-28b1-4630-b327-025bfdf38750 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1407 microversion: 2.20 time: 0.183112 Apr 07 12:57:03.713158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 91/180] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:57:03 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:57:04.400330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e9dc7833-9673-4506-956c-cda54f2ba5e3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:04.400330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e9dc7833-9673-4506-956c-cda54f2ba5e3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:04.409107 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e9dc7833-9673-4506-956c-cda54f2ba5e3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:04.409643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e9dc7833-9673-4506-956c-cda54f2ba5e3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:04.410387 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e9dc7833-9673-4506-956c-cda54f2ba5e3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:04.410780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e9dc7833-9673-4506-956c-cda54f2ba5e3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:04.442680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-13523709-a13b-4ce1-aa68-6359081d48d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:04.443489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-13523709-a13b-4ce1-aa68-6359081d48d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:04.447189 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e9dc7833-9673-4506-956c-cda54f2ba5e3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:04.447648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e9dc7833-9673-4506-956c-cda54f2ba5e3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:04.448102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-e9dc7833-9673-4506-956c-cda54f2ba5e3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lazy-loading 'fault' on Instance uuid f8280810-53d2-4a3f-8bae-bdf653d6de32 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 12:57:04.449383 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13523709-a13b-4ce1-aa68-6359081d48d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:04.450004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13523709-a13b-4ce1-aa68-6359081d48d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:04.450776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13523709-a13b-4ce1-aa68-6359081d48d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:04.451415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13523709-a13b-4ce1-aa68-6359081d48d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:04.493162 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e9dc7833-9673-4506-956c-cda54f2ba5e3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:04.503879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e9dc7833-9673-4506-956c-cda54f2ba5e3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1350 microversion: 2.1 time: 0.117610 Apr 07 12:57:04.504648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 90/181] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:04 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:04.597504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-13523709-a13b-4ce1-aa68-6359081d48d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:04.604784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-13523709-a13b-4ce1-aa68-6359081d48d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.166436 Apr 07 12:57:04.605425 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 92/182] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:04 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:57:04.732503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0ed6b428-9c10-41e4-a897-2c87bdccd151 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:04.733213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0ed6b428-9c10-41e4-a897-2c87bdccd151 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:04.739907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ed6b428-9c10-41e4-a897-2c87bdccd151 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:04.740385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ed6b428-9c10-41e4-a897-2c87bdccd151 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:04.741148 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ed6b428-9c10-41e4-a897-2c87bdccd151 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:04.741586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ed6b428-9c10-41e4-a897-2c87bdccd151 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:05.020638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0ed6b428-9c10-41e4-a897-2c87bdccd151 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:05.028251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0ed6b428-9c10-41e4-a897-2c87bdccd151 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:05.029737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0ed6b428-9c10-41e4-a897-2c87bdccd151 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:05.031695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0ed6b428-9c10-41e4-a897-2c87bdccd151 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1599 microversion: 2.20 time: 0.302910 Apr 07 12:57:05.032273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 91/183] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:57:04 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1599 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:57:05.050212 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bcff9422-176b-4bd4-aecc-136e5123bf59 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:05.050706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bcff9422-176b-4bd4-aecc-136e5123bf59 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:05.056709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bcff9422-176b-4bd4-aecc-136e5123bf59 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:05.057160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bcff9422-176b-4bd4-aecc-136e5123bf59 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:05.057915 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bcff9422-176b-4bd4-aecc-136e5123bf59 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:05.058349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bcff9422-176b-4bd4-aecc-136e5123bf59 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:05.144026 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bcff9422-176b-4bd4-aecc-136e5123bf59 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098351 Apr 07 12:57:05.144690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 93/184] 10.222.0.15 () {60 vars in 1315 bytes} [Thu Apr 7 12:57:05 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:57:05.522877 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-93f02376-6565-4e99-bed7-2c8d58265795 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:05.524063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-93f02376-6565-4e99-bed7-2c8d58265795 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:05.534424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93f02376-6565-4e99-bed7-2c8d58265795 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:05.535219 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93f02376-6565-4e99-bed7-2c8d58265795 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:05.536678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93f02376-6565-4e99-bed7-2c8d58265795 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:05.537354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93f02376-6565-4e99-bed7-2c8d58265795 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:05.571884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93f02376-6565-4e99-bed7-2c8d58265795 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:05.572782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93f02376-6565-4e99-bed7-2c8d58265795 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:05.573384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-93f02376-6565-4e99-bed7-2c8d58265795 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lazy-loading 'fault' on Instance uuid f8280810-53d2-4a3f-8bae-bdf653d6de32 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 12:57:05.614542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-93f02376-6565-4e99-bed7-2c8d58265795 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:05.622378 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fd919fe7-1347-41f6-81b6-726e6210c7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:05.622959 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fd919fe7-1347-41f6-81b6-726e6210c7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:05.623601 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-93f02376-6565-4e99-bed7-2c8d58265795 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1350 microversion: 2.1 time: 0.106094 Apr 07 12:57:05.624195 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 92/185] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:05 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:05.631481 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd919fe7-1347-41f6-81b6-726e6210c7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:05.631937 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd919fe7-1347-41f6-81b6-726e6210c7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:05.632993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd919fe7-1347-41f6-81b6-726e6210c7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:05.633434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd919fe7-1347-41f6-81b6-726e6210c7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:05.895610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fd919fe7-1347-41f6-81b6-726e6210c7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:05.904038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fd919fe7-1347-41f6-81b6-726e6210c7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.285546 Apr 07 12:57:05.904638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 94/186] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:05 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:57:06.241524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-0bcfe7c2-8bf1-4896-86ca-77249e05fd03 req-ada62e0b-c34c-4d10-8d32-9062e32eb14c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c9a464-496a-4aa9-80dd-f9ec66f515ae", "tag": "b25fac27-5301-4311-8e84-5721b8cac04c"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:57:06.250439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-0bcfe7c2-8bf1-4896-86ca-77249e05fd03 req-ada62e0b-c34c-4d10-8d32-9062e32eb14c service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:06.250889 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-0bcfe7c2-8bf1-4896-86ca-77249e05fd03 req-ada62e0b-c34c-4d10-8d32-9062e32eb14c service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:06.263266 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-0bcfe7c2-8bf1-4896-86ca-77249e05fd03 req-ada62e0b-c34c-4d10-8d32-9062e32eb14c service nova] Creating event network-changed:b25fac27-5301-4311-8e84-5721b8cac04c for instance 58c9a464-496a-4aa9-80dd-f9ec66f515ae on hv-cinder-83694 Apr 07 12:57:06.268538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-0bcfe7c2-8bf1-4896-86ca-77249e05fd03 req-ada62e0b-c34c-4d10-8d32-9062e32eb14c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030597 Apr 07 12:57:06.269890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 93/187] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:57:06.641044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-285fe655-dcf8-4195-a0e6-a8ae5d2675ba tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:06.642379 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-285fe655-dcf8-4195-a0e6-a8ae5d2675ba tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:06.659726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-285fe655-dcf8-4195-a0e6-a8ae5d2675ba tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:06.660442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-285fe655-dcf8-4195-a0e6-a8ae5d2675ba tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:06.661502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-285fe655-dcf8-4195-a0e6-a8ae5d2675ba tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:06.661944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-285fe655-dcf8-4195-a0e6-a8ae5d2675ba tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:06.719946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-285fe655-dcf8-4195-a0e6-a8ae5d2675ba tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:06.720520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-285fe655-dcf8-4195-a0e6-a8ae5d2675ba tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:06.721057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-285fe655-dcf8-4195-a0e6-a8ae5d2675ba tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lazy-loading 'fault' on Instance uuid f8280810-53d2-4a3f-8bae-bdf653d6de32 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 12:57:06.768285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-285fe655-dcf8-4195-a0e6-a8ae5d2675ba tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daabde129e49478fba6478b7d25751c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17fcd10b43a74230a4c4ede819d85b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:06.776244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-285fe655-dcf8-4195-a0e6-a8ae5d2675ba tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 200 len: 1350 microversion: 2.1 time: 0.139021 Apr 07 12:57:06.776814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 95/188] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:06 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:06.923287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0ad25134-368a-4da7-9917-809826add48e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:06.923976 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0ad25134-368a-4da7-9917-809826add48e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:06.930243 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ad25134-368a-4da7-9917-809826add48e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:06.930918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ad25134-368a-4da7-9917-809826add48e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:06.931682 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ad25134-368a-4da7-9917-809826add48e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:06.932110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ad25134-368a-4da7-9917-809826add48e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:07.077132 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0ad25134-368a-4da7-9917-809826add48e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:07.085423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0ad25134-368a-4da7-9917-809826add48e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.167887 Apr 07 12:57:07.088191 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 94/189] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:06 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:07.793927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cfe816f3-4bf3-4451-9358-7da3fbde098b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:07.794531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cfe816f3-4bf3-4451-9358-7da3fbde098b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:07.801706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cfe816f3-4bf3-4451-9358-7da3fbde098b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:07.802179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cfe816f3-4bf3-4451-9358-7da3fbde098b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:07.803007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cfe816f3-4bf3-4451-9358-7da3fbde098b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:07.803445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cfe816f3-4bf3-4451-9358-7da3fbde098b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:07.818078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-cfe816f3-4bf3-4451-9358-7da3fbde098b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] HTTP exception thrown: Instance f8280810-53d2-4a3f-8bae-bdf653d6de32 could not be found. Apr 07 12:57:07.818887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cfe816f3-4bf3-4451-9358-7da3fbde098b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Returning 404 to user: Instance f8280810-53d2-4a3f-8bae-bdf653d6de32 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:57:07.819721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cfe816f3-4bf3-4451-9358-7da3fbde098b tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 404 len: 111 microversion: 2.1 time: 0.029812 Apr 07 12:57:07.820290 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 96/190] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:07 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 12:57:07.933628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eed42a3e-84db-4afe-a981-87fb613e3198 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:07.934506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-eed42a3e-84db-4afe-a981-87fb613e3198 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:07.942420 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eed42a3e-84db-4afe-a981-87fb613e3198 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:07.943086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eed42a3e-84db-4afe-a981-87fb613e3198 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:07.943875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eed42a3e-84db-4afe-a981-87fb613e3198 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:07.944388 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eed42a3e-84db-4afe-a981-87fb613e3198 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:07.958448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-eed42a3e-84db-4afe-a981-87fb613e3198 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] HTTP exception thrown: Instance f8280810-53d2-4a3f-8bae-bdf653d6de32 could not be found. Apr 07 12:57:07.959046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eed42a3e-84db-4afe-a981-87fb613e3198 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Returning 404 to user: Instance f8280810-53d2-4a3f-8bae-bdf653d6de32 could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:57:07.960106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eed42a3e-84db-4afe-a981-87fb613e3198 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030868 Apr 07 12:57:07.960724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 95/191] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 12:57:07 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 12:57:08.103059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c0f7f642-8574-4ca8-8c68-ff30c9f42f22 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:08.103668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c0f7f642-8574-4ca8-8c68-ff30c9f42f22 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:08.116591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c0f7f642-8574-4ca8-8c68-ff30c9f42f22 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:08.117260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c0f7f642-8574-4ca8-8c68-ff30c9f42f22 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:08.118253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c0f7f642-8574-4ca8-8c68-ff30c9f42f22 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:08.118944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c0f7f642-8574-4ca8-8c68-ff30c9f42f22 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:08.282784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c0f7f642-8574-4ca8-8c68-ff30c9f42f22 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:08.290347 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c0f7f642-8574-4ca8-8c68-ff30c9f42f22 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.191293 Apr 07 12:57:08.290906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 97/192] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:08 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:09.201601 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-215d1c84-cf5e-4d35-bbb0-e4277216c745 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:09.202122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-215d1c84-cf5e-4d35-bbb0-e4277216c745 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:09.208879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-215d1c84-cf5e-4d35-bbb0-e4277216c745 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:09.209326 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-215d1c84-cf5e-4d35-bbb0-e4277216c745 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:09.210079 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-215d1c84-cf5e-4d35-bbb0-e4277216c745 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:09.210505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-215d1c84-cf5e-4d35-bbb0-e4277216c745 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:09.225112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-215d1c84-cf5e-4d35-bbb0-e4277216c745 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] HTTP exception thrown: Instance f8280810-53d2-4a3f-8bae-bdf653d6de32 could not be found. Apr 07 12:57:09.225704 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-215d1c84-cf5e-4d35-bbb0-e4277216c745 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Returning 404 to user: Instance f8280810-53d2-4a3f-8bae-bdf653d6de32 could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:57:09.226528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-215d1c84-cf5e-4d35-bbb0-e4277216c745 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 404 len: 111 microversion: 2.1 time: 0.028888 Apr 07 12:57:09.227065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 96/193] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 12:57:09 2022] DELETE /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 12:57:09.235151 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2894ba50-c706-4057-92cd-77412afbaba3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:09.235822 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2894ba50-c706-4057-92cd-77412afbaba3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] [instance: f8280810-53d2-4a3f-8bae-bdf653d6de32] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:09.242430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2894ba50-c706-4057-92cd-77412afbaba3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:09.242871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2894ba50-c706-4057-92cd-77412afbaba3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:09.244020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2894ba50-c706-4057-92cd-77412afbaba3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:09.244020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2894ba50-c706-4057-92cd-77412afbaba3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:09.257604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-2894ba50-c706-4057-92cd-77412afbaba3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] HTTP exception thrown: Instance f8280810-53d2-4a3f-8bae-bdf653d6de32 could not be found. Apr 07 12:57:09.258194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2894ba50-c706-4057-92cd-77412afbaba3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] Returning 404 to user: Instance f8280810-53d2-4a3f-8bae-bdf653d6de32 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:57:09.259015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2894ba50-c706-4057-92cd-77412afbaba3 tempest-DeleteServersTestJSON-418994922 tempest-DeleteServersTestJSON-418994922-project] 10.222.0.15 "GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32" status: 404 len: 111 microversion: 2.1 time: 0.027855 Apr 07 12:57:09.259773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 98/194] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:09 2022] GET /compute/v2.1/servers/f8280810-53d2-4a3f-8bae-bdf653d6de32 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 12:57:09.308179 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8d755115-20d8-4d49-a5b1-3637983691b3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:09.308941 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8d755115-20d8-4d49-a5b1-3637983691b3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:09.315224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d755115-20d8-4d49-a5b1-3637983691b3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:09.315945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d755115-20d8-4d49-a5b1-3637983691b3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:09.316943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d755115-20d8-4d49-a5b1-3637983691b3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:09.317458 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d755115-20d8-4d49-a5b1-3637983691b3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:09.534212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8d755115-20d8-4d49-a5b1-3637983691b3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:09.541848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8d755115-20d8-4d49-a5b1-3637983691b3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.237935 Apr 07 12:57:09.542697 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 97/195] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:09 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:10.558987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cbfdb942-a32f-4a9a-9a82-a1c005134896 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:10.560415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cbfdb942-a32f-4a9a-9a82-a1c005134896 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:10.567237 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbfdb942-a32f-4a9a-9a82-a1c005134896 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:10.568037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbfdb942-a32f-4a9a-9a82-a1c005134896 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:10.569272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbfdb942-a32f-4a9a-9a82-a1c005134896 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:10.569645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbfdb942-a32f-4a9a-9a82-a1c005134896 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:10.720449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cbfdb942-a32f-4a9a-9a82-a1c005134896 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:10.730301 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cbfdb942-a32f-4a9a-9a82-a1c005134896 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.175131 Apr 07 12:57:10.731083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 99/196] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:10 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:11.126208 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-61ad5d3d-e50c-4d43-b312-7bf25b649313 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] Action: 'create', calling method: .version_select at 0x7fde5864e430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1358868710", "metadata": {"Type": "work"}}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:57:11.127585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-61ad5d3d-e50c-4d43-b312-7bf25b649313 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:57:11.128432 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-61ad5d3d-e50c-4d43-b312-7bf25b649313 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134606 Apr 07 12:57:11.129052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 98/197] 10.222.0.15 () {60 vars in 1155 bytes} [Thu Apr 7 12:57:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 12:57:11.137780 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-48386232-939a-4450-9831-9aacd0da5f7a tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] Action: 'create', calling method: .version_select at 0x7fde58863e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1661278314", "metadata": {"Type": "work"}}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:57:11.139230 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-48386232-939a-4450-9831-9aacd0da5f7a tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:57:11.140024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-48386232-939a-4450-9831-9aacd0da5f7a tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006012 Apr 07 12:57:11.140767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 100/198] 10.222.0.15 () {60 vars in 1155 bytes} [Thu Apr 7 12:57:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 12:57:11.149449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0362745c-af2d-4065-88bf-46934de12dd5 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] Action: 'create', calling method: .version_select at 0x7fde58766ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-363785003", "metadata": {"Type": "work"}}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:57:11.150696 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0362745c-af2d-4065-88bf-46934de12dd5 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:57:11.151521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0362745c-af2d-4065-88bf-46934de12dd5 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005746 Apr 07 12:57:11.152022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 99/199] 10.222.0.15 () {60 vars in 1155 bytes} [Thu Apr 7 12:57:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 07 12:57:11.161125 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fc17640e-0872-44ae-b8df-e0cee78bf977 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] Calling method '.version_select at 0x7fde587568b0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:11.189049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-fc17640e-0872-44ae-b8df-e0cee78bf977 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] HTTP exception thrown: Volume tempest-invalid-1628833367 could not be found. Apr 07 12:57:11.189640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fc17640e-0872-44ae-b8df-e0cee78bf977 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] Returning 404 to user: Volume tempest-invalid-1628833367 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:57:11.190486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fc17640e-0872-44ae-b8df-e0cee78bf977 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1628833367" status: 404 len: 99 microversion: 2.1 time: 0.033077 Apr 07 12:57:11.191038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 101/200] 10.222.0.15 () {58 vars in 1217 bytes} [Thu Apr 7 12:57:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1628833367 => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 07 12:57:11.200677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-858624b4-9996-4b44-835a-b703e4ce39c6 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003610 Apr 07 12:57:11.201172 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 100/201] 10.222.0.15 () {58 vars in 1139 bytes} [Thu Apr 7 12:57:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 07 12:57:11.210934 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c1a477cb-a926-48ac-8147-d34736855416 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003762 Apr 07 12:57:11.211544 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 102/202] 10.222.0.15 () {58 vars in 1136 bytes} [Thu Apr 7 12:57:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 07 12:57:11.220640 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-44fcf64e-1e4e-4b09-b54b-0aa55931e3e7 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] Calling method '.version_select at 0x7fde5864ee50>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:11.249025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-44fcf64e-1e4e-4b09-b54b-0aa55931e3e7 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] HTTP exception thrown: Volume c67c9328-d32d-4904-888a-a4ccd01de529 could not be found. Apr 07 12:57:11.249770 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-44fcf64e-1e4e-4b09-b54b-0aa55931e3e7 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] Returning 404 to user: Volume c67c9328-d32d-4904-888a-a4ccd01de529 could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:57:11.250930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-44fcf64e-1e4e-4b09-b54b-0aa55931e3e7 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/c67c9328-d32d-4904-888a-a4ccd01de529" status: 404 len: 109 microversion: 2.1 time: 0.034463 Apr 07 12:57:11.251477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 101/203] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Apr 7 12:57:11 2022] DELETE /compute/v2.1/os-volumes/c67c9328-d32d-4904-888a-a4ccd01de529 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 07 12:57:11.260596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f9f1cc16-f324-48bf-9b42-1ebad4c841e4 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] Calling method '.version_select at 0x7fde5a39c0d0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:11.288430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-f9f1cc16-f324-48bf-9b42-1ebad4c841e4 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] HTTP exception thrown: Volume 25bf023f-2a74-4d9d-a962-ebe9afdf6453 could not be found. Apr 07 12:57:11.289032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f9f1cc16-f324-48bf-9b42-1ebad4c841e4 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] Returning 404 to user: Volume 25bf023f-2a74-4d9d-a962-ebe9afdf6453 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:57:11.289865 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f9f1cc16-f324-48bf-9b42-1ebad4c841e4 tempest-VolumesNegativeTest-1704442220 tempest-VolumesNegativeTest-1704442220-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/25bf023f-2a74-4d9d-a962-ebe9afdf6453" status: 404 len: 109 microversion: 2.1 time: 0.033086 Apr 07 12:57:11.290414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 103/204] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 12:57:11 2022] GET /compute/v2.1/os-volumes/25bf023f-2a74-4d9d-a962-ebe9afdf6453 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 12:57:11.747715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5e88826f-502a-4076-9653-26967dcbbe55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:11.748486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5e88826f-502a-4076-9653-26967dcbbe55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:11.755140 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e88826f-502a-4076-9653-26967dcbbe55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:11.755674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e88826f-502a-4076-9653-26967dcbbe55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:11.756478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e88826f-502a-4076-9653-26967dcbbe55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:11.756924 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e88826f-502a-4076-9653-26967dcbbe55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:11.949506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5e88826f-502a-4076-9653-26967dcbbe55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:11.956988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5e88826f-502a-4076-9653-26967dcbbe55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.213129 Apr 07 12:57:11.957545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 102/205] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:11 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:12.974618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bc677b2e-7b35-4ff4-8c58-ce369dd7e006 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:12.975229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bc677b2e-7b35-4ff4-8c58-ce369dd7e006 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:12.982524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc677b2e-7b35-4ff4-8c58-ce369dd7e006 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:12.982979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc677b2e-7b35-4ff4-8c58-ce369dd7e006 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:12.983747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc677b2e-7b35-4ff4-8c58-ce369dd7e006 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:12.984730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc677b2e-7b35-4ff4-8c58-ce369dd7e006 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:13.117399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bc677b2e-7b35-4ff4-8c58-ce369dd7e006 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:13.125018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bc677b2e-7b35-4ff4-8c58-ce369dd7e006 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.154023 Apr 07 12:57:13.125718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 104/206] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:12 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:14.141797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8c512b85-4f3f-442e-8e20-b1c6d8f5b5d9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:14.142413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8c512b85-4f3f-442e-8e20-b1c6d8f5b5d9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:14.149328 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c512b85-4f3f-442e-8e20-b1c6d8f5b5d9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:14.149782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c512b85-4f3f-442e-8e20-b1c6d8f5b5d9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:14.150546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c512b85-4f3f-442e-8e20-b1c6d8f5b5d9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:14.150982 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c512b85-4f3f-442e-8e20-b1c6d8f5b5d9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:14.313844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8c512b85-4f3f-442e-8e20-b1c6d8f5b5d9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:14.324355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8c512b85-4f3f-442e-8e20-b1c6d8f5b5d9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.183394 Apr 07 12:57:14.324355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 103/207] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:14 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:15.338138 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8bfc518b-c485-4ebb-a384-8ecc21818f33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:15.338741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8bfc518b-c485-4ebb-a384-8ecc21818f33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:15.344650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8bfc518b-c485-4ebb-a384-8ecc21818f33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:15.345096 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8bfc518b-c485-4ebb-a384-8ecc21818f33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:15.345849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8bfc518b-c485-4ebb-a384-8ecc21818f33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:15.346280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8bfc518b-c485-4ebb-a384-8ecc21818f33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:15.497027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8bfc518b-c485-4ebb-a384-8ecc21818f33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:15.505689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8bfc518b-c485-4ebb-a384-8ecc21818f33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.171185 Apr 07 12:57:15.515588 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 105/208] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:15 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:16.522427 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-14f53562-c5d0-401e-8e95-32e5866f639b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:16.523051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-14f53562-c5d0-401e-8e95-32e5866f639b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:16.529332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14f53562-c5d0-401e-8e95-32e5866f639b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:16.529786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14f53562-c5d0-401e-8e95-32e5866f639b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:16.530803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14f53562-c5d0-401e-8e95-32e5866f639b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:16.531235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14f53562-c5d0-401e-8e95-32e5866f639b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:16.664814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-14f53562-c5d0-401e-8e95-32e5866f639b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:16.672094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-14f53562-c5d0-401e-8e95-32e5866f639b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.153472 Apr 07 12:57:16.672828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 104/209] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:16 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:17.689669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c660268e-3ae6-4043-8e36-b86120c6e65e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:17.690291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c660268e-3ae6-4043-8e36-b86120c6e65e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:17.696323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c660268e-3ae6-4043-8e36-b86120c6e65e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:17.696781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c660268e-3ae6-4043-8e36-b86120c6e65e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:17.697668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c660268e-3ae6-4043-8e36-b86120c6e65e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:17.697989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c660268e-3ae6-4043-8e36-b86120c6e65e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:17.826450 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c660268e-3ae6-4043-8e36-b86120c6e65e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:17.834299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c660268e-3ae6-4043-8e36-b86120c6e65e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.149203 Apr 07 12:57:17.834869 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 106/210] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:17 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:18.851209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4ec4c33a-3af7-4640-9e5c-1465e9e3bdf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:18.851932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4ec4c33a-3af7-4640-9e5c-1465e9e3bdf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:18.858228 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ec4c33a-3af7-4640-9e5c-1465e9e3bdf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:18.858675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ec4c33a-3af7-4640-9e5c-1465e9e3bdf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:18.859433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ec4c33a-3af7-4640-9e5c-1465e9e3bdf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:18.860037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ec4c33a-3af7-4640-9e5c-1465e9e3bdf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:19.007356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4ec4c33a-3af7-4640-9e5c-1465e9e3bdf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:19.015413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4ec4c33a-3af7-4640-9e5c-1465e9e3bdf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.167910 Apr 07 12:57:19.015977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 105/211] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:18 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:20.034087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d29a06ca-8536-4e7d-a576-8cde7285297e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:20.034702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d29a06ca-8536-4e7d-a576-8cde7285297e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:20.040650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d29a06ca-8536-4e7d-a576-8cde7285297e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:20.041104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d29a06ca-8536-4e7d-a576-8cde7285297e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:20.041871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d29a06ca-8536-4e7d-a576-8cde7285297e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:20.042314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d29a06ca-8536-4e7d-a576-8cde7285297e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:20.170921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d29a06ca-8536-4e7d-a576-8cde7285297e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:20.179336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d29a06ca-8536-4e7d-a576-8cde7285297e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.149812 Apr 07 12:57:20.179891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 107/212] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:20 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:21.196468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d6b46264-7dcd-4563-a102-d7e7bbd16fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:21.197086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d6b46264-7dcd-4563-a102-d7e7bbd16fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:21.203325 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d6b46264-7dcd-4563-a102-d7e7bbd16fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:21.203770 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d6b46264-7dcd-4563-a102-d7e7bbd16fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:21.205254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d6b46264-7dcd-4563-a102-d7e7bbd16fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:21.205733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d6b46264-7dcd-4563-a102-d7e7bbd16fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:21.336826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d6b46264-7dcd-4563-a102-d7e7bbd16fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:21.344041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d6b46264-7dcd-4563-a102-d7e7bbd16fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.151357 Apr 07 12:57:21.344635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 106/213] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:21 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:22.362486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0c130d55-21b5-4a21-97ef-7de411c3435e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:22.363149 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0c130d55-21b5-4a21-97ef-7de411c3435e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:22.369143 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c130d55-21b5-4a21-97ef-7de411c3435e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:22.369537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c130d55-21b5-4a21-97ef-7de411c3435e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:22.370292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c130d55-21b5-4a21-97ef-7de411c3435e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:22.370723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c130d55-21b5-4a21-97ef-7de411c3435e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:22.500559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0c130d55-21b5-4a21-97ef-7de411c3435e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:22.508663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0c130d55-21b5-4a21-97ef-7de411c3435e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.150724 Apr 07 12:57:22.509226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 108/214] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:22 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:23.525351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-23bfc216-8960-4b90-9566-c4f05421ef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:23.525953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-23bfc216-8960-4b90-9566-c4f05421ef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:23.532371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-23bfc216-8960-4b90-9566-c4f05421ef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:23.532818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-23bfc216-8960-4b90-9566-c4f05421ef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:23.534255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-23bfc216-8960-4b90-9566-c4f05421ef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:23.534685 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-23bfc216-8960-4b90-9566-c4f05421ef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:23.720804 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-23bfc216-8960-4b90-9566-c4f05421ef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:23.728008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-23bfc216-8960-4b90-9566-c4f05421ef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.206369 Apr 07 12:57:23.728789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 107/215] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:23 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:24.744327 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0c2d1501-3327-41c7-a681-710f75f5d6cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:24.744941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0c2d1501-3327-41c7-a681-710f75f5d6cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:24.754041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c2d1501-3327-41c7-a681-710f75f5d6cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:24.754839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c2d1501-3327-41c7-a681-710f75f5d6cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:24.756039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c2d1501-3327-41c7-a681-710f75f5d6cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:24.757397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c2d1501-3327-41c7-a681-710f75f5d6cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:24.965108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0c2d1501-3327-41c7-a681-710f75f5d6cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:24.973677 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0c2d1501-3327-41c7-a681-710f75f5d6cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.233033 Apr 07 12:57:24.974257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 109/216] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:24 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:25.992184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-12af282d-cc31-4ad2-a347-543b44c605e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:25.992806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-12af282d-cc31-4ad2-a347-543b44c605e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:26.003913 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-12af282d-cc31-4ad2-a347-543b44c605e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:26.004405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-12af282d-cc31-4ad2-a347-543b44c605e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:26.005195 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-12af282d-cc31-4ad2-a347-543b44c605e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:26.007616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-12af282d-cc31-4ad2-a347-543b44c605e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:26.243614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-12af282d-cc31-4ad2-a347-543b44c605e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:26.255250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-12af282d-cc31-4ad2-a347-543b44c605e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.266635 Apr 07 12:57:26.255858 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 108/217] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:25 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:27.272932 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3b10c83a-f7a9-4d19-a164-797d97c0a7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:27.273867 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3b10c83a-f7a9-4d19-a164-797d97c0a7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:27.280490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b10c83a-f7a9-4d19-a164-797d97c0a7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:27.280977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b10c83a-f7a9-4d19-a164-797d97c0a7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:27.282003 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b10c83a-f7a9-4d19-a164-797d97c0a7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:27.282506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b10c83a-f7a9-4d19-a164-797d97c0a7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:27.437476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3b10c83a-f7a9-4d19-a164-797d97c0a7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:27.445955 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3b10c83a-f7a9-4d19-a164-797d97c0a7c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.176704 Apr 07 12:57:27.446774 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 110/218] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:27 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:28.462766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f4c8f91a-2b46-457f-8bc5-3dc4d1a3ed90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:28.463387 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f4c8f91a-2b46-457f-8bc5-3dc4d1a3ed90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:28.470029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f4c8f91a-2b46-457f-8bc5-3dc4d1a3ed90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:28.471086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f4c8f91a-2b46-457f-8bc5-3dc4d1a3ed90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:28.472122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f4c8f91a-2b46-457f-8bc5-3dc4d1a3ed90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:28.472901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f4c8f91a-2b46-457f-8bc5-3dc4d1a3ed90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:28.631170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f4c8f91a-2b46-457f-8bc5-3dc4d1a3ed90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:28.640938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f4c8f91a-2b46-457f-8bc5-3dc4d1a3ed90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.181739 Apr 07 12:57:28.642483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 109/219] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:28 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:29.658888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-585a32f4-6b4f-4d1f-b5c2-996f82a549b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:29.659726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-585a32f4-6b4f-4d1f-b5c2-996f82a549b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:29.665785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-585a32f4-6b4f-4d1f-b5c2-996f82a549b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:29.666236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-585a32f4-6b4f-4d1f-b5c2-996f82a549b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:29.667007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-585a32f4-6b4f-4d1f-b5c2-996f82a549b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:29.667447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-585a32f4-6b4f-4d1f-b5c2-996f82a549b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:29.809888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-585a32f4-6b4f-4d1f-b5c2-996f82a549b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:29.820948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-585a32f4-6b4f-4d1f-b5c2-996f82a549b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.166740 Apr 07 12:57:29.822218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 111/220] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:29 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:30.845258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4b884a53-472a-4da4-8a62-27c95338dab9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:30.846597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4b884a53-472a-4da4-8a62-27c95338dab9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:30.857257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b884a53-472a-4da4-8a62-27c95338dab9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:30.859344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b884a53-472a-4da4-8a62-27c95338dab9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:30.869537 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b884a53-472a-4da4-8a62-27c95338dab9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:30.869537 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b884a53-472a-4da4-8a62-27c95338dab9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:31.187174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4b884a53-472a-4da4-8a62-27c95338dab9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:31.196015 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4b884a53-472a-4da4-8a62-27c95338dab9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.360472 Apr 07 12:57:31.205921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 110/221] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:30 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:32.213644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-20702eb0-57c7-4156-bc0f-bf66cd116919 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:32.214451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-20702eb0-57c7-4156-bc0f-bf66cd116919 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:32.231720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20702eb0-57c7-4156-bc0f-bf66cd116919 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:32.232547 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20702eb0-57c7-4156-bc0f-bf66cd116919 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:32.233551 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20702eb0-57c7-4156-bc0f-bf66cd116919 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:32.234795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20702eb0-57c7-4156-bc0f-bf66cd116919 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:32.547869 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-20702eb0-57c7-4156-bc0f-bf66cd116919 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:32.558417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-20702eb0-57c7-4156-bc0f-bf66cd116919 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1521 microversion: 2.1 time: 0.348561 Apr 07 12:57:32.559006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 112/222] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:32 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:33.577683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d0e98091-ca23-40e1-bdd5-78fdf101823d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:33.578302 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d0e98091-ca23-40e1-bdd5-78fdf101823d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:33.586310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0e98091-ca23-40e1-bdd5-78fdf101823d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:33.586759 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0e98091-ca23-40e1-bdd5-78fdf101823d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:33.587529 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0e98091-ca23-40e1-bdd5-78fdf101823d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:33.587959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0e98091-ca23-40e1-bdd5-78fdf101823d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:33.766686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d0e98091-ca23-40e1-bdd5-78fdf101823d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:33.789303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d0e98091-ca23-40e1-bdd5-78fdf101823d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1501 microversion: 2.1 time: 0.202372 Apr 07 12:57:33.791081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 111/223] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:33 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1501 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:33.807086 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-63fe5a01-42f1-4db5-8c74-c537a5ba8101 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:33.808427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-63fe5a01-42f1-4db5-8c74-c537a5ba8101 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:33.817933 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63fe5a01-42f1-4db5-8c74-c537a5ba8101 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:33.818858 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63fe5a01-42f1-4db5-8c74-c537a5ba8101 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:33.820239 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63fe5a01-42f1-4db5-8c74-c537a5ba8101 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:33.821242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63fe5a01-42f1-4db5-8c74-c537a5ba8101 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:34.144647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-63fe5a01-42f1-4db5-8c74-c537a5ba8101 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:34.156296 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-63fe5a01-42f1-4db5-8c74-c537a5ba8101 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1514 microversion: 2.1 time: 0.354298 Apr 07 12:57:34.157422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 113/224] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:33 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1514 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:35.606450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4d0a0d00-0ef1-4bcf-a1f8-018fe2ce4add tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:57:35.607466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4d0a0d00-0ef1-4bcf-a1f8-018fe2ce4add tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:35.615933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4d0a0d00-0ef1-4bcf-a1f8-018fe2ce4add tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:35.616686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4d0a0d00-0ef1-4bcf-a1f8-018fe2ce4add tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:35.617672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4d0a0d00-0ef1-4bcf-a1f8-018fe2ce4add tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:35.618109 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4d0a0d00-0ef1-4bcf-a1f8-018fe2ce4add tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:35.644580 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-4d0a0d00-0ef1-4bcf-a1f8-018fe2ce4add tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'flavor' on Instance uuid a9feccee-a82e-4fcb-9293-a464dc5601cc {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 12:57:35.778926 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4d0a0d00-0ef1-4bcf-a1f8-018fe2ce4add tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "POST /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc/action" status: 200 len: 32 microversion: 2.1 time: 0.176345 Apr 07 12:57:35.780569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 112/225] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 12:57:35 2022] POST /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 07 12:57:35.789425 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a04b217b-7f21-451c-90ce-1a230ee96a70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:35.790251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a04b217b-7f21-451c-90ce-1a230ee96a70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:35.796197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a04b217b-7f21-451c-90ce-1a230ee96a70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:35.796951 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a04b217b-7f21-451c-90ce-1a230ee96a70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:35.797934 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a04b217b-7f21-451c-90ce-1a230ee96a70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:35.798596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a04b217b-7f21-451c-90ce-1a230ee96a70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:36.110483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a04b217b-7f21-451c-90ce-1a230ee96a70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:36.120909 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a04b217b-7f21-451c-90ce-1a230ee96a70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.335310 Apr 07 12:57:36.121757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 114/226] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:35 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:37.146789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-522b11ff-1d7e-4a18-93c3-34919c1f39da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:37.147969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-522b11ff-1d7e-4a18-93c3-34919c1f39da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:37.164971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-522b11ff-1d7e-4a18-93c3-34919c1f39da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:37.189915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-522b11ff-1d7e-4a18-93c3-34919c1f39da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:37.193158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-522b11ff-1d7e-4a18-93c3-34919c1f39da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:37.195066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-522b11ff-1d7e-4a18-93c3-34919c1f39da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:37.643954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-522b11ff-1d7e-4a18-93c3-34919c1f39da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:37.657690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-522b11ff-1d7e-4a18-93c3-34919c1f39da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.521660 Apr 07 12:57:37.670457 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 113/227] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:37 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:38.678631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1566abbd-2479-45bf-b3b9-b26320ca1f14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:38.679267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1566abbd-2479-45bf-b3b9-b26320ca1f14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:38.689663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1566abbd-2479-45bf-b3b9-b26320ca1f14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:38.690359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1566abbd-2479-45bf-b3b9-b26320ca1f14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:38.701691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1566abbd-2479-45bf-b3b9-b26320ca1f14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:38.705246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1566abbd-2479-45bf-b3b9-b26320ca1f14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:39.211894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1566abbd-2479-45bf-b3b9-b26320ca1f14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:39.219654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1566abbd-2479-45bf-b3b9-b26320ca1f14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.546126 Apr 07 12:57:39.222107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 115/228] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:38 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:57:40.238643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-aa62d941-a1ef-432a-b2be-8074648e9c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:40.239283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-aa62d941-a1ef-432a-b2be-8074648e9c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:40.261547 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aa62d941-a1ef-432a-b2be-8074648e9c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:40.264711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aa62d941-a1ef-432a-b2be-8074648e9c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:40.266251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aa62d941-a1ef-432a-b2be-8074648e9c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:40.270333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aa62d941-a1ef-432a-b2be-8074648e9c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:40.988174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-aa62d941-a1ef-432a-b2be-8074648e9c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:41.005987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-aa62d941-a1ef-432a-b2be-8074648e9c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.771636 Apr 07 12:57:41.009146 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 114/229] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:40 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:42.027404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-62899fbb-5508-4370-ab24-eba5cc99e3cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:42.028030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-62899fbb-5508-4370-ab24-eba5cc99e3cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:42.041268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62899fbb-5508-4370-ab24-eba5cc99e3cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:42.042492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62899fbb-5508-4370-ab24-eba5cc99e3cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:42.042657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62899fbb-5508-4370-ab24-eba5cc99e3cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:42.043060 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62899fbb-5508-4370-ab24-eba5cc99e3cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:42.432290 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-62899fbb-5508-4370-ab24-eba5cc99e3cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:42.444282 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-62899fbb-5508-4370-ab24-eba5cc99e3cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.421356 Apr 07 12:57:42.448131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 116/230] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:42 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:43.466625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c1b01ee1-a865-4e3a-b364-66999a533148 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:43.467255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c1b01ee1-a865-4e3a-b364-66999a533148 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:43.474438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1b01ee1-a865-4e3a-b364-66999a533148 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:43.475247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1b01ee1-a865-4e3a-b364-66999a533148 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:43.476340 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1b01ee1-a865-4e3a-b364-66999a533148 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:43.476965 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1b01ee1-a865-4e3a-b364-66999a533148 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:43.757198 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c1b01ee1-a865-4e3a-b364-66999a533148 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:43.768402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c1b01ee1-a865-4e3a-b364-66999a533148 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.305438 Apr 07 12:57:43.768992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 115/231] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:43 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:44.066116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d5a5e895-54f4-4649-9d6b-581fef75dcdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Action: 'create', calling method: .version_select at 0x7fde58756310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1816777936"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:57:44.081630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-d5a5e895-54f4-4649-9d6b-581fef75dcdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Getting quotas for project a63deb3be5f546a696dabf7b1a6f3416. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:57:44.085841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-d5a5e895-54f4-4649-9d6b-581fef75dcdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Getting quotas for user af14b11cb4c649e6881818075733a5b7 and project a63deb3be5f546a696dabf7b1a6f3416. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:57:44.239312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-d5a5e895-54f4-4649-9d6b-581fef75dcdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Getting quotas for project a63deb3be5f546a696dabf7b1a6f3416. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:57:44.246920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-d5a5e895-54f4-4649-9d6b-581fef75dcdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Getting quotas for user af14b11cb4c649e6881818075733a5b7 and project a63deb3be5f546a696dabf7b1a6f3416. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:57:44.267999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d5a5e895-54f4-4649-9d6b-581fef75dcdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.437576 Apr 07 12:57:44.269044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 117/232] 10.222.0.15 () {60 vars in 1157 bytes} [Thu Apr 7 12:57:43 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:44.788025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-98b36480-6f37-43ed-9296-21f7f69f9dcf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:44.788944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-98b36480-6f37-43ed-9296-21f7f69f9dcf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:44.797632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-98b36480-6f37-43ed-9296-21f7f69f9dcf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:44.798909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-98b36480-6f37-43ed-9296-21f7f69f9dcf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:44.799834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-98b36480-6f37-43ed-9296-21f7f69f9dcf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:44.800419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-98b36480-6f37-43ed-9296-21f7f69f9dcf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:45.105970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-98b36480-6f37-43ed-9296-21f7f69f9dcf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:45.120442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-98b36480-6f37-43ed-9296-21f7f69f9dcf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.338220 Apr 07 12:57:45.127881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 116/233] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:44 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:46.142456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3ba191fd-646a-43cb-9291-7b17aeba0db0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:46.143450 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3ba191fd-646a-43cb-9291-7b17aeba0db0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:46.151822 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3ba191fd-646a-43cb-9291-7b17aeba0db0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:46.153392 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3ba191fd-646a-43cb-9291-7b17aeba0db0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:46.156936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3ba191fd-646a-43cb-9291-7b17aeba0db0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:46.158225 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3ba191fd-646a-43cb-9291-7b17aeba0db0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:46.392874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3ba191fd-646a-43cb-9291-7b17aeba0db0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:46.404987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3ba191fd-646a-43cb-9291-7b17aeba0db0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.266281 Apr 07 12:57:46.420657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 118/234] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:46 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:47.430305 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0cf62e00-6a25-4468-9f22-cdecc48aeaac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:47.431195 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0cf62e00-6a25-4468-9f22-cdecc48aeaac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:47.439665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0cf62e00-6a25-4468-9f22-cdecc48aeaac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:47.440221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0cf62e00-6a25-4468-9f22-cdecc48aeaac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:47.441209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0cf62e00-6a25-4468-9f22-cdecc48aeaac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:47.441640 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0cf62e00-6a25-4468-9f22-cdecc48aeaac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:47.638026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0cf62e00-6a25-4468-9f22-cdecc48aeaac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:47.656290 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0cf62e00-6a25-4468-9f22-cdecc48aeaac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.234463 Apr 07 12:57:47.657846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 117/235] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:47 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:48.680237 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2c2b35ce-aafe-4c1d-ae07-f184193233e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:48.681001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2c2b35ce-aafe-4c1d-ae07-f184193233e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:48.693097 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c2b35ce-aafe-4c1d-ae07-f184193233e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:48.694796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c2b35ce-aafe-4c1d-ae07-f184193233e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:48.696453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c2b35ce-aafe-4c1d-ae07-f184193233e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:48.697437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c2b35ce-aafe-4c1d-ae07-f184193233e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:48.898482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2c2b35ce-aafe-4c1d-ae07-f184193233e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:48.908040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2c2b35ce-aafe-4c1d-ae07-f184193233e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.236866 Apr 07 12:57:48.909203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 119/236] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:48 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:49.925317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d37c9af3-fc96-4e64-bd08-ad5fee8b0057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:49.925998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d37c9af3-fc96-4e64-bd08-ad5fee8b0057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:49.936275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d37c9af3-fc96-4e64-bd08-ad5fee8b0057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:49.936732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d37c9af3-fc96-4e64-bd08-ad5fee8b0057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:49.937548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d37c9af3-fc96-4e64-bd08-ad5fee8b0057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:49.937987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d37c9af3-fc96-4e64-bd08-ad5fee8b0057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:50.019820 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ac470f02-4040-4cc5-9745-7b016d607086 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:50.020381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ac470f02-4040-4cc5-9745-7b016d607086 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:50.028040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ac470f02-4040-4cc5-9745-7b016d607086 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:50.028538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ac470f02-4040-4cc5-9745-7b016d607086 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:50.029360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ac470f02-4040-4cc5-9745-7b016d607086 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:50.029825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ac470f02-4040-4cc5-9745-7b016d607086 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:50.073176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ac470f02-4040-4cc5-9745-7b016d607086 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/ips" status: 200 len: 146 microversion: 2.1 time: 0.058104 Apr 07 12:57:50.080313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 120/237] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Apr 7 12:57:50 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/ips => generated 146 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:57:50.115129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d37c9af3-fc96-4e64-bd08-ad5fee8b0057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:50.124677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d37c9af3-fc96-4e64-bd08-ad5fee8b0057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.203236 Apr 07 12:57:50.125698 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 118/238] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:49 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:51.142741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1b5dd7e8-ab8b-4720-aed4-d38566438b57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:51.143356 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1b5dd7e8-ab8b-4720-aed4-d38566438b57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:51.149208 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b5dd7e8-ab8b-4720-aed4-d38566438b57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:51.149662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b5dd7e8-ab8b-4720-aed4-d38566438b57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:51.150566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b5dd7e8-ab8b-4720-aed4-d38566438b57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:51.151007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b5dd7e8-ab8b-4720-aed4-d38566438b57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:51.301560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1b5dd7e8-ab8b-4720-aed4-d38566438b57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:51.309922 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1b5dd7e8-ab8b-4720-aed4-d38566438b57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.171003 Apr 07 12:57:51.310694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 121/239] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:51 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:52.327782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-192caddb-de54-43d2-b9d1-4920a5ff57f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:52.328415 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-192caddb-de54-43d2-b9d1-4920a5ff57f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:52.336586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-192caddb-de54-43d2-b9d1-4920a5ff57f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:52.337033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-192caddb-de54-43d2-b9d1-4920a5ff57f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:52.337793 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-192caddb-de54-43d2-b9d1-4920a5ff57f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:52.338253 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-192caddb-de54-43d2-b9d1-4920a5ff57f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:52.474359 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-192caddb-de54-43d2-b9d1-4920a5ff57f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:52.481661 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-192caddb-de54-43d2-b9d1-4920a5ff57f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.158563 Apr 07 12:57:52.482220 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 119/240] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:52 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:52.968383 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fbed6bcb-1e42-4a65-b451-ee28501ce81d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:52.968882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fbed6bcb-1e42-4a65-b451-ee28501ce81d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:52.975552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fbed6bcb-1e42-4a65-b451-ee28501ce81d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:52.976005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fbed6bcb-1e42-4a65-b451-ee28501ce81d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:52.976948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fbed6bcb-1e42-4a65-b451-ee28501ce81d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:52.977427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fbed6bcb-1e42-4a65-b451-ee28501ce81d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:53.002941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fbed6bcb-1e42-4a65-b451-ee28501ce81d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/ips" status: 200 len: 151 microversion: 2.20 time: 0.038325 Apr 07 12:57:53.003510 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 122/241] 10.222.0.15 () {60 vars in 1288 bytes} [Thu Apr 7 12:57:52 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:57:53.499358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-38026f4c-47a1-445d-9547-234b658d02d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:53.500128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-38026f4c-47a1-445d-9547-234b658d02d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:53.513578 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38026f4c-47a1-445d-9547-234b658d02d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:53.514226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38026f4c-47a1-445d-9547-234b658d02d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:53.515192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38026f4c-47a1-445d-9547-234b658d02d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:53.515624 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38026f4c-47a1-445d-9547-234b658d02d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:53.701359 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-38026f4c-47a1-445d-9547-234b658d02d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:53.709918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-38026f4c-47a1-445d-9547-234b658d02d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.215178 Apr 07 12:57:53.721059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 120/242] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:53 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:54.733350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0c7b188b-7582-477f-9fbf-aea60a1cc451 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:54.733977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0c7b188b-7582-477f-9fbf-aea60a1cc451 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:54.741594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c7b188b-7582-477f-9fbf-aea60a1cc451 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:54.742050 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c7b188b-7582-477f-9fbf-aea60a1cc451 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:54.745878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c7b188b-7582-477f-9fbf-aea60a1cc451 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:54.746665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c7b188b-7582-477f-9fbf-aea60a1cc451 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:54.903392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c14befde-ac8b-4989-b387-75fba7d8cf2b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83191d90-351c-40aa-8bf7-e460aeec0a7c"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:57:54.904474 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c14befde-ac8b-4989-b387-75fba7d8cf2b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:54.916998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c14befde-ac8b-4989-b387-75fba7d8cf2b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:54.917861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c14befde-ac8b-4989-b387-75fba7d8cf2b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:54.919894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c14befde-ac8b-4989-b387-75fba7d8cf2b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:54.920514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c14befde-ac8b-4989-b387-75fba7d8cf2b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:54.952435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0c7b188b-7582-477f-9fbf-aea60a1cc451 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:54.961771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0c7b188b-7582-477f-9fbf-aea60a1cc451 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.232165 Apr 07 12:57:54.962531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 123/243] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:54 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:55.226837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f7535e3d-1013-4a1d-8ea1-ef0163c567d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:57:55.228052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f7535e3d-1013-4a1d-8ea1-ef0163c567d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:55.238390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7535e3d-1013-4a1d-8ea1-ef0163c567d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:55.238907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7535e3d-1013-4a1d-8ea1-ef0163c567d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:55.239691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7535e3d-1013-4a1d-8ea1-ef0163c567d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:55.240510 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7535e3d-1013-4a1d-8ea1-ef0163c567d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:55.259574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c14befde-ac8b-4989-b387-75fba7d8cf2b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "POST /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360338 Apr 07 12:57:55.267274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 121/244] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Apr 7 12:57:54 2022] POST /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 12:57:55.281203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-f7535e3d-1013-4a1d-8ea1-ef0163c567d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lazy-loading 'flavor' on Instance uuid 58c9a464-496a-4aa9-80dd-f9ec66f515ae {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 12:57:55.979560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d34e9e6a-f712-419e-a4c8-b6dcfed08369 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:55.980275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d34e9e6a-f712-419e-a4c8-b6dcfed08369 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:55.987850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d34e9e6a-f712-419e-a4c8-b6dcfed08369 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:55.988773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d34e9e6a-f712-419e-a4c8-b6dcfed08369 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:55.989545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d34e9e6a-f712-419e-a4c8-b6dcfed08369 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:55.990021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d34e9e6a-f712-419e-a4c8-b6dcfed08369 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:56.135565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d34e9e6a-f712-419e-a4c8-b6dcfed08369 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:56.145517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d34e9e6a-f712-419e-a4c8-b6dcfed08369 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.169888 Apr 07 12:57:56.146371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 122/245] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:55 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:57:57.163396 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d01de0ff-a268-4dd7-b50c-b4802eecc911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:57.164278 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d01de0ff-a268-4dd7-b50c-b4802eecc911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:57.170681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d01de0ff-a268-4dd7-b50c-b4802eecc911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:57.171418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d01de0ff-a268-4dd7-b50c-b4802eecc911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:57.172322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d01de0ff-a268-4dd7-b50c-b4802eecc911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:57.172970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d01de0ff-a268-4dd7-b50c-b4802eecc911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:57.617214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d01de0ff-a268-4dd7-b50c-b4802eecc911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:57.624909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d01de0ff-a268-4dd7-b50c-b4802eecc911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.466093 Apr 07 12:57:57.625476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 123/246] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:57 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:57:57.785564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f7535e3d-1013-4a1d-8ea1-ef0163c567d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "POST /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/action" status: 202 len: 0 microversion: 2.20 time: 2.565102 Apr 07 12:57:57.791337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 124/247] 10.222.0.15 () {62 vars in 1318 bytes} [Thu Apr 7 12:57:55 2022] POST /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/action => generated 0 bytes in 2572 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 07 12:57:57.796344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d126e477-55d2-4db1-827c-01632f1d2b9c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:57.797240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d126e477-55d2-4db1-827c-01632f1d2b9c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:57.805865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d126e477-55d2-4db1-827c-01632f1d2b9c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:57.814606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d126e477-55d2-4db1-827c-01632f1d2b9c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:57.816093 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d126e477-55d2-4db1-827c-01632f1d2b9c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:57.816602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d126e477-55d2-4db1-827c-01632f1d2b9c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:58.150874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d126e477-55d2-4db1-827c-01632f1d2b9c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:58.184711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d126e477-55d2-4db1-827c-01632f1d2b9c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:58.191999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d126e477-55d2-4db1-827c-01632f1d2b9c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:58.195399 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d126e477-55d2-4db1-827c-01632f1d2b9c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.402970 Apr 07 12:57:58.196630 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 124/248] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:57:57 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:57:58.642705 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4a2c9d63-3e49-43b8-a732-c4b0be266c14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:58.644381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4a2c9d63-3e49-43b8-a732-c4b0be266c14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:58.652820 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a2c9d63-3e49-43b8-a732-c4b0be266c14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:58.653527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a2c9d63-3e49-43b8-a732-c4b0be266c14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:58.654552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a2c9d63-3e49-43b8-a732-c4b0be266c14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:58.655726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a2c9d63-3e49-43b8-a732-c4b0be266c14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:58.812647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4a2c9d63-3e49-43b8-a732-c4b0be266c14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:58.821756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4a2c9d63-3e49-43b8-a732-c4b0be266c14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.183443 Apr 07 12:57:58.822774 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 125/249] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:58 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:57:59.214901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a06662cb-0a7b-456e-ad93-358a057e2ac9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:59.215519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a06662cb-0a7b-456e-ad93-358a057e2ac9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:59.223380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a06662cb-0a7b-456e-ad93-358a057e2ac9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:59.223753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a06662cb-0a7b-456e-ad93-358a057e2ac9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:59.224561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a06662cb-0a7b-456e-ad93-358a057e2ac9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:59.224999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a06662cb-0a7b-456e-ad93-358a057e2ac9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:59.428938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a06662cb-0a7b-456e-ad93-358a057e2ac9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:59.439232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a06662cb-0a7b-456e-ad93-358a057e2ac9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:59.441301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a06662cb-0a7b-456e-ad93-358a057e2ac9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:57:59.442648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a06662cb-0a7b-456e-ad93-358a057e2ac9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.231704 Apr 07 12:57:59.443847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 125/250] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:57:59 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:57:59.842737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2dd035aa-d464-4949-b524-a6f8d560091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:57:59.843945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2dd035aa-d464-4949-b524-a6f8d560091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:57:59.862910 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2dd035aa-d464-4949-b524-a6f8d560091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:59.863748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2dd035aa-d464-4949-b524-a6f8d560091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:57:59.868844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2dd035aa-d464-4949-b524-a6f8d560091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:57:59.869640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2dd035aa-d464-4949-b524-a6f8d560091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:00.105692 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2dd035aa-d464-4949-b524-a6f8d560091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:00.116819 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2dd035aa-d464-4949-b524-a6f8d560091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.280274 Apr 07 12:58:00.128616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 126/251] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:57:59 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:00.463240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-961078f1-d326-444a-a54a-7880812b9585 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:00.463736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-961078f1-d326-444a-a54a-7880812b9585 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:00.479045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-961078f1-d326-444a-a54a-7880812b9585 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:00.484771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-961078f1-d326-444a-a54a-7880812b9585 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:00.485814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-961078f1-d326-444a-a54a-7880812b9585 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:00.487341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-961078f1-d326-444a-a54a-7880812b9585 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:00.739013 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-961078f1-d326-444a-a54a-7880812b9585 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:00.757497 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-961078f1-d326-444a-a54a-7880812b9585 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:00.758723 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-961078f1-d326-444a-a54a-7880812b9585 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:00.760102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-961078f1-d326-444a-a54a-7880812b9585 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.301262 Apr 07 12:58:00.760831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 126/252] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:00 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:01.141194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-37b8fa44-8b5d-4b1c-86a3-e98535407847 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:01.141666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-37b8fa44-8b5d-4b1c-86a3-e98535407847 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:01.165945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-37b8fa44-8b5d-4b1c-86a3-e98535407847 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:01.170317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-37b8fa44-8b5d-4b1c-86a3-e98535407847 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:01.171171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-37b8fa44-8b5d-4b1c-86a3-e98535407847 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:01.171627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-37b8fa44-8b5d-4b1c-86a3-e98535407847 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:01.781885 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bdb0d214-de81-4a4e-86b0-f04f37987d36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:01.782509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bdb0d214-de81-4a4e-86b0-f04f37987d36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:01.796058 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bdb0d214-de81-4a4e-86b0-f04f37987d36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:01.796785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bdb0d214-de81-4a4e-86b0-f04f37987d36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:01.809534 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bdb0d214-de81-4a4e-86b0-f04f37987d36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:01.810735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bdb0d214-de81-4a4e-86b0-f04f37987d36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:01.901627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-37b8fa44-8b5d-4b1c-86a3-e98535407847 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:01.911204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-37b8fa44-8b5d-4b1c-86a3-e98535407847 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1500 microversion: 2.1 time: 0.780065 Apr 07 12:58:01.912456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 127/253] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:01 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1500 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:01.941606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-18b24a42-1d41-48be-856a-65845719c043 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "289813fb-ef03-426e-9e03-463bab880575"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:01.944828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-18b24a42-1d41-48be-856a-65845719c043 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:01.957412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-18b24a42-1d41-48be-856a-65845719c043 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:01.958204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-18b24a42-1d41-48be-856a-65845719c043 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:01.959139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-18b24a42-1d41-48be-856a-65845719c043 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:01.959676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-18b24a42-1d41-48be-856a-65845719c043 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:01.987587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-18b24a42-1d41-48be-856a-65845719c043 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] HTTP exception thrown: Cannot 'attach_volume' instance a9feccee-a82e-4fcb-9293-a464dc5601cc while it is in vm_state rescued Apr 07 12:58:01.988272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-18b24a42-1d41-48be-856a-65845719c043 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Returning 409 to user: Cannot 'attach_volume' instance a9feccee-a82e-4fcb-9293-a464dc5601cc while it is in vm_state rescued {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 12:58:01.989249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-18b24a42-1d41-48be-856a-65845719c043 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "POST /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059047 Apr 07 12:58:01.990688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 128/254] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Apr 7 12:58:01 2022] POST /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc/os-volume_attachments => generated 152 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 07 12:58:02.000308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-aa0042f5-ee98-4084-a7c1-ae186c4f3839 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:02.001093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-aa0042f5-ee98-4084-a7c1-ae186c4f3839 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:02.008286 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aa0042f5-ee98-4084-a7c1-ae186c4f3839 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:02.008745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aa0042f5-ee98-4084-a7c1-ae186c4f3839 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:02.009669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aa0042f5-ee98-4084-a7c1-ae186c4f3839 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:02.010111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aa0042f5-ee98-4084-a7c1-ae186c4f3839 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:02.120258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bdb0d214-de81-4a4e-86b0-f04f37987d36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:02.133833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bdb0d214-de81-4a4e-86b0-f04f37987d36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:02.137923 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bdb0d214-de81-4a4e-86b0-f04f37987d36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:02.139790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bdb0d214-de81-4a4e-86b0-f04f37987d36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.362443 Apr 07 12:58:02.140907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 127/255] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:01 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:02.149035 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-aa0042f5-ee98-4084-a7c1-ae186c4f3839 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "POST /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc/action" status: 202 len: 0 microversion: 2.1 time: 0.153871 Apr 07 12:58:02.152518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 129/256] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 12:58:01 2022] POST /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 12:58:02.163934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f99e5797-3e5e-4ec5-ab05-5b89e2199e13 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:02.164617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f99e5797-3e5e-4ec5-ab05-5b89e2199e13 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:02.170820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f99e5797-3e5e-4ec5-ab05-5b89e2199e13 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:02.171542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f99e5797-3e5e-4ec5-ab05-5b89e2199e13 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:02.172567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f99e5797-3e5e-4ec5-ab05-5b89e2199e13 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:02.173201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f99e5797-3e5e-4ec5-ab05-5b89e2199e13 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:02.926285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f99e5797-3e5e-4ec5-ab05-5b89e2199e13 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:02.938279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f99e5797-3e5e-4ec5-ab05-5b89e2199e13 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1508 microversion: 2.1 time: 0.778226 Apr 07 12:58:02.942088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 128/257] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:02 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1508 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:02.982222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b1d61b27-47f9-4fb4-8c46-7b18574e8952 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:02.996715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b1d61b27-47f9-4fb4-8c46-7b18574e8952 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:02.997161 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b1d61b27-47f9-4fb4-8c46-7b18574e8952 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:03.096391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b1d61b27-47f9-4fb4-8c46-7b18574e8952 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Going to try to stop instance {{(pid=116893) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 07 12:58:03.162227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-54d61ce7-4874-4db1-b437-95efc13e711d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:03.162850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-54d61ce7-4874-4db1-b437-95efc13e711d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:03.167868 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b1d61b27-47f9-4fb4-8c46-7b18574e8952 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "POST /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/action" status: 202 len: 0 microversion: 2.1 time: 0.198380 Apr 07 12:58:03.168531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 130/258] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 12:58:02 2022] POST /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 12:58:03.176000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-54d61ce7-4874-4db1-b437-95efc13e711d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:03.176501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-54d61ce7-4874-4db1-b437-95efc13e711d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:03.178835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-54d61ce7-4874-4db1-b437-95efc13e711d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:03.179262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-54d61ce7-4874-4db1-b437-95efc13e711d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:03.186238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4bf48dc5-b112-4b16-a834-0974c3e9a5c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:03.190642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4bf48dc5-b112-4b16-a834-0974c3e9a5c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:03.206131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4bf48dc5-b112-4b16-a834-0974c3e9a5c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:03.206874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4bf48dc5-b112-4b16-a834-0974c3e9a5c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:03.208103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4bf48dc5-b112-4b16-a834-0974c3e9a5c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:03.208792 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4bf48dc5-b112-4b16-a834-0974c3e9a5c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:03.495638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4bf48dc5-b112-4b16-a834-0974c3e9a5c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:03.499060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-54d61ce7-4874-4db1-b437-95efc13e711d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:03.532012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4bf48dc5-b112-4b16-a834-0974c3e9a5c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.358565 Apr 07 12:58:03.537221 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 131/259] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:03 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:03.539487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-54d61ce7-4874-4db1-b437-95efc13e711d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:03.541501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-54d61ce7-4874-4db1-b437-95efc13e711d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:03.544909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-54d61ce7-4874-4db1-b437-95efc13e711d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.388820 Apr 07 12:58:03.558647 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 129/260] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:03 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:03.959358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-55d00d6c-0292-4be4-906d-b316aa9c73c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:03.960541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-55d00d6c-0292-4be4-906d-b316aa9c73c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:03.968746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55d00d6c-0292-4be4-906d-b316aa9c73c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:03.971573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55d00d6c-0292-4be4-906d-b316aa9c73c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:03.974320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55d00d6c-0292-4be4-906d-b316aa9c73c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:03.974708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55d00d6c-0292-4be4-906d-b316aa9c73c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:04.358825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-55d00d6c-0292-4be4-906d-b316aa9c73c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:04.366484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-55d00d6c-0292-4be4-906d-b316aa9c73c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1508 microversion: 2.1 time: 0.411572 Apr 07 12:58:04.379515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 132/261] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:03 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:04.556445 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-505284f8-0417-4db1-8598-9ed0c3b550bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:04.557696 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-505284f8-0417-4db1-8598-9ed0c3b550bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:04.565518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e1992ff5-e71f-40c3-9ff7-281e205775ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:04.566161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-505284f8-0417-4db1-8598-9ed0c3b550bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:04.566274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e1992ff5-e71f-40c3-9ff7-281e205775ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:04.566622 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-505284f8-0417-4db1-8598-9ed0c3b550bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:04.567395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-505284f8-0417-4db1-8598-9ed0c3b550bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:04.568252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-505284f8-0417-4db1-8598-9ed0c3b550bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:04.573109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e1992ff5-e71f-40c3-9ff7-281e205775ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:04.573566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e1992ff5-e71f-40c3-9ff7-281e205775ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:04.578414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e1992ff5-e71f-40c3-9ff7-281e205775ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:04.578919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e1992ff5-e71f-40c3-9ff7-281e205775ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:04.812473 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-505284f8-0417-4db1-8598-9ed0c3b550bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:04.829074 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-505284f8-0417-4db1-8598-9ed0c3b550bf tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.277313 Apr 07 12:58:04.829662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 130/262] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:04 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:04.988781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e1992ff5-e71f-40c3-9ff7-281e205775ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:05.002967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e1992ff5-e71f-40c3-9ff7-281e205775ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:05.004522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e1992ff5-e71f-40c3-9ff7-281e205775ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:05.005708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e1992ff5-e71f-40c3-9ff7-281e205775ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.444935 Apr 07 12:58:05.006276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 133/263] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:04 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:58:05.386980 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f2ae70b3-b3db-45f5-9b16-c4aa3f1c523e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:05.388946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f2ae70b3-b3db-45f5-9b16-c4aa3f1c523e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:05.398834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f2ae70b3-b3db-45f5-9b16-c4aa3f1c523e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:05.399288 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f2ae70b3-b3db-45f5-9b16-c4aa3f1c523e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:05.400384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f2ae70b3-b3db-45f5-9b16-c4aa3f1c523e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:05.401021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f2ae70b3-b3db-45f5-9b16-c4aa3f1c523e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:05.723008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f2ae70b3-b3db-45f5-9b16-c4aa3f1c523e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:05.731792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f2ae70b3-b3db-45f5-9b16-c4aa3f1c523e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1508 microversion: 2.1 time: 0.351785 Apr 07 12:58:05.735007 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 131/264] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:05 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:05.851047 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-404d6733-883a-4652-a578-cb105e20b0de tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:05.853034 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-404d6733-883a-4652-a578-cb105e20b0de tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:05.866705 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-404d6733-883a-4652-a578-cb105e20b0de tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:05.867194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-404d6733-883a-4652-a578-cb105e20b0de tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:05.868793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-404d6733-883a-4652-a578-cb105e20b0de tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:05.873577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-404d6733-883a-4652-a578-cb105e20b0de tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:06.025119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-78ba27a7-9c1f-4e30-bb4f-9e0a990aef68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:06.026090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-78ba27a7-9c1f-4e30-bb4f-9e0a990aef68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:06.037495 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-78ba27a7-9c1f-4e30-bb4f-9e0a990aef68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:06.042858 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-78ba27a7-9c1f-4e30-bb4f-9e0a990aef68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:06.043945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-78ba27a7-9c1f-4e30-bb4f-9e0a990aef68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:06.044577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-78ba27a7-9c1f-4e30-bb4f-9e0a990aef68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:06.325861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-78ba27a7-9c1f-4e30-bb4f-9e0a990aef68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:06.338434 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-78ba27a7-9c1f-4e30-bb4f-9e0a990aef68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:06.340086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-78ba27a7-9c1f-4e30-bb4f-9e0a990aef68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:06.341447 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-78ba27a7-9c1f-4e30-bb4f-9e0a990aef68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.320409 Apr 07 12:58:06.353464 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-404d6733-883a-4652-a578-cb105e20b0de tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:06.359632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 132/265] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:06 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:06.375176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-404d6733-883a-4652-a578-cb105e20b0de tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.530684 Apr 07 12:58:06.380790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 134/266] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:05 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:06.751755 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b17c7524-7753-43ba-8038-d9678c608fd7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:06.753843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b17c7524-7753-43ba-8038-d9678c608fd7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:06.770421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b17c7524-7753-43ba-8038-d9678c608fd7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:06.771737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b17c7524-7753-43ba-8038-d9678c608fd7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:06.773049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b17c7524-7753-43ba-8038-d9678c608fd7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:06.773769 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b17c7524-7753-43ba-8038-d9678c608fd7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:07.183677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b17c7524-7753-43ba-8038-d9678c608fd7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:07.199590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b17c7524-7753-43ba-8038-d9678c608fd7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1514 microversion: 2.1 time: 0.452442 Apr 07 12:58:07.200774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 133/267] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:06 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1514 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:07.368322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2f11bd13-91e6-4582-b1af-085891938702 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:07.369757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2f11bd13-91e6-4582-b1af-085891938702 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:07.383979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f11bd13-91e6-4582-b1af-085891938702 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:07.384471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f11bd13-91e6-4582-b1af-085891938702 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:07.385260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f11bd13-91e6-4582-b1af-085891938702 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:07.389919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f11bd13-91e6-4582-b1af-085891938702 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:07.397613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2a32c30d-ed7d-4184-9670-5f76c5f346db tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:07.398643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2a32c30d-ed7d-4184-9670-5f76c5f346db tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:07.409444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a32c30d-ed7d-4184-9670-5f76c5f346db tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:07.410298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a32c30d-ed7d-4184-9670-5f76c5f346db tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:07.412246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a32c30d-ed7d-4184-9670-5f76c5f346db tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:07.418778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a32c30d-ed7d-4184-9670-5f76c5f346db tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:07.831568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2f11bd13-91e6-4582-b1af-085891938702 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:07.844458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2f11bd13-91e6-4582-b1af-085891938702 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:07.849262 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2f11bd13-91e6-4582-b1af-085891938702 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:07.852660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2f11bd13-91e6-4582-b1af-085891938702 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.491435 Apr 07 12:58:07.855947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 135/268] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:07 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:08.159232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2a32c30d-ed7d-4184-9670-5f76c5f346db tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:08.185940 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2a32c30d-ed7d-4184-9670-5f76c5f346db tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.793484 Apr 07 12:58:08.186779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 134/269] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:07 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:08.879736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-39122496-a85e-40fe-8adf-c381de0e2eb4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:08.880572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-39122496-a85e-40fe-8adf-c381de0e2eb4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:08.891380 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39122496-a85e-40fe-8adf-c381de0e2eb4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:08.894009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39122496-a85e-40fe-8adf-c381de0e2eb4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:08.895323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39122496-a85e-40fe-8adf-c381de0e2eb4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:08.896103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39122496-a85e-40fe-8adf-c381de0e2eb4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:09.133794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-39122496-a85e-40fe-8adf-c381de0e2eb4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:09.143695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-39122496-a85e-40fe-8adf-c381de0e2eb4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:09.145082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-39122496-a85e-40fe-8adf-c381de0e2eb4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:09.146363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-39122496-a85e-40fe-8adf-c381de0e2eb4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.276127 Apr 07 12:58:09.147003 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 136/270] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:08 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:09.205820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-65933cfb-8e7d-46af-8057-59d94557c313 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:09.206591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-65933cfb-8e7d-46af-8057-59d94557c313 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:09.213576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-65933cfb-8e7d-46af-8057-59d94557c313 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:09.214137 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-65933cfb-8e7d-46af-8057-59d94557c313 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:09.215128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-65933cfb-8e7d-46af-8057-59d94557c313 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:09.215668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-65933cfb-8e7d-46af-8057-59d94557c313 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:09.484392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-65933cfb-8e7d-46af-8057-59d94557c313 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:09.495807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-65933cfb-8e7d-46af-8057-59d94557c313 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.295870 Apr 07 12:58:09.507437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 135/271] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:09 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:10.165775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-865d9787-471d-4f66-9cd1-4c0071b7427c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:10.166799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-865d9787-471d-4f66-9cd1-4c0071b7427c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:10.184044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-865d9787-471d-4f66-9cd1-4c0071b7427c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:10.184719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-865d9787-471d-4f66-9cd1-4c0071b7427c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:10.185684 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-865d9787-471d-4f66-9cd1-4c0071b7427c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:10.186333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-865d9787-471d-4f66-9cd1-4c0071b7427c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:10.364985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-865d9787-471d-4f66-9cd1-4c0071b7427c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:10.389801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-865d9787-471d-4f66-9cd1-4c0071b7427c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:10.393624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-865d9787-471d-4f66-9cd1-4c0071b7427c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:10.395697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-865d9787-471d-4f66-9cd1-4c0071b7427c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.233165 Apr 07 12:58:10.406449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 137/272] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:10 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:10.518248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ac7e3a89-4ce0-40a6-aef7-5232e3b615f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:10.519260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ac7e3a89-4ce0-40a6-aef7-5232e3b615f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:10.525577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac7e3a89-4ce0-40a6-aef7-5232e3b615f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:10.526292 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac7e3a89-4ce0-40a6-aef7-5232e3b615f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:10.527100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac7e3a89-4ce0-40a6-aef7-5232e3b615f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:10.527535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac7e3a89-4ce0-40a6-aef7-5232e3b615f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:10.914844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ac7e3a89-4ce0-40a6-aef7-5232e3b615f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:10.926335 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ac7e3a89-4ce0-40a6-aef7-5232e3b615f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.412620 Apr 07 12:58:10.929652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 136/273] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:10 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:11.109840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ea8446e2-d02c-4b85-9f9f-88b2a33b423d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Action: 'create', calling method: .version_select at 0x7fde5869a1f0>, body: {"keypair": {"name": "tempest-keypair-1819205429"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:11.172469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-ea8446e2-d02c-4b85-9f9f-88b2a33b423d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Getting quotas for project 551ec87d1b5e4245aa75e1990d2f3139. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:58:11.180690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-ea8446e2-d02c-4b85-9f9f-88b2a33b423d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Getting quotas for user 8802ee1876204b2c85b9e54ec50d30f1 and project 551ec87d1b5e4245aa75e1990d2f3139. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:58:11.415862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0a6097e8-fe7a-4245-b236-5310404fbfeb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:11.416463 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0a6097e8-fe7a-4245-b236-5310404fbfeb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:11.443411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a6097e8-fe7a-4245-b236-5310404fbfeb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:11.443882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a6097e8-fe7a-4245-b236-5310404fbfeb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:11.444696 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a6097e8-fe7a-4245-b236-5310404fbfeb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:11.447442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a6097e8-fe7a-4245-b236-5310404fbfeb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:11.449539 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-ea8446e2-d02c-4b85-9f9f-88b2a33b423d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Getting quotas for project 551ec87d1b5e4245aa75e1990d2f3139. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:58:11.454108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-ea8446e2-d02c-4b85-9f9f-88b2a33b423d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Getting quotas for user 8802ee1876204b2c85b9e54ec50d30f1 and project 551ec87d1b5e4245aa75e1990d2f3139. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:58:11.481936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ea8446e2-d02c-4b85-9f9f-88b2a33b423d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.389643 Apr 07 12:58:11.487335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 138/274] 10.222.0.15 () {60 vars in 1157 bytes} [Thu Apr 7 12:58:11 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:11.749027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0a6097e8-fe7a-4245-b236-5310404fbfeb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:11.761461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0a6097e8-fe7a-4245-b236-5310404fbfeb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:11.765641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0a6097e8-fe7a-4245-b236-5310404fbfeb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:11.767178 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0a6097e8-fe7a-4245-b236-5310404fbfeb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.355325 Apr 07 12:58:11.769955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 137/275] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:11 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:11.949333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b3521087-07ba-4910-a24d-e1c2ed8f03f7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:11.950114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b3521087-07ba-4910-a24d-e1c2ed8f03f7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:11.965268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3521087-07ba-4910-a24d-e1c2ed8f03f7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:11.967526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3521087-07ba-4910-a24d-e1c2ed8f03f7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:11.968668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3521087-07ba-4910-a24d-e1c2ed8f03f7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:11.969384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3521087-07ba-4910-a24d-e1c2ed8f03f7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:12.167163 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b3521087-07ba-4910-a24d-e1c2ed8f03f7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:12.194768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b3521087-07ba-4910-a24d-e1c2ed8f03f7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.240791 Apr 07 12:58:12.197376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 139/276] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:11 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:12.788683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5b2efaca-ff49-4fb6-9fb6-941aedffafdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:12.789298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5b2efaca-ff49-4fb6-9fb6-941aedffafdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:12.806316 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b2efaca-ff49-4fb6-9fb6-941aedffafdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:12.807082 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b2efaca-ff49-4fb6-9fb6-941aedffafdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:12.808059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b2efaca-ff49-4fb6-9fb6-941aedffafdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:12.808691 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b2efaca-ff49-4fb6-9fb6-941aedffafdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:13.213155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ae3255a1-1207-4d1e-bd36-50cb1d6f2e22 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:13.213812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ae3255a1-1207-4d1e-bd36-50cb1d6f2e22 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:13.240218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae3255a1-1207-4d1e-bd36-50cb1d6f2e22 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:13.241312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae3255a1-1207-4d1e-bd36-50cb1d6f2e22 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:13.242372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae3255a1-1207-4d1e-bd36-50cb1d6f2e22 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:13.243918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae3255a1-1207-4d1e-bd36-50cb1d6f2e22 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:13.287127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5b2efaca-ff49-4fb6-9fb6-941aedffafdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:13.303767 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5b2efaca-ff49-4fb6-9fb6-941aedffafdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:13.308523 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5b2efaca-ff49-4fb6-9fb6-941aedffafdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:13.313171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5b2efaca-ff49-4fb6-9fb6-941aedffafdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.528303 Apr 07 12:58:13.318530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 138/277] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:12 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:13.499056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ae3255a1-1207-4d1e-bd36-50cb1d6f2e22 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:13.514131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ae3255a1-1207-4d1e-bd36-50cb1d6f2e22 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.304270 Apr 07 12:58:13.516795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 140/278] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:13 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:14.289074 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-612703037", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02be5230-dc72-46d8-8183-35a63cb29776"}], "security_groups": [{"name": "tempest-securitygroup--1216516252"}], "key_name": "tempest-keypair-1819205429", "user_data": "}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:14.337584 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-40c65c61-1452-49d3-beac-5ec7e5fe271a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:14.338210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-40c65c61-1452-49d3-beac-5ec7e5fe271a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:14.344997 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40c65c61-1452-49d3-beac-5ec7e5fe271a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:14.346299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40c65c61-1452-49d3-beac-5ec7e5fe271a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:14.347920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40c65c61-1452-49d3-beac-5ec7e5fe271a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:14.348675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40c65c61-1452-49d3-beac-5ec7e5fe271a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:14.609304 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-40c65c61-1452-49d3-beac-5ec7e5fe271a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:14.621343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-40c65c61-1452-49d3-beac-5ec7e5fe271a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:14.623918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-40c65c61-1452-49d3-beac-5ec7e5fe271a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:14.625500 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-40c65c61-1452-49d3-beac-5ec7e5fe271a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.292401 Apr 07 12:58:14.627351 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 141/279] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:14 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:14.652959 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0e316158-322a-4ad2-bba2-de563768ea7b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:14.653712 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0e316158-322a-4ad2-bba2-de563768ea7b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:14.663034 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0e316158-322a-4ad2-bba2-de563768ea7b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:14.663628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0e316158-322a-4ad2-bba2-de563768ea7b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:14.664700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0e316158-322a-4ad2-bba2-de563768ea7b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:14.665351 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0e316158-322a-4ad2-bba2-de563768ea7b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:14.866971 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0e316158-322a-4ad2-bba2-de563768ea7b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:14.884821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0e316158-322a-4ad2-bba2-de563768ea7b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.255320 Apr 07 12:58:14.887320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 142/280] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:14 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:15.654038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-dc9e46cf-0728-40a2-a3e4-80c93877d726 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:15.657177 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-dc9e46cf-0728-40a2-a3e4-80c93877d726 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:15.676320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dc9e46cf-0728-40a2-a3e4-80c93877d726 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:15.677571 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dc9e46cf-0728-40a2-a3e4-80c93877d726 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:15.680326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dc9e46cf-0728-40a2-a3e4-80c93877d726 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:15.681860 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dc9e46cf-0728-40a2-a3e4-80c93877d726 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:15.905958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-dc9e46cf-0728-40a2-a3e4-80c93877d726 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:15.940255 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-dc9e46cf-0728-40a2-a3e4-80c93877d726 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:15.951060 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-dc9e46cf-0728-40a2-a3e4-80c93877d726 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:15.957664 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-dc9e46cf-0728-40a2-a3e4-80c93877d726 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1723 microversion: 2.20 time: 0.315240 Apr 07 12:58:15.959132 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 143/281] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:15 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:15.977935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-40c303d1-a4e7-4905-85c9-c31b24081aa6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:15.979527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-40c303d1-a4e7-4905-85c9-c31b24081aa6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:15.986874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40c303d1-a4e7-4905-85c9-c31b24081aa6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:15.987330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40c303d1-a4e7-4905-85c9-c31b24081aa6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:15.988160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40c303d1-a4e7-4905-85c9-c31b24081aa6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:15.988623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40c303d1-a4e7-4905-85c9-c31b24081aa6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:16.182821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-40c303d1-a4e7-4905-85c9-c31b24081aa6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:16.191260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-40c303d1-a4e7-4905-85c9-c31b24081aa6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.230407 Apr 07 12:58:16.192089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 144/282] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:15 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:16.248676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.network.neutron [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] validate_networks() for [('02be5230-dc72-46d8-8183-35a63cb29776', None, None, None, None, None)] {{(pid=116892) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 12:58:16.943746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Flavor limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 12:58:16.944194 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Image limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 12:58:16.944809 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Flavor pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 12:58:16.945110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Image pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 12:58:16.945485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 12:58:16.958683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:16.959286 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:16.959951 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:16.960409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:16.990760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-36ec9884-594a-46ac-b66a-0ac2c02e4185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:16.991435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-36ec9884-594a-46ac-b66a-0ac2c02e4185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:17.001626 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36ec9884-594a-46ac-b66a-0ac2c02e4185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:17.003872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36ec9884-594a-46ac-b66a-0ac2c02e4185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:17.007203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Getting quotas for project 551ec87d1b5e4245aa75e1990d2f3139. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:58:17.007792 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36ec9884-594a-46ac-b66a-0ac2c02e4185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:17.008616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36ec9884-594a-46ac-b66a-0ac2c02e4185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:17.021017 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Getting quotas for user 8802ee1876204b2c85b9e54ec50d30f1 and project 551ec87d1b5e4245aa75e1990d2f3139. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:58:17.050426 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Going to run 1 instances... {{(pid=116892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 12:58:17.053788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 12:58:17.144567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f1694bcb-3ae5-44df-916c-c567662888cf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.861345 Apr 07 12:58:17.153438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 139/283] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 12:58:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 2871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 07 12:58:17.166159 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-10eb2927-4fa2-479a-bceb-33524082ca48 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:17.170361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-10eb2927-4fa2-479a-bceb-33524082ca48 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:17.254687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-10eb2927-4fa2-479a-bceb-33524082ca48 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:17.262679 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-10eb2927-4fa2-479a-bceb-33524082ca48 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1245 microversion: 2.1 time: 0.105968 Apr 07 12:58:17.263485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 140/284] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:17 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:17.270919 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-298d72b4-4f56-476c-beb0-0bb685fde6dc tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:17.272816 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-298d72b4-4f56-476c-beb0-0bb685fde6dc tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:17.284057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-298d72b4-4f56-476c-beb0-0bb685fde6dc tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:17.284779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-298d72b4-4f56-476c-beb0-0bb685fde6dc tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:17.286736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-298d72b4-4f56-476c-beb0-0bb685fde6dc tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:17.287460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-298d72b4-4f56-476c-beb0-0bb685fde6dc tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:17.461466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-36ec9884-594a-46ac-b66a-0ac2c02e4185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:17.474407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-36ec9884-594a-46ac-b66a-0ac2c02e4185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:17.480077 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-36ec9884-594a-46ac-b66a-0ac2c02e4185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:17.483970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-36ec9884-594a-46ac-b66a-0ac2c02e4185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1744 microversion: 2.20 time: 0.496342 Apr 07 12:58:17.485779 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 145/285] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:16 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1744 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:17.770257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-298d72b4-4f56-476c-beb0-0bb685fde6dc tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:17.786917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-298d72b4-4f56-476c-beb0-0bb685fde6dc tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.521934 Apr 07 12:58:17.789212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 141/286] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:17 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:18.281008 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fa78cc8d-6452-427a-9784-d70428c85d86 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:18.281623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fa78cc8d-6452-427a-9784-d70428c85d86 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:18.299788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fa78cc8d-6452-427a-9784-d70428c85d86 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:18.300265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fa78cc8d-6452-427a-9784-d70428c85d86 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:18.301053 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fa78cc8d-6452-427a-9784-d70428c85d86 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:18.301490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fa78cc8d-6452-427a-9784-d70428c85d86 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:18.415488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fa78cc8d-6452-427a-9784-d70428c85d86 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:18.427979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fa78cc8d-6452-427a-9784-d70428c85d86 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1297 microversion: 2.1 time: 0.151118 Apr 07 12:58:18.441843 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 146/287] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1297 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:18.507578 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4c90defd-df3b-4ca7-a4a5-6425c0468c8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:18.508345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4c90defd-df3b-4ca7-a4a5-6425c0468c8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:18.522384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c90defd-df3b-4ca7-a4a5-6425c0468c8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:18.523889 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c90defd-df3b-4ca7-a4a5-6425c0468c8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:18.525201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c90defd-df3b-4ca7-a4a5-6425c0468c8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:18.525898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c90defd-df3b-4ca7-a4a5-6425c0468c8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:18.808348 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ca17e172-bc23-45a3-a8fc-1e137948f9f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:18.812731 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ca17e172-bc23-45a3-a8fc-1e137948f9f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:18.836690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ca17e172-bc23-45a3-a8fc-1e137948f9f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:18.837889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ca17e172-bc23-45a3-a8fc-1e137948f9f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:18.840693 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ca17e172-bc23-45a3-a8fc-1e137948f9f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:18.841275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ca17e172-bc23-45a3-a8fc-1e137948f9f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:18.907028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4c90defd-df3b-4ca7-a4a5-6425c0468c8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:18.922683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4c90defd-df3b-4ca7-a4a5-6425c0468c8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:18.926141 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4c90defd-df3b-4ca7-a4a5-6425c0468c8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:18.929289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4c90defd-df3b-4ca7-a4a5-6425c0468c8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1744 microversion: 2.20 time: 0.430068 Apr 07 12:58:18.932575 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 142/288] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:18 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1744 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:19.191897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ca17e172-bc23-45a3-a8fc-1e137948f9f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:19.201058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ca17e172-bc23-45a3-a8fc-1e137948f9f9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.399073 Apr 07 12:58:19.210528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 147/289] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:18 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:19.449258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-60bd18e4-067b-4629-9358-da5e363917f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:19.449878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-60bd18e4-067b-4629-9358-da5e363917f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:19.460199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-60bd18e4-067b-4629-9358-da5e363917f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:19.462951 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-60bd18e4-067b-4629-9358-da5e363917f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:19.464918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-60bd18e4-067b-4629-9358-da5e363917f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:19.465374 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-60bd18e4-067b-4629-9358-da5e363917f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:19.612632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-60bd18e4-067b-4629-9358-da5e363917f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:19.620850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-60bd18e4-067b-4629-9358-da5e363917f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1303 microversion: 2.1 time: 0.178405 Apr 07 12:58:19.627998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 143/290] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:19 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1303 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:19.950076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c60d75ce-9f51-493c-a2d8-0e5931fd0fe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:19.951096 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c60d75ce-9f51-493c-a2d8-0e5931fd0fe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:19.965341 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c60d75ce-9f51-493c-a2d8-0e5931fd0fe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:19.966362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c60d75ce-9f51-493c-a2d8-0e5931fd0fe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:19.968682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c60d75ce-9f51-493c-a2d8-0e5931fd0fe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:19.969336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c60d75ce-9f51-493c-a2d8-0e5931fd0fe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:20.219421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-973a3f34-9773-475a-855d-2cdc3b186029 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:20.220051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-973a3f34-9773-475a-855d-2cdc3b186029 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:20.234676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-973a3f34-9773-475a-855d-2cdc3b186029 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:20.235143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-973a3f34-9773-475a-855d-2cdc3b186029 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:20.242756 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-973a3f34-9773-475a-855d-2cdc3b186029 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:20.243932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-973a3f34-9773-475a-855d-2cdc3b186029 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:20.438670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c60d75ce-9f51-493c-a2d8-0e5931fd0fe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:20.463515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c60d75ce-9f51-493c-a2d8-0e5931fd0fe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:20.468517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c60d75ce-9f51-493c-a2d8-0e5931fd0fe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:20.471403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c60d75ce-9f51-493c-a2d8-0e5931fd0fe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1739 microversion: 2.20 time: 0.525477 Apr 07 12:58:20.498531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 148/291] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:19 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1739 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:20.638834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-dc43e685-d66e-4bb5-ab79-e56f5420ea68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:20.639833 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-dc43e685-d66e-4bb5-ab79-e56f5420ea68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:20.653680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dc43e685-d66e-4bb5-ab79-e56f5420ea68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:20.655566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dc43e685-d66e-4bb5-ab79-e56f5420ea68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:20.656669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dc43e685-d66e-4bb5-ab79-e56f5420ea68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:20.664087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dc43e685-d66e-4bb5-ab79-e56f5420ea68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:20.838191 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-973a3f34-9773-475a-855d-2cdc3b186029 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:20.853200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-973a3f34-9773-475a-855d-2cdc3b186029 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 0.638865 Apr 07 12:58:20.869010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 144/292] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:20 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:20.934511 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-9b2f2104-cd01-4f80-8da1-63bdb752c440 req-409b47d1-8280-4807-89e2-89ec390bb0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c9a464-496a-4aa9-80dd-f9ec66f515ae", "name": "network-vif-plugged", "status": "completed", "tag": "b25fac27-5301-4311-8e84-5721b8cac04c"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:20.949273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-9b2f2104-cd01-4f80-8da1-63bdb752c440 req-409b47d1-8280-4807-89e2-89ec390bb0f7 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:20.950130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-9b2f2104-cd01-4f80-8da1-63bdb752c440 req-409b47d1-8280-4807-89e2-89ec390bb0f7 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:20.969647 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-9b2f2104-cd01-4f80-8da1-63bdb752c440 req-409b47d1-8280-4807-89e2-89ec390bb0f7 service nova] Creating event network-vif-plugged:b25fac27-5301-4311-8e84-5721b8cac04c for instance 58c9a464-496a-4aa9-80dd-f9ec66f515ae on hv-cinder-83694 Apr 07 12:58:20.977725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-9b2f2104-cd01-4f80-8da1-63bdb752c440 req-409b47d1-8280-4807-89e2-89ec390bb0f7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048897 Apr 07 12:58:20.979002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 145/293] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 12:58:21.181373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-dc43e685-d66e-4bb5-ab79-e56f5420ea68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:21.191201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-dc43e685-d66e-4bb5-ab79-e56f5420ea68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1371 microversion: 2.1 time: 0.556978 Apr 07 12:58:21.211398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 149/294] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:20 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1371 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:21.495476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-398877ca-0714-40d3-bba0-f8c3bcfec3eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:21.496800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-398877ca-0714-40d3-bba0-f8c3bcfec3eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:21.508762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-398877ca-0714-40d3-bba0-f8c3bcfec3eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:21.509513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-398877ca-0714-40d3-bba0-f8c3bcfec3eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:21.510733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-398877ca-0714-40d3-bba0-f8c3bcfec3eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:21.511369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-398877ca-0714-40d3-bba0-f8c3bcfec3eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:21.876298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3800413d-bdad-45e5-bf0e-e8dc61214cc5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:21.879325 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3800413d-bdad-45e5-bf0e-e8dc61214cc5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:21.898141 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3800413d-bdad-45e5-bf0e-e8dc61214cc5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:21.901289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-398877ca-0714-40d3-bba0-f8c3bcfec3eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:21.903454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3800413d-bdad-45e5-bf0e-e8dc61214cc5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:21.905657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3800413d-bdad-45e5-bf0e-e8dc61214cc5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:21.907652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3800413d-bdad-45e5-bf0e-e8dc61214cc5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:21.911898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-398877ca-0714-40d3-bba0-f8c3bcfec3eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:21.913420 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-398877ca-0714-40d3-bba0-f8c3bcfec3eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:21.914613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-398877ca-0714-40d3-bba0-f8c3bcfec3eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1739 microversion: 2.20 time: 0.426008 Apr 07 12:58:21.925732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 146/295] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:21 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1739 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:22.210203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2eeb3de2-f272-4f25-9ea8-19a8d2c3ff63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:22.211257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2eeb3de2-f272-4f25-9ea8-19a8d2c3ff63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:22.222826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2eeb3de2-f272-4f25-9ea8-19a8d2c3ff63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:22.225712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2eeb3de2-f272-4f25-9ea8-19a8d2c3ff63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:22.229179 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2eeb3de2-f272-4f25-9ea8-19a8d2c3ff63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:22.229715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2eeb3de2-f272-4f25-9ea8-19a8d2c3ff63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:22.849471 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2eeb3de2-f272-4f25-9ea8-19a8d2c3ff63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:22.871305 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2eeb3de2-f272-4f25-9ea8-19a8d2c3ff63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1371 microversion: 2.1 time: 0.666762 Apr 07 12:58:22.872440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 147/296] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:22 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1371 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:22.894143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-31cfecf5-c05d-41d4-a4d5-d2847b57852d req-2d1569c2-71fa-4a29-a52c-9fc1a1d18313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2c5542-86c5-4fe4-9287-ed9dc322b189", "tag": "01b94e44-6b83-4805-bf7a-8c07a6310174"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:22.913981 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-31cfecf5-c05d-41d4-a4d5-d2847b57852d req-2d1569c2-71fa-4a29-a52c-9fc1a1d18313 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:22.915437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-31cfecf5-c05d-41d4-a4d5-d2847b57852d req-2d1569c2-71fa-4a29-a52c-9fc1a1d18313 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:22.948340 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-31cfecf5-c05d-41d4-a4d5-d2847b57852d req-2d1569c2-71fa-4a29-a52c-9fc1a1d18313 service nova] Creating event network-changed:01b94e44-6b83-4805-bf7a-8c07a6310174 for instance 1c2c5542-86c5-4fe4-9287-ed9dc322b189 on hv-cinder-83694 Apr 07 12:58:22.957995 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-31cfecf5-c05d-41d4-a4d5-d2847b57852d req-2d1569c2-71fa-4a29-a52c-9fc1a1d18313 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083334 Apr 07 12:58:22.961852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 148/297] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:58:22.974620 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b0a6386b-ccf8-46fa-a7d8-6642e0f25920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:22.976436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b0a6386b-ccf8-46fa-a7d8-6642e0f25920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:22.994241 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0a6386b-ccf8-46fa-a7d8-6642e0f25920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:22.994899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0a6386b-ccf8-46fa-a7d8-6642e0f25920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:22.995834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0a6386b-ccf8-46fa-a7d8-6642e0f25920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:23.000701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0a6386b-ccf8-46fa-a7d8-6642e0f25920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:23.266505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3800413d-bdad-45e5-bf0e-e8dc61214cc5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:23.280382 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3800413d-bdad-45e5-bf0e-e8dc61214cc5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1725 microversion: 2.1 time: 1.407454 Apr 07 12:58:23.285685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 150/298] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:21 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1725 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:23.458198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-341363270", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1816777936", "security_groups": [{"name": "tempest-secgroup-smoke-1306186040"}], "block_device_mapping_v2": [{"uuid": "429c3140-a50f-4367-ab87-8b0ca3ac6271", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ece19f0d-be5f-4b8f-aed1-374da7c54815"}]}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:23.575235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b0a6386b-ccf8-46fa-a7d8-6642e0f25920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:23.594948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b0a6386b-ccf8-46fa-a7d8-6642e0f25920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:23.602245 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b0a6386b-ccf8-46fa-a7d8-6642e0f25920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:23.605170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b0a6386b-ccf8-46fa-a7d8-6642e0f25920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1739 microversion: 2.20 time: 0.641894 Apr 07 12:58:23.607765 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 149/299] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1739 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:23.861673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.network.neutron [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] validate_networks() for [('ece19f0d-be5f-4b8f-aed1-374da7c54815', None, None, None, None, None)] {{(pid=116893) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 12:58:23.894288 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dac86a95-b1aa-46e0-819b-b180a28b426d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:23.894973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dac86a95-b1aa-46e0-819b-b180a28b426d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:23.910227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dac86a95-b1aa-46e0-819b-b180a28b426d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:23.910700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dac86a95-b1aa-46e0-819b-b180a28b426d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:23.911487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dac86a95-b1aa-46e0-819b-b180a28b426d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:23.911923 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dac86a95-b1aa-46e0-819b-b180a28b426d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:24.273534 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dac86a95-b1aa-46e0-819b-b180a28b426d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:24.282653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dac86a95-b1aa-46e0-819b-b180a28b426d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1371 microversion: 2.1 time: 0.396926 Apr 07 12:58:24.293505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 150/300] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:23 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1371 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:24.304683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ad312588-1591-4e48-85b8-4511d0613514 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:24.305511 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ad312588-1591-4e48-85b8-4511d0613514 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:24.311825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad312588-1591-4e48-85b8-4511d0613514 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:24.312568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad312588-1591-4e48-85b8-4511d0613514 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:24.313493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad312588-1591-4e48-85b8-4511d0613514 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:24.314699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad312588-1591-4e48-85b8-4511d0613514 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:24.863713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ad312588-1591-4e48-85b8-4511d0613514 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:24.897068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ad312588-1591-4e48-85b8-4511d0613514 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1702 microversion: 2.1 time: 0.596067 Apr 07 12:58:24.910368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 151/301] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:24 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1702 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:24.944841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-61c0bff7-3bb2-4f82-b3b2-7cd109252506 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:24.945476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-61c0bff7-3bb2-4f82-b3b2-7cd109252506 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:24.962937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61c0bff7-3bb2-4f82-b3b2-7cd109252506 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:24.963398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61c0bff7-3bb2-4f82-b3b2-7cd109252506 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:24.964451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61c0bff7-3bb2-4f82-b3b2-7cd109252506 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:24.964946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61c0bff7-3bb2-4f82-b3b2-7cd109252506 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:25.213404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Flavor limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 12:58:25.214002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Image limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 12:58:25.214294 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Flavor pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 12:58:25.214706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Image pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 12:58:25.217519 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 12:58:25.229749 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:25.230207 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:25.231090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:25.231527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:25.302584 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Getting quotas for project a63deb3be5f546a696dabf7b1a6f3416. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:58:25.310457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Getting quotas for user af14b11cb4c649e6881818075733a5b7 and project a63deb3be5f546a696dabf7b1a6f3416. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:58:25.454937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-61c0bff7-3bb2-4f82-b3b2-7cd109252506 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:25.467722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Going to run 1 instances... {{(pid=116893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 12:58:25.471468 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='429c3140-a50f-4367-ab87-8b0ca3ac6271',volume_size=None,volume_type=None)] {{(pid=116893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 12:58:25.487485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-61c0bff7-3bb2-4f82-b3b2-7cd109252506 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:25.508606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-61c0bff7-3bb2-4f82-b3b2-7cd109252506 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:25.509798 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-61c0bff7-3bb2-4f82-b3b2-7cd109252506 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1739 microversion: 2.20 time: 0.596307 Apr 07 12:58:25.522648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 152/302] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:24 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1739 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:25.527882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-007a597a-bcf3-4275-b781-6afc71ff222b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:25.545891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-007a597a-bcf3-4275-b781-6afc71ff222b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:25.546647 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-007a597a-bcf3-4275-b781-6afc71ff222b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:25.722549 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-007a597a-bcf3-4275-b781-6afc71ff222b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Going to try to start instance {{(pid=116892) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 07 12:58:25.878126 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-007a597a-bcf3-4275-b781-6afc71ff222b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "POST /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/action" status: 202 len: 0 microversion: 2.1 time: 0.342600 Apr 07 12:58:25.878126 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 153/303] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 12:58:25 2022] POST /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 12:58:25.878126 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2f9df4fa-a53d-42c5-8e79-d5ae9eb79a9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:25.888136 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2f9df4fa-a53d-42c5-8e79-d5ae9eb79a9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:25.899249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f9df4fa-a53d-42c5-8e79-d5ae9eb79a9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:25.899843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f9df4fa-a53d-42c5-8e79-d5ae9eb79a9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:25.900803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f9df4fa-a53d-42c5-8e79-d5ae9eb79a9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:25.901478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f9df4fa-a53d-42c5-8e79-d5ae9eb79a9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:26.063064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-eb0365e3-6d3f-4ba3-b6d4-04055f7e477d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.613254 Apr 07 12:58:26.069724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 151/304] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 12:58:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 2621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 07 12:58:26.097436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-59a5e722-b56d-4933-9df6-e854d071dd96 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:26.101874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-59a5e722-b56d-4933-9df6-e854d071dd96 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:26.141489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-59a5e722-b56d-4933-9df6-e854d071dd96 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:26.146261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-59a5e722-b56d-4933-9df6-e854d071dd96 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:26.151120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-59a5e722-b56d-4933-9df6-e854d071dd96 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:26.152136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-59a5e722-b56d-4933-9df6-e854d071dd96 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:26.734375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2f9df4fa-a53d-42c5-8e79-d5ae9eb79a9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:26.750028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2f9df4fa-a53d-42c5-8e79-d5ae9eb79a9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1371 microversion: 2.1 time: 0.880831 Apr 07 12:58:26.752996 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 154/305] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:25 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1371 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:26.766213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b89fcc48-4de3-4acb-a3bc-4cc03dfc40d5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:26.767082 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b89fcc48-4de3-4acb-a3bc-4cc03dfc40d5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:26.890593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-59a5e722-b56d-4933-9df6-e854d071dd96 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:26.920419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-59a5e722-b56d-4933-9df6-e854d071dd96 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1711 microversion: 2.1 time: 0.843016 Apr 07 12:58:26.921085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 152/306] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:26 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1711 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:26.927073 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-35b9f356-050d-4ef8-9bbd-cb1196ac6cb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:26.967872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-35b9f356-050d-4ef8-9bbd-cb1196ac6cb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:27.006058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-35b9f356-050d-4ef8-9bbd-cb1196ac6cb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:27.006503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-35b9f356-050d-4ef8-9bbd-cb1196ac6cb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:27.007289 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-35b9f356-050d-4ef8-9bbd-cb1196ac6cb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:27.007717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-35b9f356-050d-4ef8-9bbd-cb1196ac6cb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:27.087000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b89fcc48-4de3-4acb-a3bc-4cc03dfc40d5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:27.101290 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b89fcc48-4de3-4acb-a3bc-4cc03dfc40d5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1094 microversion: 2.1 time: 0.340717 Apr 07 12:58:27.102081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 155/307] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:26 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1094 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:27.407046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-35b9f356-050d-4ef8-9bbd-cb1196ac6cb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:27.422650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-35b9f356-050d-4ef8-9bbd-cb1196ac6cb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:27.427179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-35b9f356-050d-4ef8-9bbd-cb1196ac6cb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:27.441706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-35b9f356-050d-4ef8-9bbd-cb1196ac6cb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1739 microversion: 2.20 time: 0.514066 Apr 07 12:58:27.445019 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 153/308] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:26 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1739 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:27.774459 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d9748c9a-5d20-47aa-b3d8-32042d551dd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:27.777458 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d9748c9a-5d20-47aa-b3d8-32042d551dd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:27.795384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d9748c9a-5d20-47aa-b3d8-32042d551dd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:27.795661 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d9748c9a-5d20-47aa-b3d8-32042d551dd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:27.798160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d9748c9a-5d20-47aa-b3d8-32042d551dd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:27.799898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d9748c9a-5d20-47aa-b3d8-32042d551dd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:27.938710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2d57277f-51a0-4f02-8b27-55d092acc248 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:27.939911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2d57277f-51a0-4f02-8b27-55d092acc248 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:27.959745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2d57277f-51a0-4f02-8b27-55d092acc248 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:27.960259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2d57277f-51a0-4f02-8b27-55d092acc248 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:27.963781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2d57277f-51a0-4f02-8b27-55d092acc248 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:27.964282 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2d57277f-51a0-4f02-8b27-55d092acc248 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:28.336182 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2d57277f-51a0-4f02-8b27-55d092acc248 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:28.344730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2d57277f-51a0-4f02-8b27-55d092acc248 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1711 microversion: 2.1 time: 0.409873 Apr 07 12:58:28.345977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 154/309] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:27 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1711 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:28.374789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-406135071", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "networks": [{"uuid": "5c5ed470-5570-4944-b545-0cac9fe8b6ec"}]}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:28.559762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d9748c9a-5d20-47aa-b3d8-32042d551dd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:28.574511 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d9748c9a-5d20-47aa-b3d8-32042d551dd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1371 microversion: 2.1 time: 0.808869 Apr 07 12:58:28.580584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 156/310] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1371 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:28.594195 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-403513c7-f278-447f-8157-c40abe1f17c0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:28.609089 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-403513c7-f278-447f-8157-c40abe1f17c0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:28.615883 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-403513c7-f278-447f-8157-c40abe1f17c0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:28.616712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-403513c7-f278-447f-8157-c40abe1f17c0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:28.617725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-403513c7-f278-447f-8157-c40abe1f17c0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:28.618379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-403513c7-f278-447f-8157-c40abe1f17c0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:28.737613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-403513c7-f278-447f-8157-c40abe1f17c0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:28.748803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-403513c7-f278-447f-8157-c40abe1f17c0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1210 microversion: 2.1 time: 0.165426 Apr 07 12:58:28.749731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 157/311] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:28 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1210 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:28.758734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-42d71f81-789c-4377-8b52-c6d002d5705c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:28.761692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-42d71f81-789c-4377-8b52-c6d002d5705c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:28.779383 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-42d71f81-789c-4377-8b52-c6d002d5705c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:28.780266 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-42d71f81-789c-4377-8b52-c6d002d5705c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:28.783510 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-42d71f81-789c-4377-8b52-c6d002d5705c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:28.789042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-42d71f81-789c-4377-8b52-c6d002d5705c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:29.497714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-42d71f81-789c-4377-8b52-c6d002d5705c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:29.507146 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-42d71f81-789c-4377-8b52-c6d002d5705c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:29.518539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-42d71f81-789c-4377-8b52-c6d002d5705c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:29.531285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-42d71f81-789c-4377-8b52-c6d002d5705c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1739 microversion: 2.20 time: 0.780300 Apr 07 12:58:29.535047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 158/312] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:28 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1739 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:29.551851 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8c6848cb-9c43-4b98-9138-e430cdb9e69f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:29.561150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8c6848cb-9c43-4b98-9138-e430cdb9e69f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:29.576799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c6848cb-9c43-4b98-9138-e430cdb9e69f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:29.577636 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c6848cb-9c43-4b98-9138-e430cdb9e69f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:29.583055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c6848cb-9c43-4b98-9138-e430cdb9e69f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:29.583875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c6848cb-9c43-4b98-9138-e430cdb9e69f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:29.949235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8c6848cb-9c43-4b98-9138-e430cdb9e69f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:29.958680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8c6848cb-9c43-4b98-9138-e430cdb9e69f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1711 microversion: 2.1 time: 0.421432 Apr 07 12:58:29.960041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 159/313] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:29 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1711 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:29.965677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-05bda521-cf1d-475a-908a-7ca987c7dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:29.966478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-05bda521-cf1d-475a-908a-7ca987c7dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:29.976737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05bda521-cf1d-475a-908a-7ca987c7dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:29.977548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05bda521-cf1d-475a-908a-7ca987c7dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:29.978666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05bda521-cf1d-475a-908a-7ca987c7dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:29.979259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05bda521-cf1d-475a-908a-7ca987c7dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:30.061696 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.network.neutron [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] validate_networks() for [('5c5ed470-5570-4944-b545-0cac9fe8b6ec', None, None, None, None, None)] {{(pid=116893) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 12:58:30.357240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-05bda521-cf1d-475a-908a-7ca987c7dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:30.372878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-05bda521-cf1d-475a-908a-7ca987c7dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1371 microversion: 2.1 time: 0.411247 Apr 07 12:58:30.373971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 160/314] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:29 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1371 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:30.383969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-85da1af6-dece-4933-8dee-1dc7a91c6007 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:30.384891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-85da1af6-dece-4933-8dee-1dc7a91c6007 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:30.401227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-85da1af6-dece-4933-8dee-1dc7a91c6007 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:30.401682 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-85da1af6-dece-4933-8dee-1dc7a91c6007 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:30.402472 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-85da1af6-dece-4933-8dee-1dc7a91c6007 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:30.402905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-85da1af6-dece-4933-8dee-1dc7a91c6007 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:30.613256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-85da1af6-dece-4933-8dee-1dc7a91c6007 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:30.621358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-85da1af6-dece-4933-8dee-1dc7a91c6007 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.246114 Apr 07 12:58:30.622362 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 161/315] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:30 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:30.627130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6e659fbc-95d1-4dfb-85e5-0008633a4e83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Action: 'create', calling method: .version_select at 0x7fde5862fb80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1818995414"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:30.647314 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-6e659fbc-95d1-4dfb-85e5-0008633a4e83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Getting quotas for project 8e1c0e24f0394eef8804893e1ca3f91b. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:58:30.651766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-6e659fbc-95d1-4dfb-85e5-0008633a4e83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Getting quotas for user 06e1e692e6f7454da7d5e40bd049132f and project 8e1c0e24f0394eef8804893e1ca3f91b. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:58:30.697983 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Flavor limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 12:58:30.698568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Image limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 12:58:30.699158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Flavor pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 12:58:30.699676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Image pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 12:58:30.700221 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 12:58:30.718651 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:30.719572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:30.723973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:30.724545 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:30.752263 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Getting quotas for project 68b9990f9e7d4c6aa7f472952d89f94d. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:58:30.757021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Getting quotas for user 1ce952f5fbb249a08c3c103b542c94f6 and project 68b9990f9e7d4c6aa7f472952d89f94d. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:58:30.772341 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Going to run 1 instances... {{(pid=116893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 12:58:30.775038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 12:58:30.814710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-6e659fbc-95d1-4dfb-85e5-0008633a4e83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Getting quotas for project 8e1c0e24f0394eef8804893e1ca3f91b. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:58:30.824027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-6e659fbc-95d1-4dfb-85e5-0008633a4e83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Getting quotas for user 06e1e692e6f7454da7d5e40bd049132f and project 8e1c0e24f0394eef8804893e1ca3f91b. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:58:30.828637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a261e8c2-0e60-4ee5-9e15-2accfb170022 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.480103 Apr 07 12:58:30.838357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 155/316] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 12:58:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 12:58:30.840926 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6e659fbc-95d1-4dfb-85e5-0008633a4e83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.217634 Apr 07 12:58:30.841892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 162/317] 10.222.0.15 () {60 vars in 1157 bytes} [Thu Apr 7 12:58:30 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:30.846923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-63cad68f-3474-40b9-93e4-31099eadda3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:30.847778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-63cad68f-3474-40b9-93e4-31099eadda3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:30.848884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-635124cd-4bf3-45cd-bcac-6de3e4666c88 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:30.850235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-635124cd-4bf3-45cd-bcac-6de3e4666c88 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:30.855243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63cad68f-3474-40b9-93e4-31099eadda3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:30.856271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63cad68f-3474-40b9-93e4-31099eadda3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:30.858199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63cad68f-3474-40b9-93e4-31099eadda3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:30.858948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63cad68f-3474-40b9-93e4-31099eadda3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:30.950645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-635124cd-4bf3-45cd-bcac-6de3e4666c88 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:30.962967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-635124cd-4bf3-45cd-bcac-6de3e4666c88 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1218 microversion: 2.1 time: 0.117057 Apr 07 12:58:30.963792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 163/318] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:30 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:30.977409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-495128844", "imageRef": "7f2f1919-c61a-4a9b-a750-964bda58cbbe", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1818995414", "networks": [{"uuid": "6eba0e64-bbab-43a8-aa6a-ac864bc98d22"}]}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:31.041664 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.network.neutron [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] validate_networks() for [('6eba0e64-bbab-43a8-aa6a-ac864bc98d22', None, None, None, None, None)] {{(pid=116892) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 12:58:31.119575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-63cad68f-3474-40b9-93e4-31099eadda3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:31.129555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-63cad68f-3474-40b9-93e4-31099eadda3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:31.131056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-63cad68f-3474-40b9-93e4-31099eadda3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:31.132256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-63cad68f-3474-40b9-93e4-31099eadda3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1739 microversion: 2.20 time: 0.292014 Apr 07 12:58:31.140676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 156/319] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:30 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:31.153076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-22b426a0-03af-4755-b117-e433289b9322 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:31.154225 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-22b426a0-03af-4755-b117-e433289b9322 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:31.166834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-22b426a0-03af-4755-b117-e433289b9322 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:31.167284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-22b426a0-03af-4755-b117-e433289b9322 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:31.168059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-22b426a0-03af-4755-b117-e433289b9322 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:31.168530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-22b426a0-03af-4755-b117-e433289b9322 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:31.376509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-22b426a0-03af-4755-b117-e433289b9322 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:31.389689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-22b426a0-03af-4755-b117-e433289b9322 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1715 microversion: 2.1 time: 0.247913 Apr 07 12:58:31.392620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 157/320] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:31 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1715 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:31.414629 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6263770b-bdb6-4f58-807c-4582a1a0c780 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:31.415270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6263770b-bdb6-4f58-807c-4582a1a0c780 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:31.434560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6263770b-bdb6-4f58-807c-4582a1a0c780 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:31.435028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6263770b-bdb6-4f58-807c-4582a1a0c780 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:31.436412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6263770b-bdb6-4f58-807c-4582a1a0c780 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:31.436858 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6263770b-bdb6-4f58-807c-4582a1a0c780 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:31.605271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6263770b-bdb6-4f58-807c-4582a1a0c780 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:31.624885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6263770b-bdb6-4f58-807c-4582a1a0c780 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1371 microversion: 2.1 time: 0.230140 Apr 07 12:58:31.627527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 158/321] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:31 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:31.643031 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c318933e-afd2-4e01-9d98-4d55245a622e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:31.645412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c318933e-afd2-4e01-9d98-4d55245a622e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:31.656085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c318933e-afd2-4e01-9d98-4d55245a622e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:31.656720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c318933e-afd2-4e01-9d98-4d55245a622e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:31.658270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c318933e-afd2-4e01-9d98-4d55245a622e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:31.658805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c318933e-afd2-4e01-9d98-4d55245a622e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:31.839076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c318933e-afd2-4e01-9d98-4d55245a622e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:31.840741 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Flavor limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 12:58:31.841423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Image limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 12:58:31.842296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Flavor pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 12:58:31.842956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Image pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 12:58:31.844433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 12:58:31.854642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c318933e-afd2-4e01-9d98-4d55245a622e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.220005 Apr 07 12:58:31.855264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 159/322] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:31 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:31.857575 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:31.858446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:31.859686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:31.860594 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:31.882532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Getting quotas for project 8e1c0e24f0394eef8804893e1ca3f91b. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 12:58:31.887727 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Getting quotas for user 06e1e692e6f7454da7d5e40bd049132f and project 8e1c0e24f0394eef8804893e1ca3f91b. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 12:58:31.901142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Going to run 1 instances... {{(pid=116892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 12:58:31.903674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f2f1919-c61a-4a9b-a750-964bda58cbbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 12:58:32.012228 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2c1ed9dc-6638-4657-9b71-8be8856dbbf5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:32.012228 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2c1ed9dc-6638-4657-9b71-8be8856dbbf5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:32.012659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6bf46007-2696-4492-8ef0-90f30f9a85e0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.024415 Apr 07 12:58:32.012659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 164/323] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 12:58:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 12:58:32.031050 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c1ed9dc-6638-4657-9b71-8be8856dbbf5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:32.031372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c1ed9dc-6638-4657-9b71-8be8856dbbf5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:32.034169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9724b696-e116-464e-b954-e9de6d07aa9d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:32.034729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c1ed9dc-6638-4657-9b71-8be8856dbbf5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:32.037515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c1ed9dc-6638-4657-9b71-8be8856dbbf5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:32.040925 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9724b696-e116-464e-b954-e9de6d07aa9d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:32.138520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2c1ed9dc-6638-4657-9b71-8be8856dbbf5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:32.147983 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2c1ed9dc-6638-4657-9b71-8be8856dbbf5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1222 microversion: 2.1 time: 0.167828 Apr 07 12:58:32.149280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 160/324] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:31 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1222 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:32.159416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6ad05b4a-78ed-46bc-ba25-eba4dc90e640 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:32.160217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6ad05b4a-78ed-46bc-ba25-eba4dc90e640 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:32.167283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6ad05b4a-78ed-46bc-ba25-eba4dc90e640 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:32.168316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6ad05b4a-78ed-46bc-ba25-eba4dc90e640 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:32.168837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6ad05b4a-78ed-46bc-ba25-eba4dc90e640 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:32.169370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6ad05b4a-78ed-46bc-ba25-eba4dc90e640 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:32.200337 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9724b696-e116-464e-b954-e9de6d07aa9d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:32.213139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9724b696-e116-464e-b954-e9de6d07aa9d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1258 microversion: 2.1 time: 0.198901 Apr 07 12:58:32.220326 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 165/325] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:32 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1258 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:32.378464 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6ad05b4a-78ed-46bc-ba25-eba4dc90e640 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:32.389560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6ad05b4a-78ed-46bc-ba25-eba4dc90e640 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:32.391879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6ad05b4a-78ed-46bc-ba25-eba4dc90e640 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:32.394007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6ad05b4a-78ed-46bc-ba25-eba4dc90e640 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1739 microversion: 2.20 time: 0.240478 Apr 07 12:58:32.395426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 161/326] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:32 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:32.652289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-06bef40d-0d15-41f8-93f3-e123c29ea093 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:32.654431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-06bef40d-0d15-41f8-93f3-e123c29ea093 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:32.669868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06bef40d-0d15-41f8-93f3-e123c29ea093 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:32.670328 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06bef40d-0d15-41f8-93f3-e123c29ea093 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:32.671176 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06bef40d-0d15-41f8-93f3-e123c29ea093 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:32.671540 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06bef40d-0d15-41f8-93f3-e123c29ea093 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:32.871918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-11091bdc-f287-4de9-a566-0321a338ae0d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:32.872592 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-11091bdc-f287-4de9-a566-0321a338ae0d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:32.890007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11091bdc-f287-4de9-a566-0321a338ae0d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:32.890747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11091bdc-f287-4de9-a566-0321a338ae0d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:32.893570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11091bdc-f287-4de9-a566-0321a338ae0d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:32.894173 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11091bdc-f287-4de9-a566-0321a338ae0d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:33.176218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-11091bdc-f287-4de9-a566-0321a338ae0d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:33.193237 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-11091bdc-f287-4de9-a566-0321a338ae0d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.325201 Apr 07 12:58:33.196486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 162/327] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:32 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:33.215184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-b18d3dca-460c-4177-8899-41662cc2008b req-58ba780c-4296-457c-8deb-900bb5846557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb36ce2a-6233-4601-85c0-35c550476cea", "tag": "1d264377-61da-43aa-ba85-52dd323d34d8"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:33.231363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-b18d3dca-460c-4177-8899-41662cc2008b req-58ba780c-4296-457c-8deb-900bb5846557 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:33.231994 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-b18d3dca-460c-4177-8899-41662cc2008b req-58ba780c-4296-457c-8deb-900bb5846557 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:33.261810 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-b18d3dca-460c-4177-8899-41662cc2008b req-58ba780c-4296-457c-8deb-900bb5846557 service nova] Creating event network-changed:1d264377-61da-43aa-ba85-52dd323d34d8 for instance cb36ce2a-6233-4601-85c0-35c550476cea on hv-cinder-83694 Apr 07 12:58:33.270811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-b18d3dca-460c-4177-8899-41662cc2008b req-58ba780c-4296-457c-8deb-900bb5846557 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072246 Apr 07 12:58:33.273679 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 163/328] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:58:33.284332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4adc80c8-99a8-482b-bf26-1d6d1b0d7f72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:33.285193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4adc80c8-99a8-482b-bf26-1d6d1b0d7f72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:33.288964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-06bef40d-0d15-41f8-93f3-e123c29ea093 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:33.292807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4adc80c8-99a8-482b-bf26-1d6d1b0d7f72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:33.293509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4adc80c8-99a8-482b-bf26-1d6d1b0d7f72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:33.294953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4adc80c8-99a8-482b-bf26-1d6d1b0d7f72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:33.295696 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4adc80c8-99a8-482b-bf26-1d6d1b0d7f72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:33.297004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-06bef40d-0d15-41f8-93f3-e123c29ea093 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1371 microversion: 2.1 time: 0.656934 Apr 07 12:58:33.297573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 166/329] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1371 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:33.306562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-8b02f17d-b8d0-4a6b-b0db-c4ae9394cef0 req-18997154-43a7-4cce-a814-de0459ebdb57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2c5542-86c5-4fe4-9287-ed9dc322b189", "name": "network-vif-plugged", "status": "completed", "tag": "01b94e44-6b83-4805-bf7a-8c07a6310174"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:33.316035 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-8b02f17d-b8d0-4a6b-b0db-c4ae9394cef0 req-18997154-43a7-4cce-a814-de0459ebdb57 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:33.317421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-8b02f17d-b8d0-4a6b-b0db-c4ae9394cef0 req-18997154-43a7-4cce-a814-de0459ebdb57 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:33.330114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-8b02f17d-b8d0-4a6b-b0db-c4ae9394cef0 req-18997154-43a7-4cce-a814-de0459ebdb57 service nova] Creating event network-vif-plugged:01b94e44-6b83-4805-bf7a-8c07a6310174 for instance 1c2c5542-86c5-4fe4-9287-ed9dc322b189 on hv-cinder-83694 Apr 07 12:58:33.335200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-8b02f17d-b8d0-4a6b-b0db-c4ae9394cef0 req-18997154-43a7-4cce-a814-de0459ebdb57 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034927 Apr 07 12:58:33.335799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 167/330] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:58:33.340880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-27b87ff2-ffe2-47b5-9d37-9adce094df2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:33.341596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-27b87ff2-ffe2-47b5-9d37-9adce094df2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:33.348543 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-27b87ff2-ffe2-47b5-9d37-9adce094df2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:33.349052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-27b87ff2-ffe2-47b5-9d37-9adce094df2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:33.350262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-27b87ff2-ffe2-47b5-9d37-9adce094df2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:33.350890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-27b87ff2-ffe2-47b5-9d37-9adce094df2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:33.372563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4adc80c8-99a8-482b-bf26-1d6d1b0d7f72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:33.381459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4adc80c8-99a8-482b-bf26-1d6d1b0d7f72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1270 microversion: 2.1 time: 0.106027 Apr 07 12:58:33.382327 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 164/331] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:33 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:33.415882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-25eae5ab-a281-470a-8ea5-89bf02c1d9e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:33.416792 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-25eae5ab-a281-470a-8ea5-89bf02c1d9e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:33.433698 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-27b87ff2-ffe2-47b5-9d37-9adce094df2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:33.434067 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-25eae5ab-a281-470a-8ea5-89bf02c1d9e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:33.434702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-25eae5ab-a281-470a-8ea5-89bf02c1d9e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:33.435643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-25eae5ab-a281-470a-8ea5-89bf02c1d9e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:33.436253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-25eae5ab-a281-470a-8ea5-89bf02c1d9e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:33.462281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-27b87ff2-ffe2-47b5-9d37-9adce094df2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1310 microversion: 2.1 time: 0.124528 Apr 07 12:58:33.462281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 168/332] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:33 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1310 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:33.669194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-25eae5ab-a281-470a-8ea5-89bf02c1d9e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:33.680306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-25eae5ab-a281-470a-8ea5-89bf02c1d9e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:33.685056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-25eae5ab-a281-470a-8ea5-89bf02c1d9e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:33.688032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-25eae5ab-a281-470a-8ea5-89bf02c1d9e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1739 microversion: 2.20 time: 0.277344 Apr 07 12:58:33.692203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 165/333] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:33 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1739 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:34.223088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f69d834c-86b4-49f5-ae0a-e98da5e8e7b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:34.226452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f69d834c-86b4-49f5-ae0a-e98da5e8e7b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:34.267888 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f69d834c-86b4-49f5-ae0a-e98da5e8e7b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:34.268422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f69d834c-86b4-49f5-ae0a-e98da5e8e7b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:34.269260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f69d834c-86b4-49f5-ae0a-e98da5e8e7b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:34.274224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f69d834c-86b4-49f5-ae0a-e98da5e8e7b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:34.322178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1a4dddac-43b6-45f1-ab72-a505d7f0e0ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:34.323579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1a4dddac-43b6-45f1-ab72-a505d7f0e0ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:34.331860 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a4dddac-43b6-45f1-ab72-a505d7f0e0ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:34.332622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a4dddac-43b6-45f1-ab72-a505d7f0e0ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:34.333732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a4dddac-43b6-45f1-ab72-a505d7f0e0ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:34.334332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a4dddac-43b6-45f1-ab72-a505d7f0e0ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:34.585413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1a4dddac-43b6-45f1-ab72-a505d7f0e0ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:34.605505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1a4dddac-43b6-45f1-ab72-a505d7f0e0ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1371 microversion: 2.1 time: 0.291925 Apr 07 12:58:34.615714 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 166/334] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:34 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:34.618746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-14eed94c-da06-4f57-b50c-03b36b1a969f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:34.620339 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-14eed94c-da06-4f57-b50c-03b36b1a969f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:34.631408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14eed94c-da06-4f57-b50c-03b36b1a969f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:34.631947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14eed94c-da06-4f57-b50c-03b36b1a969f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:34.634421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14eed94c-da06-4f57-b50c-03b36b1a969f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:34.635537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14eed94c-da06-4f57-b50c-03b36b1a969f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:34.677841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f69d834c-86b4-49f5-ae0a-e98da5e8e7b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:34.686778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f69d834c-86b4-49f5-ae0a-e98da5e8e7b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.474770 Apr 07 12:58:34.690873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 169/335] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:34 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:34.701066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-965cbe96-8f77-4f38-8ff7-3b25168dbf5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:34.707942 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-965cbe96-8f77-4f38-8ff7-3b25168dbf5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:34.717749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-965cbe96-8f77-4f38-8ff7-3b25168dbf5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:34.718476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-965cbe96-8f77-4f38-8ff7-3b25168dbf5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:34.719440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-965cbe96-8f77-4f38-8ff7-3b25168dbf5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:34.720945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-965cbe96-8f77-4f38-8ff7-3b25168dbf5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:34.752248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-14eed94c-da06-4f57-b50c-03b36b1a969f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:34.766120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-14eed94c-da06-4f57-b50c-03b36b1a969f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1276 microversion: 2.1 time: 0.155460 Apr 07 12:58:34.767697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 167/336] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:34 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:34.783533 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-265ef45a-1cd4-4475-976d-a7c0d3e0bbf9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:34.784170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-265ef45a-1cd4-4475-976d-a7c0d3e0bbf9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:34.791556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-265ef45a-1cd4-4475-976d-a7c0d3e0bbf9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:34.791804 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-265ef45a-1cd4-4475-976d-a7c0d3e0bbf9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:34.792874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-265ef45a-1cd4-4475-976d-a7c0d3e0bbf9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:34.793041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-265ef45a-1cd4-4475-976d-a7c0d3e0bbf9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:34.856424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-965cbe96-8f77-4f38-8ff7-3b25168dbf5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:34.877829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-965cbe96-8f77-4f38-8ff7-3b25168dbf5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1316 microversion: 2.1 time: 0.180995 Apr 07 12:58:34.877829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 170/337] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:34 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:35.304866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-265ef45a-1cd4-4475-976d-a7c0d3e0bbf9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:35.320198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-265ef45a-1cd4-4475-976d-a7c0d3e0bbf9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:35.325200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-265ef45a-1cd4-4475-976d-a7c0d3e0bbf9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:35.329355 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-265ef45a-1cd4-4475-976d-a7c0d3e0bbf9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1739 microversion: 2.20 time: 0.560049 Apr 07 12:58:35.333828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 168/338] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:34 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1739 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:35.623198 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fcd9c0e7-05d6-45a6-923a-d42ca3be9867 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:35.623857 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fcd9c0e7-05d6-45a6-923a-d42ca3be9867 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:35.643305 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fcd9c0e7-05d6-45a6-923a-d42ca3be9867 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:35.643993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fcd9c0e7-05d6-45a6-923a-d42ca3be9867 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:35.644883 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fcd9c0e7-05d6-45a6-923a-d42ca3be9867 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:35.645294 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fcd9c0e7-05d6-45a6-923a-d42ca3be9867 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:35.711158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-aae86d91-83c4-4fdb-abec-9eb0cc48b5f3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:35.712503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-aae86d91-83c4-4fdb-abec-9eb0cc48b5f3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:35.722164 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aae86d91-83c4-4fdb-abec-9eb0cc48b5f3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:35.727635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aae86d91-83c4-4fdb-abec-9eb0cc48b5f3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:35.728806 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aae86d91-83c4-4fdb-abec-9eb0cc48b5f3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:35.732403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aae86d91-83c4-4fdb-abec-9eb0cc48b5f3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:36.226677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fcd9c0e7-05d6-45a6-923a-d42ca3be9867 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:36.244415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-aae86d91-83c4-4fdb-abec-9eb0cc48b5f3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:36.250524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fcd9c0e7-05d6-45a6-923a-d42ca3be9867 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1371 microversion: 2.1 time: 0.631523 Apr 07 12:58:36.252126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-aae86d91-83c4-4fdb-abec-9eb0cc48b5f3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.548318 Apr 07 12:58:36.253346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 171/339] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:35 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1371 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:36.266980 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e49c055e-062b-4702-b693-fd4704ea8d8a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:36.268993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e49c055e-062b-4702-b693-fd4704ea8d8a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:36.272483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 169/340] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:35 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:36.281199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-072d6023-0325-4149-89d0-19a6c5b7683d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:36.285702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-072d6023-0325-4149-89d0-19a6c5b7683d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:36.287157 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e49c055e-062b-4702-b693-fd4704ea8d8a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:36.289908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e49c055e-062b-4702-b693-fd4704ea8d8a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:36.293159 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e49c055e-062b-4702-b693-fd4704ea8d8a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:36.294020 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e49c055e-062b-4702-b693-fd4704ea8d8a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:36.296909 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-072d6023-0325-4149-89d0-19a6c5b7683d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:36.297360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-072d6023-0325-4149-89d0-19a6c5b7683d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:36.298615 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-072d6023-0325-4149-89d0-19a6c5b7683d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:36.307539 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-072d6023-0325-4149-89d0-19a6c5b7683d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:36.728066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-072d6023-0325-4149-89d0-19a6c5b7683d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:36.738751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-072d6023-0325-4149-89d0-19a6c5b7683d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.465091 Apr 07 12:58:36.747609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 170/341] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:36 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:36.753702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9d334853-3b3e-4e95-8cce-5f38809d48f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:36.754570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9d334853-3b3e-4e95-8cce-5f38809d48f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:36.777965 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9d334853-3b3e-4e95-8cce-5f38809d48f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:36.784603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9d334853-3b3e-4e95-8cce-5f38809d48f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:36.785686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9d334853-3b3e-4e95-8cce-5f38809d48f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:36.786303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9d334853-3b3e-4e95-8cce-5f38809d48f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:37.012855 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e49c055e-062b-4702-b693-fd4704ea8d8a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:37.043484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e49c055e-062b-4702-b693-fd4704ea8d8a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.781566 Apr 07 12:58:37.044802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 172/342] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:36 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:37.269995 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5faddc74-d9e3-4afe-90ab-87a25678f84c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:37.271567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5faddc74-d9e3-4afe-90ab-87a25678f84c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:37.286435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5faddc74-d9e3-4afe-90ab-87a25678f84c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:37.287271 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5faddc74-d9e3-4afe-90ab-87a25678f84c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:37.288652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5faddc74-d9e3-4afe-90ab-87a25678f84c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:37.289319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5faddc74-d9e3-4afe-90ab-87a25678f84c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:37.538259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5faddc74-d9e3-4afe-90ab-87a25678f84c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:37.558579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5faddc74-d9e3-4afe-90ab-87a25678f84c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.293428 Apr 07 12:58:37.561557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 173/343] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:37 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:37.584436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-55f048f7-0c36-42d7-9031-ffc2733ffa3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:37.586832 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-55f048f7-0c36-42d7-9031-ffc2733ffa3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:37.603282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-55f048f7-0c36-42d7-9031-ffc2733ffa3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:37.604844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-55f048f7-0c36-42d7-9031-ffc2733ffa3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:37.606928 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-55f048f7-0c36-42d7-9031-ffc2733ffa3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:37.612590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-55f048f7-0c36-42d7-9031-ffc2733ffa3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:37.713476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9d334853-3b3e-4e95-8cce-5f38809d48f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:37.731518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9d334853-3b3e-4e95-8cce-5f38809d48f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:37.738864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9d334853-3b3e-4e95-8cce-5f38809d48f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:37.742355 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9d334853-3b3e-4e95-8cce-5f38809d48f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1739 microversion: 2.20 time: 0.993475 Apr 07 12:58:37.757857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 171/344] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:36 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1739 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:37.771242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a94a055f-d666-49e2-9349-40068b62367c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:37.773831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a94a055f-d666-49e2-9349-40068b62367c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:37.794840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a94a055f-d666-49e2-9349-40068b62367c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:37.795306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a94a055f-d666-49e2-9349-40068b62367c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:37.799734 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a94a055f-d666-49e2-9349-40068b62367c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:37.800236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a94a055f-d666-49e2-9349-40068b62367c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:38.401204 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-55f048f7-0c36-42d7-9031-ffc2733ffa3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:38.409807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-55f048f7-0c36-42d7-9031-ffc2733ffa3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1565 microversion: 2.1 time: 0.846908 Apr 07 12:58:38.425902 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 174/345] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1565 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:38.435808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-718f0148-9126-4dec-9c42-9c2d03292332 req-8c9be3f5-54e1-4af4-9aae-31e3a03f39f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59fbdca4-9e5a-484d-a17d-bfe7f41b4860", "tag": "20e5487f-b0e6-40bc-a8f6-4f47e6af7f78"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:38.458050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-718f0148-9126-4dec-9c42-9c2d03292332 req-8c9be3f5-54e1-4af4-9aae-31e3a03f39f6 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:38.458550 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-718f0148-9126-4dec-9c42-9c2d03292332 req-8c9be3f5-54e1-4af4-9aae-31e3a03f39f6 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:38.491375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-718f0148-9126-4dec-9c42-9c2d03292332 req-8c9be3f5-54e1-4af4-9aae-31e3a03f39f6 service nova] Creating event network-changed:20e5487f-b0e6-40bc-a8f6-4f47e6af7f78 for instance 59fbdca4-9e5a-484d-a17d-bfe7f41b4860 on hv-cinder-83694 Apr 07 12:58:38.505787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-718f0148-9126-4dec-9c42-9c2d03292332 req-8c9be3f5-54e1-4af4-9aae-31e3a03f39f6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078489 Apr 07 12:58:38.506696 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 175/346] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:58:38.524341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-edad4f9d-c3b8-4997-bd50-7b5308794722 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:38.525659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-edad4f9d-c3b8-4997-bd50-7b5308794722 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:38.534774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-edad4f9d-c3b8-4997-bd50-7b5308794722 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:38.535488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-edad4f9d-c3b8-4997-bd50-7b5308794722 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:38.537490 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-edad4f9d-c3b8-4997-bd50-7b5308794722 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:38.538176 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-edad4f9d-c3b8-4997-bd50-7b5308794722 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:38.834474 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a94a055f-d666-49e2-9349-40068b62367c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:38.848280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a94a055f-d666-49e2-9349-40068b62367c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 1.087328 Apr 07 12:58:38.850075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 172/347] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:37 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:38.857296 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b4d55728-47b8-4181-ada2-ca6376e9cf4f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:38.858001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b4d55728-47b8-4181-ada2-ca6376e9cf4f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:38.887466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4d55728-47b8-4181-ada2-ca6376e9cf4f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:38.888946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4d55728-47b8-4181-ada2-ca6376e9cf4f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:38.889964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4d55728-47b8-4181-ada2-ca6376e9cf4f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:38.895839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4d55728-47b8-4181-ada2-ca6376e9cf4f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:38.992122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-edad4f9d-c3b8-4997-bd50-7b5308794722 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:39.002857 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-edad4f9d-c3b8-4997-bd50-7b5308794722 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.494933 Apr 07 12:58:39.003779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 176/348] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:38 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:39.022384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-19eddf5e-1f1e-46d0-98c7-a9572fdddc35 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:39.024429 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-19eddf5e-1f1e-46d0-98c7-a9572fdddc35 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:39.046742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-19eddf5e-1f1e-46d0-98c7-a9572fdddc35 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:39.047344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-19eddf5e-1f1e-46d0-98c7-a9572fdddc35 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:39.049105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-19eddf5e-1f1e-46d0-98c7-a9572fdddc35 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:39.049686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-19eddf5e-1f1e-46d0-98c7-a9572fdddc35 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:39.161360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b4d55728-47b8-4181-ada2-ca6376e9cf4f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.309642 Apr 07 12:58:39.162060 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 173/349] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Apr 7 12:58:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-interface => generated 285 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:58:39.192644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4730f601-d593-4bc0-9e10-569811ec1988 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:39.193534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4730f601-d593-4bc0-9e10-569811ec1988 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:39.220466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4730f601-d593-4bc0-9e10-569811ec1988 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:39.221058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4730f601-d593-4bc0-9e10-569811ec1988 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:39.223447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4730f601-d593-4bc0-9e10-569811ec1988 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:39.223964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4730f601-d593-4bc0-9e10-569811ec1988 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:39.533806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-19eddf5e-1f1e-46d0-98c7-a9572fdddc35 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:39.565868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-19eddf5e-1f1e-46d0-98c7-a9572fdddc35 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.557543 Apr 07 12:58:39.569022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 177/350] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:39 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:39.722779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-c6c7cee1-e408-466c-8216-3f21be8e00aa req-9039dc3c-223b-45e0-9b2c-9ffee2147958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926785df-7955-4e58-a0ae-dc896b2b3f2c", "tag": "3f362b45-57dc-4ae2-9d2e-6280d7bf36e2"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:39.731041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4730f601-d593-4bc0-9e10-569811ec1988 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:39.740706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4730f601-d593-4bc0-9e10-569811ec1988 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:39.752661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4730f601-d593-4bc0-9e10-569811ec1988 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:39.753896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4730f601-d593-4bc0-9e10-569811ec1988 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1739 microversion: 2.20 time: 0.586512 Apr 07 12:58:39.761404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-c6c7cee1-e408-466c-8216-3f21be8e00aa req-9039dc3c-223b-45e0-9b2c-9ffee2147958 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:39.764118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-c6c7cee1-e408-466c-8216-3f21be8e00aa req-9039dc3c-223b-45e0-9b2c-9ffee2147958 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:39.775840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 174/351] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:39 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1739 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:39.803724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-c6c7cee1-e408-466c-8216-3f21be8e00aa req-9039dc3c-223b-45e0-9b2c-9ffee2147958 service nova] Creating event network-changed:3f362b45-57dc-4ae2-9d2e-6280d7bf36e2 for instance 926785df-7955-4e58-a0ae-dc896b2b3f2c on hv-cinder-83694 Apr 07 12:58:39.812800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-c6c7cee1-e408-466c-8216-3f21be8e00aa req-9039dc3c-223b-45e0-9b2c-9ffee2147958 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095507 Apr 07 12:58:39.814768 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 178/352] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 12:58:39.867576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e52c8dc4-828c-45d5-8def-6f3f45368349 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:39.868206 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e52c8dc4-828c-45d5-8def-6f3f45368349 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:39.882593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e52c8dc4-828c-45d5-8def-6f3f45368349 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:39.883445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e52c8dc4-828c-45d5-8def-6f3f45368349 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:39.884466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e52c8dc4-828c-45d5-8def-6f3f45368349 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:39.887024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e52c8dc4-828c-45d5-8def-6f3f45368349 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:40.019874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-df37880d-c684-4797-b7c9-20db4dab9b03 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:40.020759 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-df37880d-c684-4797-b7c9-20db4dab9b03 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:40.027540 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df37880d-c684-4797-b7c9-20db4dab9b03 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:40.027990 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df37880d-c684-4797-b7c9-20db4dab9b03 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:40.028789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df37880d-c684-4797-b7c9-20db4dab9b03 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:40.036794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df37880d-c684-4797-b7c9-20db4dab9b03 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:40.214246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-df37880d-c684-4797-b7c9-20db4dab9b03 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:40.225991 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-df37880d-c684-4797-b7c9-20db4dab9b03 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.210832 Apr 07 12:58:40.227142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 179/353] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:40 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:40.243453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e52c8dc4-828c-45d5-8def-6f3f45368349 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:40.252093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e52c8dc4-828c-45d5-8def-6f3f45368349 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.388591 Apr 07 12:58:40.252940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 175/354] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:39 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:40.590970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f5a9996b-baf2-4798-994d-a6c6ce755437 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:40.591341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f5a9996b-baf2-4798-994d-a6c6ce755437 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:40.601478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5a9996b-baf2-4798-994d-a6c6ce755437 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:40.602024 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5a9996b-baf2-4798-994d-a6c6ce755437 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:40.603264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5a9996b-baf2-4798-994d-a6c6ce755437 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:40.604516 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5a9996b-baf2-4798-994d-a6c6ce755437 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:40.776810 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-02f09fc8-d85f-4f82-b57c-f820af6ab37e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:40.777916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-02f09fc8-d85f-4f82-b57c-f820af6ab37e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:40.792735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02f09fc8-d85f-4f82-b57c-f820af6ab37e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:40.793402 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02f09fc8-d85f-4f82-b57c-f820af6ab37e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:40.800200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02f09fc8-d85f-4f82-b57c-f820af6ab37e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:40.800901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02f09fc8-d85f-4f82-b57c-f820af6ab37e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:40.904060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f5a9996b-baf2-4798-994d-a6c6ce755437 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:40.917884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f5a9996b-baf2-4798-994d-a6c6ce755437 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.331131 Apr 07 12:58:40.927097 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 180/355] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:40 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:41.245116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-64d6c898-fa45-4292-a3b9-cd9961916371 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:41.246024 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-64d6c898-fa45-4292-a3b9-cd9961916371 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:41.257358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-64d6c898-fa45-4292-a3b9-cd9961916371 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:41.259087 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-64d6c898-fa45-4292-a3b9-cd9961916371 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:41.270573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-64d6c898-fa45-4292-a3b9-cd9961916371 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:41.271530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-64d6c898-fa45-4292-a3b9-cd9961916371 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:41.316115 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-02f09fc8-d85f-4f82-b57c-f820af6ab37e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:41.327247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-02f09fc8-d85f-4f82-b57c-f820af6ab37e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:41.329173 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-02f09fc8-d85f-4f82-b57c-f820af6ab37e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:41.345957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-02f09fc8-d85f-4f82-b57c-f820af6ab37e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.573184 Apr 07 12:58:41.376526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 176/356] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:40 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:58:41.385758 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-127cf7e5-c7e0-40fa-9557-2682a0b6af19 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:41.386387 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-127cf7e5-c7e0-40fa-9557-2682a0b6af19 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:41.409308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-127cf7e5-c7e0-40fa-9557-2682a0b6af19 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:41.409760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-127cf7e5-c7e0-40fa-9557-2682a0b6af19 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:41.410558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-127cf7e5-c7e0-40fa-9557-2682a0b6af19 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:41.411001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-127cf7e5-c7e0-40fa-9557-2682a0b6af19 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:41.571059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-64d6c898-fa45-4292-a3b9-cd9961916371 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:41.583690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-64d6c898-fa45-4292-a3b9-cd9961916371 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.343214 Apr 07 12:58:41.584352 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 181/357] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:41 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:41.786727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-127cf7e5-c7e0-40fa-9557-2682a0b6af19 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:41.795320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-127cf7e5-c7e0-40fa-9557-2682a0b6af19 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.417783 Apr 07 12:58:41.798842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 177/358] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:41 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:41.846679 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-14559a0e-4b33-4015-9ed7-aadc71a058ec req-f8f9faa4-96dc-4574-af02-a26e879bbdfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2c5542-86c5-4fe4-9287-ed9dc322b189", "tag": "01b94e44-6b83-4805-bf7a-8c07a6310174"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:41.867224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-14559a0e-4b33-4015-9ed7-aadc71a058ec req-f8f9faa4-96dc-4574-af02-a26e879bbdfd service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:41.867614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-14559a0e-4b33-4015-9ed7-aadc71a058ec req-f8f9faa4-96dc-4574-af02-a26e879bbdfd service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:41.890705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-14559a0e-4b33-4015-9ed7-aadc71a058ec req-f8f9faa4-96dc-4574-af02-a26e879bbdfd service nova] Creating event network-changed:01b94e44-6b83-4805-bf7a-8c07a6310174 for instance 1c2c5542-86c5-4fe4-9287-ed9dc322b189 on hv-cinder-83694 Apr 07 12:58:41.896577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-14559a0e-4b33-4015-9ed7-aadc71a058ec req-f8f9faa4-96dc-4574-af02-a26e879bbdfd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054925 Apr 07 12:58:41.897183 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 182/359] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:58:41.942081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0bfd78f6-af30-4e12-a8a7-93171b8b6fee tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:41.942840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0bfd78f6-af30-4e12-a8a7-93171b8b6fee tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:41.950785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0bfd78f6-af30-4e12-a8a7-93171b8b6fee tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:41.951910 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0bfd78f6-af30-4e12-a8a7-93171b8b6fee tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:41.952950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0bfd78f6-af30-4e12-a8a7-93171b8b6fee tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:41.953704 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0bfd78f6-af30-4e12-a8a7-93171b8b6fee tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:42.201743 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0bfd78f6-af30-4e12-a8a7-93171b8b6fee tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:42.216754 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0bfd78f6-af30-4e12-a8a7-93171b8b6fee tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.280333 Apr 07 12:58:42.225907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 178/360] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:41 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:42.373990 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3b7295df-28a7-4bee-ab4f-95cb4113e1df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:42.374860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3b7295df-28a7-4bee-ab4f-95cb4113e1df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:42.390349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3b7295df-28a7-4bee-ab4f-95cb4113e1df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:42.390349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3b7295df-28a7-4bee-ab4f-95cb4113e1df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:42.390349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3b7295df-28a7-4bee-ab4f-95cb4113e1df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:42.390349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3b7295df-28a7-4bee-ab4f-95cb4113e1df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:42.604928 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-798aeec2-0667-4fff-ba45-51fac99e6154 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:42.606177 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-798aeec2-0667-4fff-ba45-51fac99e6154 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:42.628471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-798aeec2-0667-4fff-ba45-51fac99e6154 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:42.628897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-798aeec2-0667-4fff-ba45-51fac99e6154 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:42.630045 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-798aeec2-0667-4fff-ba45-51fac99e6154 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:42.630637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-798aeec2-0667-4fff-ba45-51fac99e6154 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:42.651140 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3b7295df-28a7-4bee-ab4f-95cb4113e1df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:42.674548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3b7295df-28a7-4bee-ab4f-95cb4113e1df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:42.676332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3b7295df-28a7-4bee-ab4f-95cb4113e1df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:42.677519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3b7295df-28a7-4bee-ab4f-95cb4113e1df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.308162 Apr 07 12:58:42.678430 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 183/361] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:42 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:42.815749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b48ad63f-a876-4553-92e9-23244cb61600 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:42.816622 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b48ad63f-a876-4553-92e9-23244cb61600 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:42.846232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b48ad63f-a876-4553-92e9-23244cb61600 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:42.846759 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b48ad63f-a876-4553-92e9-23244cb61600 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:42.847586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b48ad63f-a876-4553-92e9-23244cb61600 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:42.860435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b48ad63f-a876-4553-92e9-23244cb61600 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:42.948658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-798aeec2-0667-4fff-ba45-51fac99e6154 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:42.958221 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-798aeec2-0667-4fff-ba45-51fac99e6154 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.358220 Apr 07 12:58:42.967274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 179/362] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:42 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:43.187366 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b48ad63f-a876-4553-92e9-23244cb61600 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:43.195279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b48ad63f-a876-4553-92e9-23244cb61600 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.384305 Apr 07 12:58:43.207412 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 184/363] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:42 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:43.241168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8fece35f-9436-41a6-9f04-1b83f694f87b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:43.241789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8fece35f-9436-41a6-9f04-1b83f694f87b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:43.259261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fece35f-9436-41a6-9f04-1b83f694f87b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:43.259703 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fece35f-9436-41a6-9f04-1b83f694f87b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:43.265105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fece35f-9436-41a6-9f04-1b83f694f87b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:43.265573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fece35f-9436-41a6-9f04-1b83f694f87b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:43.359625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-942af558-5295-4829-8225-ce0de8a4dfc9 req-3a3ec68a-b89f-4595-b05a-3ffaa245dd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fbdca4-9e5a-484d-a17d-bfe7f41b4860", "name": "network-vif-plugged", "status": "completed", "tag": "20e5487f-b0e6-40bc-a8f6-4f47e6af7f78"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:43.377216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-942af558-5295-4829-8225-ce0de8a4dfc9 req-3a3ec68a-b89f-4595-b05a-3ffaa245dd25 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:43.379789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-942af558-5295-4829-8225-ce0de8a4dfc9 req-3a3ec68a-b89f-4595-b05a-3ffaa245dd25 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:43.403423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-942af558-5295-4829-8225-ce0de8a4dfc9 req-3a3ec68a-b89f-4595-b05a-3ffaa245dd25 service nova] Creating event network-vif-plugged:20e5487f-b0e6-40bc-a8f6-4f47e6af7f78 for instance 59fbdca4-9e5a-484d-a17d-bfe7f41b4860 on hv-cinder-83694 Apr 07 12:58:43.423468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-942af558-5295-4829-8225-ce0de8a4dfc9 req-3a3ec68a-b89f-4595-b05a-3ffaa245dd25 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067669 Apr 07 12:58:43.424806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 185/364] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:58:43.596659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8fece35f-9436-41a6-9f04-1b83f694f87b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:43.608506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8fece35f-9436-41a6-9f04-1b83f694f87b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.376316 Apr 07 12:58:43.611093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 180/365] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:43 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:43.697080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d592bf65-1572-47c0-8abe-a79d8a65d2a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:43.698050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d592bf65-1572-47c0-8abe-a79d8a65d2a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:43.705575 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d592bf65-1572-47c0-8abe-a79d8a65d2a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:43.706028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d592bf65-1572-47c0-8abe-a79d8a65d2a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:43.706801 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d592bf65-1572-47c0-8abe-a79d8a65d2a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:43.707233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d592bf65-1572-47c0-8abe-a79d8a65d2a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:43.957222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d592bf65-1572-47c0-8abe-a79d8a65d2a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:43.965459 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d592bf65-1572-47c0-8abe-a79d8a65d2a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:43.967422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d592bf65-1572-47c0-8abe-a79d8a65d2a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:43.968653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d592bf65-1572-47c0-8abe-a79d8a65d2a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.276418 Apr 07 12:58:43.969339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 186/366] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:43 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:43.976013 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9091b0f8-3b2e-4821-acb1-d0a4dd007da8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:43.976690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9091b0f8-3b2e-4821-acb1-d0a4dd007da8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:43.983114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9091b0f8-3b2e-4821-acb1-d0a4dd007da8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:43.983827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9091b0f8-3b2e-4821-acb1-d0a4dd007da8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:43.984862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9091b0f8-3b2e-4821-acb1-d0a4dd007da8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:43.985457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9091b0f8-3b2e-4821-acb1-d0a4dd007da8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:44.129118 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9091b0f8-3b2e-4821-acb1-d0a4dd007da8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:44.136641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9091b0f8-3b2e-4821-acb1-d0a4dd007da8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.164941 Apr 07 12:58:44.137441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 181/367] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:43 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:44.213150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-824bab82-50fb-46e9-9586-d70c695136c2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:44.214143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-824bab82-50fb-46e9-9586-d70c695136c2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:44.227943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-824bab82-50fb-46e9-9586-d70c695136c2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:44.228810 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-824bab82-50fb-46e9-9586-d70c695136c2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:44.229879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-824bab82-50fb-46e9-9586-d70c695136c2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:44.230806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-824bab82-50fb-46e9-9586-d70c695136c2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:44.385795 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-824bab82-50fb-46e9-9586-d70c695136c2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:44.397690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-824bab82-50fb-46e9-9586-d70c695136c2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.184840 Apr 07 12:58:44.398621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 187/368] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:44 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:44.632259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d6f77f97-fad4-4b72-b601-7f02dfecc2b3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:44.633837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d6f77f97-fad4-4b72-b601-7f02dfecc2b3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:44.640097 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6f77f97-fad4-4b72-b601-7f02dfecc2b3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:44.640829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6f77f97-fad4-4b72-b601-7f02dfecc2b3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:44.641797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6f77f97-fad4-4b72-b601-7f02dfecc2b3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:44.642235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6f77f97-fad4-4b72-b601-7f02dfecc2b3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:44.812627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d6f77f97-fad4-4b72-b601-7f02dfecc2b3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:44.820626 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d6f77f97-fad4-4b72-b601-7f02dfecc2b3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.197415 Apr 07 12:58:44.821191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 182/369] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:44 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:44.987708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-134d21b9-fec2-4542-8679-4dd9fc92df0d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:44.988347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-134d21b9-fec2-4542-8679-4dd9fc92df0d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:44.994690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-134d21b9-fec2-4542-8679-4dd9fc92df0d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:44.995199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-134d21b9-fec2-4542-8679-4dd9fc92df0d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:44.996019 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-134d21b9-fec2-4542-8679-4dd9fc92df0d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:44.996715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-134d21b9-fec2-4542-8679-4dd9fc92df0d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:45.154493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0564b14f-6c39-4e59-bf93-45ea31050229 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:45.156130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0564b14f-6c39-4e59-bf93-45ea31050229 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:45.163960 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0564b14f-6c39-4e59-bf93-45ea31050229 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:45.164440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0564b14f-6c39-4e59-bf93-45ea31050229 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:45.169002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0564b14f-6c39-4e59-bf93-45ea31050229 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:45.169461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0564b14f-6c39-4e59-bf93-45ea31050229 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:45.223860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-134d21b9-fec2-4542-8679-4dd9fc92df0d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:45.243112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-134d21b9-fec2-4542-8679-4dd9fc92df0d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:45.244670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-134d21b9-fec2-4542-8679-4dd9fc92df0d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:45.245828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-134d21b9-fec2-4542-8679-4dd9fc92df0d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.262964 Apr 07 12:58:45.258762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 188/370] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:44 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:45.418702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0f4a4a35-c201-4401-91fb-45ad2b1415fe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:45.419508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0f4a4a35-c201-4401-91fb-45ad2b1415fe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:45.426279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0564b14f-6c39-4e59-bf93-45ea31050229 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:45.429503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f4a4a35-c201-4401-91fb-45ad2b1415fe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:45.431816 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f4a4a35-c201-4401-91fb-45ad2b1415fe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:45.434032 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f4a4a35-c201-4401-91fb-45ad2b1415fe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:45.434728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f4a4a35-c201-4401-91fb-45ad2b1415fe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:45.450376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0564b14f-6c39-4e59-bf93-45ea31050229 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.299860 Apr 07 12:58:45.451177 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 183/371] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:45 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:45.475111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-930347ee-d0cc-403c-8175-6dabcac1357b req-87f0e776-2704-415c-98b7-c3335274471c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c9a464-496a-4aa9-80dd-f9ec66f515ae", "name": "network-vif-unplugged", "status": "completed", "tag": "b25fac27-5301-4311-8e84-5721b8cac04c"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:45.491200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-930347ee-d0cc-403c-8175-6dabcac1357b req-87f0e776-2704-415c-98b7-c3335274471c service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:45.491933 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-930347ee-d0cc-403c-8175-6dabcac1357b req-87f0e776-2704-415c-98b7-c3335274471c service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:45.528888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-930347ee-d0cc-403c-8175-6dabcac1357b req-87f0e776-2704-415c-98b7-c3335274471c service nova] Creating event network-vif-unplugged:b25fac27-5301-4311-8e84-5721b8cac04c for instance 58c9a464-496a-4aa9-80dd-f9ec66f515ae on hv-cinder-83694 Apr 07 12:58:45.535171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-930347ee-d0cc-403c-8175-6dabcac1357b req-87f0e776-2704-415c-98b7-c3335274471c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064347 Apr 07 12:58:45.535931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 184/372] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:58:45.636431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0f4a4a35-c201-4401-91fb-45ad2b1415fe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:45.647339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0f4a4a35-c201-4401-91fb-45ad2b1415fe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.233826 Apr 07 12:58:45.649108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 189/373] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:45 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:45.837404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b3ceb242-d67d-4222-9ccf-fbf205be2123 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:45.838325 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b3ceb242-d67d-4222-9ccf-fbf205be2123 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:45.847344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3ceb242-d67d-4222-9ccf-fbf205be2123 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:45.848412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3ceb242-d67d-4222-9ccf-fbf205be2123 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:45.849960 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3ceb242-d67d-4222-9ccf-fbf205be2123 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:45.850753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3ceb242-d67d-4222-9ccf-fbf205be2123 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:46.002768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b3ceb242-d67d-4222-9ccf-fbf205be2123 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:46.011324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b3ceb242-d67d-4222-9ccf-fbf205be2123 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.178691 Apr 07 12:58:46.016455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 185/374] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:45 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:46.264836 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a2455c4f-16f7-4400-9deb-4070a0c3ffbc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:46.265576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a2455c4f-16f7-4400-9deb-4070a0c3ffbc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:46.273968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a2455c4f-16f7-4400-9deb-4070a0c3ffbc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:46.274421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a2455c4f-16f7-4400-9deb-4070a0c3ffbc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:46.275201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a2455c4f-16f7-4400-9deb-4070a0c3ffbc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:46.275680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a2455c4f-16f7-4400-9deb-4070a0c3ffbc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:46.443452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a2455c4f-16f7-4400-9deb-4070a0c3ffbc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:46.452715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a2455c4f-16f7-4400-9deb-4070a0c3ffbc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:46.456052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a2455c4f-16f7-4400-9deb-4070a0c3ffbc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:46.457352 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a2455c4f-16f7-4400-9deb-4070a0c3ffbc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.196553 Apr 07 12:58:46.467708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 190/375] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:46 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:46.467928 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4c263cb6-f8e7-42e3-a996-cbd12922f1a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:46.467928 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4c263cb6-f8e7-42e3-a996-cbd12922f1a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:46.474160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c263cb6-f8e7-42e3-a996-cbd12922f1a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:46.474612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c263cb6-f8e7-42e3-a996-cbd12922f1a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:46.475575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c263cb6-f8e7-42e3-a996-cbd12922f1a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:46.476013 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c263cb6-f8e7-42e3-a996-cbd12922f1a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:46.648010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4c263cb6-f8e7-42e3-a996-cbd12922f1a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:46.658048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4c263cb6-f8e7-42e3-a996-cbd12922f1a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.195174 Apr 07 12:58:46.666589 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9a5db542-ae0f-47cb-9b8f-0c518ba8aea5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:46.667618 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9a5db542-ae0f-47cb-9b8f-0c518ba8aea5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:46.668424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 186/376] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:46 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:46.677108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a5db542-ae0f-47cb-9b8f-0c518ba8aea5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:46.677722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a5db542-ae0f-47cb-9b8f-0c518ba8aea5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:46.678717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a5db542-ae0f-47cb-9b8f-0c518ba8aea5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:46.679310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a5db542-ae0f-47cb-9b8f-0c518ba8aea5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:46.891457 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9a5db542-ae0f-47cb-9b8f-0c518ba8aea5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:46.898700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9a5db542-ae0f-47cb-9b8f-0c518ba8aea5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.237749 Apr 07 12:58:46.899263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 191/377] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:46 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:47.030343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a225bf20-e95f-42e3-a7c9-b232af794f38 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:47.032424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a225bf20-e95f-42e3-a7c9-b232af794f38 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:47.038757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a225bf20-e95f-42e3-a7c9-b232af794f38 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:47.039204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a225bf20-e95f-42e3-a7c9-b232af794f38 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:47.039982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a225bf20-e95f-42e3-a7c9-b232af794f38 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:47.040444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a225bf20-e95f-42e3-a7c9-b232af794f38 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:47.189179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a225bf20-e95f-42e3-a7c9-b232af794f38 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:47.197188 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a225bf20-e95f-42e3-a7c9-b232af794f38 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.171039 Apr 07 12:58:47.197752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 187/378] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:47 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:47.478587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-081e7656-f197-4233-a2e3-79d88e101e3a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:47.479220 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-081e7656-f197-4233-a2e3-79d88e101e3a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:47.486448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-081e7656-f197-4233-a2e3-79d88e101e3a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:47.486937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-081e7656-f197-4233-a2e3-79d88e101e3a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:47.487793 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-081e7656-f197-4233-a2e3-79d88e101e3a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:47.488340 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-081e7656-f197-4233-a2e3-79d88e101e3a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:47.635847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-081e7656-f197-4233-a2e3-79d88e101e3a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:47.644604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-081e7656-f197-4233-a2e3-79d88e101e3a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:47.646100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-081e7656-f197-4233-a2e3-79d88e101e3a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:47.647276 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-081e7656-f197-4233-a2e3-79d88e101e3a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.172967 Apr 07 12:58:47.647835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 192/379] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:47 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:47.677346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ea473fa4-bc43-438c-ae3d-3b453148f8cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:47.678338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ea473fa4-bc43-438c-ae3d-3b453148f8cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:47.685492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea473fa4-bc43-438c-ae3d-3b453148f8cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:47.686089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea473fa4-bc43-438c-ae3d-3b453148f8cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:47.687277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea473fa4-bc43-438c-ae3d-3b453148f8cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:47.695078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea473fa4-bc43-438c-ae3d-3b453148f8cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:47.841550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ea473fa4-bc43-438c-ae3d-3b453148f8cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:47.855134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ea473fa4-bc43-438c-ae3d-3b453148f8cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.181952 Apr 07 12:58:47.856756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 188/380] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:47 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:47.916865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b2815f2a-5f9d-4619-b07e-65b0972a5eb6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:47.917905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b2815f2a-5f9d-4619-b07e-65b0972a5eb6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:47.924574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b2815f2a-5f9d-4619-b07e-65b0972a5eb6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:47.925134 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b2815f2a-5f9d-4619-b07e-65b0972a5eb6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:47.925994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b2815f2a-5f9d-4619-b07e-65b0972a5eb6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:47.926494 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b2815f2a-5f9d-4619-b07e-65b0972a5eb6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:48.079972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b2815f2a-5f9d-4619-b07e-65b0972a5eb6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:48.088255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b2815f2a-5f9d-4619-b07e-65b0972a5eb6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.175714 Apr 07 12:58:48.097155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 193/381] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:47 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:48.215276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9efd5a2e-f6e5-44f8-8eeb-e469bb8bfbb7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:48.215894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9efd5a2e-f6e5-44f8-8eeb-e469bb8bfbb7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:48.223057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9efd5a2e-f6e5-44f8-8eeb-e469bb8bfbb7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:48.223516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9efd5a2e-f6e5-44f8-8eeb-e469bb8bfbb7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:48.224335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9efd5a2e-f6e5-44f8-8eeb-e469bb8bfbb7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:48.228319 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9efd5a2e-f6e5-44f8-8eeb-e469bb8bfbb7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:48.398532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9efd5a2e-f6e5-44f8-8eeb-e469bb8bfbb7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:48.407303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9efd5a2e-f6e5-44f8-8eeb-e469bb8bfbb7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.195618 Apr 07 12:58:48.408191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 189/382] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:48 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:48.665898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b34aac18-1c55-43cd-9ca8-1a3587197cfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:48.666488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b34aac18-1c55-43cd-9ca8-1a3587197cfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:48.674066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b34aac18-1c55-43cd-9ca8-1a3587197cfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:48.674552 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b34aac18-1c55-43cd-9ca8-1a3587197cfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:48.678647 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b34aac18-1c55-43cd-9ca8-1a3587197cfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:48.679101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b34aac18-1c55-43cd-9ca8-1a3587197cfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:48.817395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b34aac18-1c55-43cd-9ca8-1a3587197cfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:48.825660 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b34aac18-1c55-43cd-9ca8-1a3587197cfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:48.827207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b34aac18-1c55-43cd-9ca8-1a3587197cfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:48.828942 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b34aac18-1c55-43cd-9ca8-1a3587197cfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.166315 Apr 07 12:58:48.829498 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 194/383] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:48 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:48.874328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3408f98f-b25a-41be-aa49-59469dd311d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:48.874928 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3408f98f-b25a-41be-aa49-59469dd311d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:48.881440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3408f98f-b25a-41be-aa49-59469dd311d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:48.881884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3408f98f-b25a-41be-aa49-59469dd311d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:48.882665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3408f98f-b25a-41be-aa49-59469dd311d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:48.883095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3408f98f-b25a-41be-aa49-59469dd311d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:49.019350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3408f98f-b25a-41be-aa49-59469dd311d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:49.026949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3408f98f-b25a-41be-aa49-59469dd311d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.156502 Apr 07 12:58:49.027511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 190/384] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:48 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:49.105623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-902806e2-d69e-48df-82b8-88fda11b7d4b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:49.106129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-902806e2-d69e-48df-82b8-88fda11b7d4b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:49.113233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-902806e2-d69e-48df-82b8-88fda11b7d4b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:49.113233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-902806e2-d69e-48df-82b8-88fda11b7d4b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:49.113428 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-902806e2-d69e-48df-82b8-88fda11b7d4b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:49.113857 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-902806e2-d69e-48df-82b8-88fda11b7d4b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:49.248125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-902806e2-d69e-48df-82b8-88fda11b7d4b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:49.256539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-902806e2-d69e-48df-82b8-88fda11b7d4b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.154677 Apr 07 12:58:49.257120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 195/385] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:49 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:49.425150 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6dc60c50-203b-47f3-8ece-4c3d4c889530 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:49.425762 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6dc60c50-203b-47f3-8ece-4c3d4c889530 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:49.431622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6dc60c50-203b-47f3-8ece-4c3d4c889530 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:49.432067 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6dc60c50-203b-47f3-8ece-4c3d4c889530 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:49.432861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6dc60c50-203b-47f3-8ece-4c3d4c889530 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:49.433297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6dc60c50-203b-47f3-8ece-4c3d4c889530 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:49.568275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6dc60c50-203b-47f3-8ece-4c3d4c889530 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:49.576315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6dc60c50-203b-47f3-8ece-4c3d4c889530 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.154879 Apr 07 12:58:49.576890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 191/386] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:49 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:49.847794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ae78faf6-5fee-40dd-ad5f-94e2a2a26a05 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:49.848356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ae78faf6-5fee-40dd-ad5f-94e2a2a26a05 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:49.854794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae78faf6-5fee-40dd-ad5f-94e2a2a26a05 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:49.855291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae78faf6-5fee-40dd-ad5f-94e2a2a26a05 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:49.856044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae78faf6-5fee-40dd-ad5f-94e2a2a26a05 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:49.856501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae78faf6-5fee-40dd-ad5f-94e2a2a26a05 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:50.004377 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ae78faf6-5fee-40dd-ad5f-94e2a2a26a05 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:50.012122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ae78faf6-5fee-40dd-ad5f-94e2a2a26a05 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:50.013636 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ae78faf6-5fee-40dd-ad5f-94e2a2a26a05 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:50.014779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ae78faf6-5fee-40dd-ad5f-94e2a2a26a05 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.171552 Apr 07 12:58:50.015325 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 196/387] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:49 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:50.044576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d805a7ca-b7c7-4328-9ecf-5446613c6580 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:50.045190 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d805a7ca-b7c7-4328-9ecf-5446613c6580 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:50.051746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d805a7ca-b7c7-4328-9ecf-5446613c6580 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:50.052221 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d805a7ca-b7c7-4328-9ecf-5446613c6580 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:50.052979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d805a7ca-b7c7-4328-9ecf-5446613c6580 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:50.053412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d805a7ca-b7c7-4328-9ecf-5446613c6580 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:50.190168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d805a7ca-b7c7-4328-9ecf-5446613c6580 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:50.197443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d805a7ca-b7c7-4328-9ecf-5446613c6580 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.156660 Apr 07 12:58:50.198003 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 192/388] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:50 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:50.273175 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5012c216-75a2-450b-af4d-7f9598551a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:50.273788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5012c216-75a2-450b-af4d-7f9598551a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:50.279766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5012c216-75a2-450b-af4d-7f9598551a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:50.280500 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5012c216-75a2-450b-af4d-7f9598551a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:50.281260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5012c216-75a2-450b-af4d-7f9598551a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:50.282269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5012c216-75a2-450b-af4d-7f9598551a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:50.419778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5012c216-75a2-450b-af4d-7f9598551a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:50.427303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5012c216-75a2-450b-af4d-7f9598551a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.157999 Apr 07 12:58:50.427877 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 197/389] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:50 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:50.592797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9751fd5b-1391-4bfa-972c-7503c02bcf1c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:50.593482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9751fd5b-1391-4bfa-972c-7503c02bcf1c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:50.600555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9751fd5b-1391-4bfa-972c-7503c02bcf1c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:50.601000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9751fd5b-1391-4bfa-972c-7503c02bcf1c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:50.601766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9751fd5b-1391-4bfa-972c-7503c02bcf1c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:50.602199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9751fd5b-1391-4bfa-972c-7503c02bcf1c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:50.741544 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9751fd5b-1391-4bfa-972c-7503c02bcf1c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:50.748926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9751fd5b-1391-4bfa-972c-7503c02bcf1c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.159940 Apr 07 12:58:50.749490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 193/390] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:50 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:51.034406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-817a88a2-6ebf-4d6f-9a29-5e4f1336f101 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:51.034943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-817a88a2-6ebf-4d6f-9a29-5e4f1336f101 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:51.041501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-817a88a2-6ebf-4d6f-9a29-5e4f1336f101 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:51.041959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-817a88a2-6ebf-4d6f-9a29-5e4f1336f101 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:51.042728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-817a88a2-6ebf-4d6f-9a29-5e4f1336f101 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:51.043166 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-817a88a2-6ebf-4d6f-9a29-5e4f1336f101 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:51.183006 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-817a88a2-6ebf-4d6f-9a29-5e4f1336f101 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:51.192204 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-817a88a2-6ebf-4d6f-9a29-5e4f1336f101 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:51.193705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-817a88a2-6ebf-4d6f-9a29-5e4f1336f101 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:51.194857 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-817a88a2-6ebf-4d6f-9a29-5e4f1336f101 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.164869 Apr 07 12:58:51.195408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 198/391] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:51 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:51.214629 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8c512c69-e2ca-4f0b-91f6-57e36fc5a7b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:51.215338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8c512c69-e2ca-4f0b-91f6-57e36fc5a7b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:51.221643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8c512c69-e2ca-4f0b-91f6-57e36fc5a7b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:51.222090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8c512c69-e2ca-4f0b-91f6-57e36fc5a7b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:51.222854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8c512c69-e2ca-4f0b-91f6-57e36fc5a7b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:51.223288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8c512c69-e2ca-4f0b-91f6-57e36fc5a7b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:51.358726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8c512c69-e2ca-4f0b-91f6-57e36fc5a7b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:51.366834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8c512c69-e2ca-4f0b-91f6-57e36fc5a7b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.156077 Apr 07 12:58:51.367390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 194/392] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:51 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:51.444587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7b7ca089-9162-4306-9328-a7727f0c9c62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:51.445200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7b7ca089-9162-4306-9328-a7727f0c9c62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:51.450970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b7ca089-9162-4306-9328-a7727f0c9c62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:51.451419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b7ca089-9162-4306-9328-a7727f0c9c62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:51.452211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b7ca089-9162-4306-9328-a7727f0c9c62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:51.452649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b7ca089-9162-4306-9328-a7727f0c9c62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:51.588040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7b7ca089-9162-4306-9328-a7727f0c9c62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:51.596466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7b7ca089-9162-4306-9328-a7727f0c9c62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.155600 Apr 07 12:58:51.597026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 199/393] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:51 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:51.765588 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-21a8ee1e-1f61-4496-b619-5a49fe05c17a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:51.766799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-21a8ee1e-1f61-4496-b619-5a49fe05c17a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:51.772895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21a8ee1e-1f61-4496-b619-5a49fe05c17a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:51.773352 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21a8ee1e-1f61-4496-b619-5a49fe05c17a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:51.774127 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21a8ee1e-1f61-4496-b619-5a49fe05c17a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:51.774567 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21a8ee1e-1f61-4496-b619-5a49fe05c17a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:51.987344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-21a8ee1e-1f61-4496-b619-5a49fe05c17a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:51.995328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-21a8ee1e-1f61-4496-b619-5a49fe05c17a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.233506 Apr 07 12:58:51.995894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 195/394] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:51 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:52.213008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a8ec2262-8045-46be-b920-3a57f2f95cd3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:52.213878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a8ec2262-8045-46be-b920-3a57f2f95cd3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:52.220376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a8ec2262-8045-46be-b920-3a57f2f95cd3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:52.220832 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a8ec2262-8045-46be-b920-3a57f2f95cd3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:52.221597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a8ec2262-8045-46be-b920-3a57f2f95cd3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:52.222033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a8ec2262-8045-46be-b920-3a57f2f95cd3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:52.367227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a8ec2262-8045-46be-b920-3a57f2f95cd3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:52.374851 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a8ec2262-8045-46be-b920-3a57f2f95cd3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:52.376998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a8ec2262-8045-46be-b920-3a57f2f95cd3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:52.378211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a8ec2262-8045-46be-b920-3a57f2f95cd3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.169935 Apr 07 12:58:52.378760 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 200/395] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:52 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:52.384412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4a7430d5-a73e-45b5-accd-c9661e84a3f1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:52.385022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4a7430d5-a73e-45b5-accd-c9661e84a3f1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:52.391446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a7430d5-a73e-45b5-accd-c9661e84a3f1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:52.392032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a7430d5-a73e-45b5-accd-c9661e84a3f1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:52.392756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a7430d5-a73e-45b5-accd-c9661e84a3f1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:52.393192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a7430d5-a73e-45b5-accd-c9661e84a3f1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:52.525274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4a7430d5-a73e-45b5-accd-c9661e84a3f1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:52.533169 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4a7430d5-a73e-45b5-accd-c9661e84a3f1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.152524 Apr 07 12:58:52.533719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 196/396] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:52 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:52.613437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ca662949-f67c-4270-90c5-6bcd79252c71 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:52.614086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ca662949-f67c-4270-90c5-6bcd79252c71 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:52.619905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca662949-f67c-4270-90c5-6bcd79252c71 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:52.620455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca662949-f67c-4270-90c5-6bcd79252c71 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:52.621217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca662949-f67c-4270-90c5-6bcd79252c71 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:52.621650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca662949-f67c-4270-90c5-6bcd79252c71 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:52.753384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ca662949-f67c-4270-90c5-6bcd79252c71 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:52.760592 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ca662949-f67c-4270-90c5-6bcd79252c71 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.151357 Apr 07 12:58:52.761160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 201/397] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:52 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:53.012596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c27dceb1-fb53-4d2b-87c3-709b98bb5d3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:53.013131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c27dceb1-fb53-4d2b-87c3-709b98bb5d3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:53.019025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c27dceb1-fb53-4d2b-87c3-709b98bb5d3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:53.019465 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c27dceb1-fb53-4d2b-87c3-709b98bb5d3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:53.020257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c27dceb1-fb53-4d2b-87c3-709b98bb5d3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:53.020690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c27dceb1-fb53-4d2b-87c3-709b98bb5d3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:53.395507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c27dceb1-fb53-4d2b-87c3-709b98bb5d3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:53.396226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c376a6fe-963b-4831-b7b5-f7d80f2ce451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:53.396870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c376a6fe-963b-4831-b7b5-f7d80f2ce451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:53.402857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c27dceb1-fb53-4d2b-87c3-709b98bb5d3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.394123 Apr 07 12:58:53.403095 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c376a6fe-963b-4831-b7b5-f7d80f2ce451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:53.403442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 197/398] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:53 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:53.403564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c376a6fe-963b-4831-b7b5-f7d80f2ce451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:53.404361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c376a6fe-963b-4831-b7b5-f7d80f2ce451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:53.404795 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c376a6fe-963b-4831-b7b5-f7d80f2ce451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:53.533370 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c376a6fe-963b-4831-b7b5-f7d80f2ce451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:53.541046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c376a6fe-963b-4831-b7b5-f7d80f2ce451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:53.542538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c376a6fe-963b-4831-b7b5-f7d80f2ce451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:53.543696 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c376a6fe-963b-4831-b7b5-f7d80f2ce451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.151673 Apr 07 12:58:53.544658 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 202/399] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:53 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:58:53.549478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ef2cee47-7ec8-4c81-ae75-8d2a4fe9a0c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:53.550084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ef2cee47-7ec8-4c81-ae75-8d2a4fe9a0c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:53.555800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef2cee47-7ec8-4c81-ae75-8d2a4fe9a0c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:53.556287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef2cee47-7ec8-4c81-ae75-8d2a4fe9a0c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:53.557040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef2cee47-7ec8-4c81-ae75-8d2a4fe9a0c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:53.557509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef2cee47-7ec8-4c81-ae75-8d2a4fe9a0c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:53.693784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ef2cee47-7ec8-4c81-ae75-8d2a4fe9a0c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:53.701111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ef2cee47-7ec8-4c81-ae75-8d2a4fe9a0c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.155412 Apr 07 12:58:53.701662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 198/400] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:53 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:53.777147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-76e209ac-79b3-4e67-ba09-2149b190a47b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:53.777761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-76e209ac-79b3-4e67-ba09-2149b190a47b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:53.784000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76e209ac-79b3-4e67-ba09-2149b190a47b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:53.784480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76e209ac-79b3-4e67-ba09-2149b190a47b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:53.785255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76e209ac-79b3-4e67-ba09-2149b190a47b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:53.785702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76e209ac-79b3-4e67-ba09-2149b190a47b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:53.916560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-76e209ac-79b3-4e67-ba09-2149b190a47b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:53.923740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-76e209ac-79b3-4e67-ba09-2149b190a47b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.150353 Apr 07 12:58:53.924326 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 203/401] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:53 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:54.420335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4823fecf-ec08-4c6b-b73b-e50a850745a2 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:54.420941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4823fecf-ec08-4c6b-b73b-e50a850745a2 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:54.427288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4823fecf-ec08-4c6b-b73b-e50a850745a2 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:54.427729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4823fecf-ec08-4c6b-b73b-e50a850745a2 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:54.428512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4823fecf-ec08-4c6b-b73b-e50a850745a2 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:54.428946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4823fecf-ec08-4c6b-b73b-e50a850745a2 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:54.562738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-18395b21-85a3-430e-a664-cc679cd0708f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:54.563443 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-18395b21-85a3-430e-a664-cc679cd0708f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:54.564120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4823fecf-ec08-4c6b-b73b-e50a850745a2 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:54.570093 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-18395b21-85a3-430e-a664-cc679cd0708f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:54.570538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-18395b21-85a3-430e-a664-cc679cd0708f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:54.571316 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-18395b21-85a3-430e-a664-cc679cd0708f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:54.571754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-18395b21-85a3-430e-a664-cc679cd0708f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:54.573257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4823fecf-ec08-4c6b-b73b-e50a850745a2 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.156165 Apr 07 12:58:54.574792 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 199/402] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:54 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:54.706307 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-18395b21-85a3-430e-a664-cc679cd0708f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:54.714349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-18395b21-85a3-430e-a664-cc679cd0708f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:54.715854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-18395b21-85a3-430e-a664-cc679cd0708f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:54.717048 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-18395b21-85a3-430e-a664-cc679cd0708f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.158294 Apr 07 12:58:54.717766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 204/403] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:54 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:58:54.718310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0b9a4a66-52a7-4899-8229-94eb32b852a4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:54.718981 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0b9a4a66-52a7-4899-8229-94eb32b852a4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:54.725256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0b9a4a66-52a7-4899-8229-94eb32b852a4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:54.725922 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0b9a4a66-52a7-4899-8229-94eb32b852a4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:54.726841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0b9a4a66-52a7-4899-8229-94eb32b852a4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:54.727422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0b9a4a66-52a7-4899-8229-94eb32b852a4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:54.862584 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0b9a4a66-52a7-4899-8229-94eb32b852a4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:54.869852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0b9a4a66-52a7-4899-8229-94eb32b852a4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.155360 Apr 07 12:58:54.870413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 200/404] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:54 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:58:54.941221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4ad3b4e4-2c52-4270-a175-9bb6ca244930 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:54.941831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4ad3b4e4-2c52-4270-a175-9bb6ca244930 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:54.947821 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ad3b4e4-2c52-4270-a175-9bb6ca244930 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:54.948301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ad3b4e4-2c52-4270-a175-9bb6ca244930 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:54.949059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ad3b4e4-2c52-4270-a175-9bb6ca244930 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:54.949492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ad3b4e4-2c52-4270-a175-9bb6ca244930 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:55.083705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4ad3b4e4-2c52-4270-a175-9bb6ca244930 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:55.090869 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4ad3b4e4-2c52-4270-a175-9bb6ca244930 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.154168 Apr 07 12:58:55.091426 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 205/405] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:54 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:55.590472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e6412b52-1df1-46f7-b978-0a3669895c3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:55.597171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e6412b52-1df1-46f7-b978-0a3669895c3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:55.611941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e6412b52-1df1-46f7-b978-0a3669895c3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:55.613627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e6412b52-1df1-46f7-b978-0a3669895c3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:55.614930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e6412b52-1df1-46f7-b978-0a3669895c3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:55.615763 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e6412b52-1df1-46f7-b978-0a3669895c3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:55.735559 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-48a00131-e0f9-44fe-b0bd-014faf1cdf2b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:55.736828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-48a00131-e0f9-44fe-b0bd-014faf1cdf2b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:55.757418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48a00131-e0f9-44fe-b0bd-014faf1cdf2b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:55.757880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48a00131-e0f9-44fe-b0bd-014faf1cdf2b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:55.758687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48a00131-e0f9-44fe-b0bd-014faf1cdf2b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:55.759132 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48a00131-e0f9-44fe-b0bd-014faf1cdf2b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:55.938850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e6412b52-1df1-46f7-b978-0a3669895c3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:55.946424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e6412b52-1df1-46f7-b978-0a3669895c3b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.360149 Apr 07 12:58:55.956569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 201/406] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:55 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:55.956569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-189647bf-31e8-44a0-aa36-f0c7bb6cb686 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:55.956569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-189647bf-31e8-44a0-aa36-f0c7bb6cb686 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:55.961599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-189647bf-31e8-44a0-aa36-f0c7bb6cb686 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:55.962245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-189647bf-31e8-44a0-aa36-f0c7bb6cb686 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:55.963110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-189647bf-31e8-44a0-aa36-f0c7bb6cb686 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:55.963612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-189647bf-31e8-44a0-aa36-f0c7bb6cb686 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:56.150703 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-189647bf-31e8-44a0-aa36-f0c7bb6cb686 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:56.159231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-189647bf-31e8-44a0-aa36-f0c7bb6cb686 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.209838 Apr 07 12:58:56.159918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 202/407] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:55 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:56.164913 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-51306661-7cc0-411f-93ea-188eddd7d6cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:56.165793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-51306661-7cc0-411f-93ea-188eddd7d6cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:56.172211 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51306661-7cc0-411f-93ea-188eddd7d6cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:56.172998 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51306661-7cc0-411f-93ea-188eddd7d6cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:56.174165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51306661-7cc0-411f-93ea-188eddd7d6cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:56.174816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51306661-7cc0-411f-93ea-188eddd7d6cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:56.375885 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-48a00131-e0f9-44fe-b0bd-014faf1cdf2b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:56.386684 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-48a00131-e0f9-44fe-b0bd-014faf1cdf2b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:56.389379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-48a00131-e0f9-44fe-b0bd-014faf1cdf2b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:56.392029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-48a00131-e0f9-44fe-b0bd-014faf1cdf2b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.661199 Apr 07 12:58:56.392833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 206/408] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:55 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:58:56.422659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-51306661-7cc0-411f-93ea-188eddd7d6cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:56.429897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-51306661-7cc0-411f-93ea-188eddd7d6cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.268706 Apr 07 12:58:56.430464 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 203/409] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:56 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:56.964035 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ff8eb3ef-7c5b-4f0e-830e-d53589c4e9a5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:56.966136 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ff8eb3ef-7c5b-4f0e-830e-d53589c4e9a5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:56.974809 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff8eb3ef-7c5b-4f0e-830e-d53589c4e9a5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:56.975416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff8eb3ef-7c5b-4f0e-830e-d53589c4e9a5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:56.976479 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff8eb3ef-7c5b-4f0e-830e-d53589c4e9a5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:56.977046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff8eb3ef-7c5b-4f0e-830e-d53589c4e9a5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:57.117823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ff8eb3ef-7c5b-4f0e-830e-d53589c4e9a5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:57.127924 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ff8eb3ef-7c5b-4f0e-830e-d53589c4e9a5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.167701 Apr 07 12:58:57.128525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 207/410] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:56 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:57.176320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-95dcf3dc-0b70-4ffc-aa99-4c13d9da3fc5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:57.177287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-95dcf3dc-0b70-4ffc-aa99-4c13d9da3fc5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:57.185278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-95dcf3dc-0b70-4ffc-aa99-4c13d9da3fc5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:57.185740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-95dcf3dc-0b70-4ffc-aa99-4c13d9da3fc5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:57.186513 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-95dcf3dc-0b70-4ffc-aa99-4c13d9da3fc5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:57.186953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-95dcf3dc-0b70-4ffc-aa99-4c13d9da3fc5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:57.327178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-95dcf3dc-0b70-4ffc-aa99-4c13d9da3fc5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:57.335531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-95dcf3dc-0b70-4ffc-aa99-4c13d9da3fc5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.163448 Apr 07 12:58:57.336108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 204/411] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:57 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:57.411430 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b7db98da-3f1d-4902-ac97-42e61c19d667 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:57.412068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b7db98da-3f1d-4902-ac97-42e61c19d667 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:57.418181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7db98da-3f1d-4902-ac97-42e61c19d667 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:57.418641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7db98da-3f1d-4902-ac97-42e61c19d667 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:57.419412 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7db98da-3f1d-4902-ac97-42e61c19d667 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:57.419848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7db98da-3f1d-4902-ac97-42e61c19d667 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:57.446673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-62be9673-ff49-4a0c-95cd-e00d0c880934 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:57.447270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-62be9673-ff49-4a0c-95cd-e00d0c880934 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:57.454199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62be9673-ff49-4a0c-95cd-e00d0c880934 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:57.454647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62be9673-ff49-4a0c-95cd-e00d0c880934 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:57.455436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62be9673-ff49-4a0c-95cd-e00d0c880934 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:57.455865 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62be9673-ff49-4a0c-95cd-e00d0c880934 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:57.582331 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b7db98da-3f1d-4902-ac97-42e61c19d667 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:57.598017 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b7db98da-3f1d-4902-ac97-42e61c19d667 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:57.599518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b7db98da-3f1d-4902-ac97-42e61c19d667 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:57.602266 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b7db98da-3f1d-4902-ac97-42e61c19d667 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.193387 Apr 07 12:58:57.602947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 208/412] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:57 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:57.603413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-62be9673-ff49-4a0c-95cd-e00d0c880934 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:57.612050 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-62be9673-ff49-4a0c-95cd-e00d0c880934 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.169074 Apr 07 12:58:57.612669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 205/413] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:57 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:58.144169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2b0bc1dd-d5b3-419a-975c-822395926cd1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:58.144705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2b0bc1dd-d5b3-419a-975c-822395926cd1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:58.150915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2b0bc1dd-d5b3-419a-975c-822395926cd1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:58.151360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2b0bc1dd-d5b3-419a-975c-822395926cd1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:58.152110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2b0bc1dd-d5b3-419a-975c-822395926cd1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:58.152569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2b0bc1dd-d5b3-419a-975c-822395926cd1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:58.284449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2b0bc1dd-d5b3-419a-975c-822395926cd1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:58.291624 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2b0bc1dd-d5b3-419a-975c-822395926cd1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.151553 Apr 07 12:58:58.292201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 209/414] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:58 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:58.352785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-17fe2f08-9ef0-4cac-8f3e-903ac12b782f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:58.353400 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-17fe2f08-9ef0-4cac-8f3e-903ac12b782f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:58.359402 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-17fe2f08-9ef0-4cac-8f3e-903ac12b782f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:58.359853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-17fe2f08-9ef0-4cac-8f3e-903ac12b782f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:58.361360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-17fe2f08-9ef0-4cac-8f3e-903ac12b782f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:58.361790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-17fe2f08-9ef0-4cac-8f3e-903ac12b782f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:58.495253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-17fe2f08-9ef0-4cac-8f3e-903ac12b782f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:58.503497 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-17fe2f08-9ef0-4cac-8f3e-903ac12b782f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.154531 Apr 07 12:58:58.504058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 206/415] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:58 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:58.621143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-64a3b0eb-2484-4714-a90f-6e844c64fbf2 req-1d6db084-b192-4dce-bc4e-d9cf51a74211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb36ce2a-6233-4601-85c0-35c550476cea", "name": "network-vif-plugged", "status": "completed", "tag": "1d264377-61da-43aa-ba85-52dd323d34d8"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:58:58.623550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3f12a490-72bd-4c82-abaf-379e37ba0a47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:58.624288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3f12a490-72bd-4c82-abaf-379e37ba0a47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:58.630997 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f12a490-72bd-4c82-abaf-379e37ba0a47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:58.631180 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-64a3b0eb-2484-4714-a90f-6e844c64fbf2 req-1d6db084-b192-4dce-bc4e-d9cf51a74211 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:58.631537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f12a490-72bd-4c82-abaf-379e37ba0a47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:58.631635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-64a3b0eb-2484-4714-a90f-6e844c64fbf2 req-1d6db084-b192-4dce-bc4e-d9cf51a74211 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:58.633639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f12a490-72bd-4c82-abaf-379e37ba0a47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:58.633639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f12a490-72bd-4c82-abaf-379e37ba0a47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:58.644701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-64a3b0eb-2484-4714-a90f-6e844c64fbf2 req-1d6db084-b192-4dce-bc4e-d9cf51a74211 service nova] Creating event network-vif-plugged:1d264377-61da-43aa-ba85-52dd323d34d8 for instance cb36ce2a-6233-4601-85c0-35c550476cea on hv-cinder-83694 Apr 07 12:58:58.649662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-64a3b0eb-2484-4714-a90f-6e844c64fbf2 req-1d6db084-b192-4dce-bc4e-d9cf51a74211 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032148 Apr 07 12:58:58.650489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 210/416] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 12:58:58.657607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-57aa9602-ad5e-4e70-9f85-8e0ebf082515 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:58.657607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-57aa9602-ad5e-4e70-9f85-8e0ebf082515 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:58.664296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57aa9602-ad5e-4e70-9f85-8e0ebf082515 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:58.664514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57aa9602-ad5e-4e70-9f85-8e0ebf082515 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:58.665116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57aa9602-ad5e-4e70-9f85-8e0ebf082515 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:58.665948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57aa9602-ad5e-4e70-9f85-8e0ebf082515 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:58.783661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3f12a490-72bd-4c82-abaf-379e37ba0a47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:58.791564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3f12a490-72bd-4c82-abaf-379e37ba0a47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:58.793240 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3f12a490-72bd-4c82-abaf-379e37ba0a47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:58.794505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3f12a490-72bd-4c82-abaf-379e37ba0a47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.174917 Apr 07 12:58:58.795044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 207/417] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:58 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:58:58.807818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-57aa9602-ad5e-4e70-9f85-8e0ebf082515 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:58.815394 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-57aa9602-ad5e-4e70-9f85-8e0ebf082515 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.164094 Apr 07 12:58:58.815946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 211/418] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:58 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:59.308797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b13fc598-cd59-4426-b32d-f2a020d9c4e9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:59.309296 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b13fc598-cd59-4426-b32d-f2a020d9c4e9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:59.315144 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b13fc598-cd59-4426-b32d-f2a020d9c4e9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:59.315586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b13fc598-cd59-4426-b32d-f2a020d9c4e9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:59.316375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b13fc598-cd59-4426-b32d-f2a020d9c4e9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:59.316804 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b13fc598-cd59-4426-b32d-f2a020d9c4e9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:59.450278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b13fc598-cd59-4426-b32d-f2a020d9c4e9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:59.458093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b13fc598-cd59-4426-b32d-f2a020d9c4e9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.153211 Apr 07 12:58:59.458648 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 208/419] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:59 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:59.520423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eb41fa32-4f74-425d-8c44-c67151225286 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:59.521085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-eb41fa32-4f74-425d-8c44-c67151225286 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:59.527458 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb41fa32-4f74-425d-8c44-c67151225286 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:59.527909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb41fa32-4f74-425d-8c44-c67151225286 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:59.528711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb41fa32-4f74-425d-8c44-c67151225286 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:59.529150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb41fa32-4f74-425d-8c44-c67151225286 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:59.661798 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eb41fa32-4f74-425d-8c44-c67151225286 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:59.668957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eb41fa32-4f74-425d-8c44-c67151225286 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.152904 Apr 07 12:58:59.669517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 212/420] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:59 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:58:59.813399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5e16b9a2-a5e3-438c-91b5-02d9673bb5a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:59.814574 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5e16b9a2-a5e3-438c-91b5-02d9673bb5a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:59.820425 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e16b9a2-a5e3-438c-91b5-02d9673bb5a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:59.820866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e16b9a2-a5e3-438c-91b5-02d9673bb5a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:59.821617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e16b9a2-a5e3-438c-91b5-02d9673bb5a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:59.822043 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e16b9a2-a5e3-438c-91b5-02d9673bb5a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:59.832553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-88e2c2cd-fe3c-4f18-957d-91163659a15f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:58:59.833171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-88e2c2cd-fe3c-4f18-957d-91163659a15f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:58:59.839039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-88e2c2cd-fe3c-4f18-957d-91163659a15f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:59.839436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-88e2c2cd-fe3c-4f18-957d-91163659a15f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:59.840232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-88e2c2cd-fe3c-4f18-957d-91163659a15f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:58:59.840791 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-88e2c2cd-fe3c-4f18-957d-91163659a15f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:58:59.958565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5e16b9a2-a5e3-438c-91b5-02d9673bb5a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:59.966710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5e16b9a2-a5e3-438c-91b5-02d9673bb5a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:59.968237 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5e16b9a2-a5e3-438c-91b5-02d9673bb5a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:59.969914 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5e16b9a2-a5e3-438c-91b5-02d9673bb5a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.160266 Apr 07 12:58:59.970884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 209/421] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:58:59 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:58:59.983616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-88e2c2cd-fe3c-4f18-957d-91163659a15f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:58:59.992039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-88e2c2cd-fe3c-4f18-957d-91163659a15f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.163882 Apr 07 12:58:59.992560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 213/422] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:58:59 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:59:00.474882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e572eff4-e5df-487f-aadf-b2e0aeee904d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:00.475421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e572eff4-e5df-487f-aadf-b2e0aeee904d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:00.481383 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e572eff4-e5df-487f-aadf-b2e0aeee904d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:00.481831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e572eff4-e5df-487f-aadf-b2e0aeee904d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:00.482591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e572eff4-e5df-487f-aadf-b2e0aeee904d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:00.483024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e572eff4-e5df-487f-aadf-b2e0aeee904d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:00.619193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e572eff4-e5df-487f-aadf-b2e0aeee904d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:00.627159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e572eff4-e5df-487f-aadf-b2e0aeee904d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.156132 Apr 07 12:59:00.627721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 210/423] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:00 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:00.685596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c2c22fa9-cb08-48b6-b1e7-505e20876a04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:00.686211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c2c22fa9-cb08-48b6-b1e7-505e20876a04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:00.693158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c2c22fa9-cb08-48b6-b1e7-505e20876a04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:00.693614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c2c22fa9-cb08-48b6-b1e7-505e20876a04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:00.694377 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c2c22fa9-cb08-48b6-b1e7-505e20876a04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:00.694814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c2c22fa9-cb08-48b6-b1e7-505e20876a04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:00.828725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c2c22fa9-cb08-48b6-b1e7-505e20876a04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:00.838973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c2c22fa9-cb08-48b6-b1e7-505e20876a04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.157111 Apr 07 12:59:00.839811 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 214/424] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:00 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:00.988650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7fb935ef-1aa3-4809-8e16-9d78cd3b65a2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:00.989449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7fb935ef-1aa3-4809-8e16-9d78cd3b65a2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:00.995039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fb935ef-1aa3-4809-8e16-9d78cd3b65a2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:00.995489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fb935ef-1aa3-4809-8e16-9d78cd3b65a2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:00.996296 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fb935ef-1aa3-4809-8e16-9d78cd3b65a2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:00.996728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fb935ef-1aa3-4809-8e16-9d78cd3b65a2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:01.009311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b123c7b5-c780-4660-a23a-caa55540e4f8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:01.009992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b123c7b5-c780-4660-a23a-caa55540e4f8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:01.016253 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b123c7b5-c780-4660-a23a-caa55540e4f8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:01.017331 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b123c7b5-c780-4660-a23a-caa55540e4f8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:01.018335 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b123c7b5-c780-4660-a23a-caa55540e4f8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:01.018875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b123c7b5-c780-4660-a23a-caa55540e4f8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:01.145766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7fb935ef-1aa3-4809-8e16-9d78cd3b65a2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:01.154750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7fb935ef-1aa3-4809-8e16-9d78cd3b65a2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:01.156525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7fb935ef-1aa3-4809-8e16-9d78cd3b65a2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:01.159180 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7fb935ef-1aa3-4809-8e16-9d78cd3b65a2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.175064 Apr 07 12:59:01.159881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 211/425] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:00 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:01.174903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b123c7b5-c780-4660-a23a-caa55540e4f8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:01.183901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b123c7b5-c780-4660-a23a-caa55540e4f8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.178583 Apr 07 12:59:01.184488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 215/426] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:01 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:59:01.643591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-240c8beb-60a5-4bc1-b5ab-750335f5e757 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:01.644236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-240c8beb-60a5-4bc1-b5ab-750335f5e757 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:01.649967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-240c8beb-60a5-4bc1-b5ab-750335f5e757 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:01.650418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-240c8beb-60a5-4bc1-b5ab-750335f5e757 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:01.651181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-240c8beb-60a5-4bc1-b5ab-750335f5e757 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:01.651613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-240c8beb-60a5-4bc1-b5ab-750335f5e757 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:01.785992 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-240c8beb-60a5-4bc1-b5ab-750335f5e757 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:01.793509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-240c8beb-60a5-4bc1-b5ab-750335f5e757 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.153800 Apr 07 12:59:01.794098 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 212/427] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:01 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:01.854878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-def612b3-317e-4f9b-9afc-3de8686a2277 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:01.855493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-def612b3-317e-4f9b-9afc-3de8686a2277 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:01.862401 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-def612b3-317e-4f9b-9afc-3de8686a2277 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:01.862854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-def612b3-317e-4f9b-9afc-3de8686a2277 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:01.863612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-def612b3-317e-4f9b-9afc-3de8686a2277 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:01.864080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-def612b3-317e-4f9b-9afc-3de8686a2277 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:01.997986 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-def612b3-317e-4f9b-9afc-3de8686a2277 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:02.005505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-def612b3-317e-4f9b-9afc-3de8686a2277 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1318 microversion: 2.1 time: 0.154427 Apr 07 12:59:02.006068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 216/428] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:01 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:02.183740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a220c234-0037-43ba-9c43-428f0deef0da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:02.184423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a220c234-0037-43ba-9c43-428f0deef0da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:02.191244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a220c234-0037-43ba-9c43-428f0deef0da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:02.191702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a220c234-0037-43ba-9c43-428f0deef0da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:02.192521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a220c234-0037-43ba-9c43-428f0deef0da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:02.192965 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a220c234-0037-43ba-9c43-428f0deef0da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:02.200186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2d8bacbb-9fbd-491b-91bc-30b15bec46f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:02.201037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2d8bacbb-9fbd-491b-91bc-30b15bec46f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:02.207735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d8bacbb-9fbd-491b-91bc-30b15bec46f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:02.208859 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d8bacbb-9fbd-491b-91bc-30b15bec46f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:02.209160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d8bacbb-9fbd-491b-91bc-30b15bec46f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:02.209682 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d8bacbb-9fbd-491b-91bc-30b15bec46f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:02.385369 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a220c234-0037-43ba-9c43-428f0deef0da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:02.398280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a220c234-0037-43ba-9c43-428f0deef0da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:02.400831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a220c234-0037-43ba-9c43-428f0deef0da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:02.402565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a220c234-0037-43ba-9c43-428f0deef0da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1721 microversion: 2.20 time: 0.224077 Apr 07 12:59:02.403837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 213/429] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:02 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:59:02.519138 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2d8bacbb-9fbd-491b-91bc-30b15bec46f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:02.529252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2d8bacbb-9fbd-491b-91bc-30b15bec46f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.332501 Apr 07 12:59:02.530260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 217/430] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:02 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:59:02.811656 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1c53a7e5-baf7-4d49-b2fe-4f3e6cf36791 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:02.812552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1c53a7e5-baf7-4d49-b2fe-4f3e6cf36791 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:02.820821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1c53a7e5-baf7-4d49-b2fe-4f3e6cf36791 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:02.822131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1c53a7e5-baf7-4d49-b2fe-4f3e6cf36791 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:02.823452 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1c53a7e5-baf7-4d49-b2fe-4f3e6cf36791 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:02.824268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1c53a7e5-baf7-4d49-b2fe-4f3e6cf36791 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:02.981128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1c53a7e5-baf7-4d49-b2fe-4f3e6cf36791 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:02.994052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1c53a7e5-baf7-4d49-b2fe-4f3e6cf36791 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.186597 Apr 07 12:59:02.994676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 214/431] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:02 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:03.022339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cf5e7a37-08ba-4053-9527-d40db90a005b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:03.023163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cf5e7a37-08ba-4053-9527-d40db90a005b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:03.029703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf5e7a37-08ba-4053-9527-d40db90a005b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:03.030460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf5e7a37-08ba-4053-9527-d40db90a005b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:03.031242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf5e7a37-08ba-4053-9527-d40db90a005b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:03.031680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf5e7a37-08ba-4053-9527-d40db90a005b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:03.284174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cf5e7a37-08ba-4053-9527-d40db90a005b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:03.292667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cf5e7a37-08ba-4053-9527-d40db90a005b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1507 microversion: 2.1 time: 0.273968 Apr 07 12:59:03.293242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 218/432] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:03 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:03.421029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4f1eda24-bc7b-4510-8e07-ed1d22d8312c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:03.421565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4f1eda24-bc7b-4510-8e07-ed1d22d8312c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:03.427557 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f1eda24-bc7b-4510-8e07-ed1d22d8312c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:03.428000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f1eda24-bc7b-4510-8e07-ed1d22d8312c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:03.428788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f1eda24-bc7b-4510-8e07-ed1d22d8312c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:03.429215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f1eda24-bc7b-4510-8e07-ed1d22d8312c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:03.546641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-27ab0906-5b3e-4215-8fba-3dc9a147b56e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:03.547247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-27ab0906-5b3e-4215-8fba-3dc9a147b56e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:03.553637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-27ab0906-5b3e-4215-8fba-3dc9a147b56e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:03.554334 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-27ab0906-5b3e-4215-8fba-3dc9a147b56e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:03.555186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-27ab0906-5b3e-4215-8fba-3dc9a147b56e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:03.555635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-27ab0906-5b3e-4215-8fba-3dc9a147b56e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:03.568670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4f1eda24-bc7b-4510-8e07-ed1d22d8312c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:03.576617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4f1eda24-bc7b-4510-8e07-ed1d22d8312c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:03.578523 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4f1eda24-bc7b-4510-8e07-ed1d22d8312c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:03.581384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4f1eda24-bc7b-4510-8e07-ed1d22d8312c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1664 microversion: 2.20 time: 0.162650 Apr 07 12:59:03.581987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 215/433] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:03 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:03.599390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-96984f47-90d0-4bac-b3b4-68648f10a337 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b54a146f-ce55-4109-8f45-d02eacadc203"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:03.600645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-96984f47-90d0-4bac-b3b4-68648f10a337 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:03.614789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-96984f47-90d0-4bac-b3b4-68648f10a337 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:03.618970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-96984f47-90d0-4bac-b3b4-68648f10a337 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:03.620174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-96984f47-90d0-4bac-b3b4-68648f10a337 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:03.620488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-96984f47-90d0-4bac-b3b4-68648f10a337 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:03.759713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-27ab0906-5b3e-4215-8fba-3dc9a147b56e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:03.770078 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-27ab0906-5b3e-4215-8fba-3dc9a147b56e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.227093 Apr 07 12:59:03.770839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 219/434] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:03 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:59:04.007039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-96984f47-90d0-4bac-b3b4-68648f10a337 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "POST /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.411813 Apr 07 12:59:04.007912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 216/435] 10.222.0.15 () {62 vars in 1363 bytes} [Thu Apr 7 12:59:03 2022] POST /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 188 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 12:59:04.010819 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b11edf06-8637-46db-a3a2-10c234d8e8ce tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:04.011383 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b11edf06-8637-46db-a3a2-10c234d8e8ce tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:04.022096 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b11edf06-8637-46db-a3a2-10c234d8e8ce tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:04.024944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b11edf06-8637-46db-a3a2-10c234d8e8ce tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:04.025761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b11edf06-8637-46db-a3a2-10c234d8e8ce tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:04.026209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b11edf06-8637-46db-a3a2-10c234d8e8ce tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:04.126578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-18e14538-c6f4-45cf-951e-2d1ae8555010 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:04.127478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-18e14538-c6f4-45cf-951e-2d1ae8555010 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:04.134427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-18e14538-c6f4-45cf-951e-2d1ae8555010 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:04.134883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-18e14538-c6f4-45cf-951e-2d1ae8555010 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:04.135663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-18e14538-c6f4-45cf-951e-2d1ae8555010 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:04.136101 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-18e14538-c6f4-45cf-951e-2d1ae8555010 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:04.173568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b11edf06-8637-46db-a3a2-10c234d8e8ce tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:04.182569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b11edf06-8637-46db-a3a2-10c234d8e8ce tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.175569 Apr 07 12:59:04.183146 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 220/436] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:04 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:59:04.241224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-18e14538-c6f4-45cf-951e-2d1ae8555010 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "POST /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/action" status: 202 len: 0 microversion: 2.20 time: 0.118247 Apr 07 12:59:04.241766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 217/437] 10.222.0.15 () {62 vars in 1318 bytes} [Thu Apr 7 12:59:04 2022] POST /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 07 12:59:04.250248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f5b42776-6192-4862-af70-78006b4b1fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:04.250901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f5b42776-6192-4862-af70-78006b4b1fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:04.257057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5b42776-6192-4862-af70-78006b4b1fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:04.257558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5b42776-6192-4862-af70-78006b4b1fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:04.258406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5b42776-6192-4862-af70-78006b4b1fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:04.258914 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5b42776-6192-4862-af70-78006b4b1fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:04.403986 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f5b42776-6192-4862-af70-78006b4b1fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:04.413126 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f5b42776-6192-4862-af70-78006b4b1fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:04.414701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f5b42776-6192-4862-af70-78006b4b1fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:04.415881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f5b42776-6192-4862-af70-78006b4b1fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1750 microversion: 2.20 time: 0.169814 Apr 07 12:59:04.416471 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 221/438] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:04 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:59:04.789456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ec7412e5-5a57-4ad1-a8c5-e9a5feb81a64 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:04.790434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ec7412e5-5a57-4ad1-a8c5-e9a5feb81a64 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:04.796715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ec7412e5-5a57-4ad1-a8c5-e9a5feb81a64 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:04.797881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ec7412e5-5a57-4ad1-a8c5-e9a5feb81a64 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:04.799130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ec7412e5-5a57-4ad1-a8c5-e9a5feb81a64 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:04.799746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ec7412e5-5a57-4ad1-a8c5-e9a5feb81a64 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:04.984979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ec7412e5-5a57-4ad1-a8c5-e9a5feb81a64 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:04.997116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ec7412e5-5a57-4ad1-a8c5-e9a5feb81a64 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.212483 Apr 07 12:59:04.998627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 218/439] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:04 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:05.198997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-66aed1b4-6551-4b16-a71c-1f5673885e63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:05.199668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-66aed1b4-6551-4b16-a71c-1f5673885e63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:05.206795 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-66aed1b4-6551-4b16-a71c-1f5673885e63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:05.207324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-66aed1b4-6551-4b16-a71c-1f5673885e63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:05.208200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-66aed1b4-6551-4b16-a71c-1f5673885e63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:05.208722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-66aed1b4-6551-4b16-a71c-1f5673885e63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:05.364654 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-66aed1b4-6551-4b16-a71c-1f5673885e63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:05.372595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-66aed1b4-6551-4b16-a71c-1f5673885e63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1266 microversion: 2.1 time: 0.177421 Apr 07 12:59:05.373162 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 222/440] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:05 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:59:05.437572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1dc55bba-b6da-4164-877f-8022a16396fb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:05.438243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1dc55bba-b6da-4164-877f-8022a16396fb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:05.445417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1dc55bba-b6da-4164-877f-8022a16396fb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:05.445856 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1dc55bba-b6da-4164-877f-8022a16396fb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:05.446619 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1dc55bba-b6da-4164-877f-8022a16396fb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:05.447051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1dc55bba-b6da-4164-877f-8022a16396fb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:05.596912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1dc55bba-b6da-4164-877f-8022a16396fb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:05.605368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1dc55bba-b6da-4164-877f-8022a16396fb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:05.606853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1dc55bba-b6da-4164-877f-8022a16396fb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:05.608003 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1dc55bba-b6da-4164-877f-8022a16396fb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1752 microversion: 2.20 time: 0.175023 Apr 07 12:59:05.608600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 219/441] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:05 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:06.015742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-483cec36-20d1-4eae-b267-a9daddb6009d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:06.016508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-483cec36-20d1-4eae-b267-a9daddb6009d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:06.024592 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-483cec36-20d1-4eae-b267-a9daddb6009d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:06.025062 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-483cec36-20d1-4eae-b267-a9daddb6009d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:06.025845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-483cec36-20d1-4eae-b267-a9daddb6009d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:06.026281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-483cec36-20d1-4eae-b267-a9daddb6009d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:06.192050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-483cec36-20d1-4eae-b267-a9daddb6009d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:06.200499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-483cec36-20d1-4eae-b267-a9daddb6009d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.188903 Apr 07 12:59:06.201068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 223/442] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:06 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:06.391018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7e5272b9-4f0b-47e0-8461-0a07e3244718 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:06.391627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7e5272b9-4f0b-47e0-8461-0a07e3244718 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:06.398203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7e5272b9-4f0b-47e0-8461-0a07e3244718 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:06.398651 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7e5272b9-4f0b-47e0-8461-0a07e3244718 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:06.399461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7e5272b9-4f0b-47e0-8461-0a07e3244718 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:06.399900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7e5272b9-4f0b-47e0-8461-0a07e3244718 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:06.611226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7e5272b9-4f0b-47e0-8461-0a07e3244718 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:06.620867 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7e5272b9-4f0b-47e0-8461-0a07e3244718 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1454 microversion: 2.1 time: 0.233816 Apr 07 12:59:06.632419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 220/443] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:06 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1454 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:06.632775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ea4592fd-90af-494c-ba4f-c70684fd001a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:06.632775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ea4592fd-90af-494c-ba4f-c70684fd001a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:06.635015 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea4592fd-90af-494c-ba4f-c70684fd001a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:06.635535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea4592fd-90af-494c-ba4f-c70684fd001a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:06.636506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea4592fd-90af-494c-ba4f-c70684fd001a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:06.636941 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea4592fd-90af-494c-ba4f-c70684fd001a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:06.639678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a4d46373-63a0-4351-b3c1-90fd13c314e7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:06.640326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a4d46373-63a0-4351-b3c1-90fd13c314e7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:06.646818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a4d46373-63a0-4351-b3c1-90fd13c314e7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:06.647269 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a4d46373-63a0-4351-b3c1-90fd13c314e7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:06.648359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a4d46373-63a0-4351-b3c1-90fd13c314e7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:06.649013 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a4d46373-63a0-4351-b3c1-90fd13c314e7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:06.787880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ea4592fd-90af-494c-ba4f-c70684fd001a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:06.805859 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ea4592fd-90af-494c-ba4f-c70684fd001a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:06.807802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ea4592fd-90af-494c-ba4f-c70684fd001a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:06.809476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ea4592fd-90af-494c-ba4f-c70684fd001a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1752 microversion: 2.20 time: 0.186621 Apr 07 12:59:06.810200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 224/444] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:06 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:59:06.830238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a4d46373-63a0-4351-b3c1-90fd13c314e7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:06.838257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a4d46373-63a0-4351-b3c1-90fd13c314e7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1454 microversion: 2.1 time: 0.202904 Apr 07 12:59:06.839015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 221/445] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:06 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1454 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:59:07.217981 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-84d737b2-a381-4d8d-94e7-07f056c2f744 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:07.218771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-84d737b2-a381-4d8d-94e7-07f056c2f744 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:07.225144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-84d737b2-a381-4d8d-94e7-07f056c2f744 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:07.225603 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-84d737b2-a381-4d8d-94e7-07f056c2f744 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:07.226566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-84d737b2-a381-4d8d-94e7-07f056c2f744 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:07.227011 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-84d737b2-a381-4d8d-94e7-07f056c2f744 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:07.391443 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-84d737b2-a381-4d8d-94e7-07f056c2f744 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:07.401528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-84d737b2-a381-4d8d-94e7-07f056c2f744 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.187281 Apr 07 12:59:07.411947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 225/446] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:07 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:07.833829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-680fbe9e-3413-4dd1-94ff-5d57ee4bee4a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:07.834435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-680fbe9e-3413-4dd1-94ff-5d57ee4bee4a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:07.850685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-680fbe9e-3413-4dd1-94ff-5d57ee4bee4a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:07.851400 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-680fbe9e-3413-4dd1-94ff-5d57ee4bee4a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:07.852488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-680fbe9e-3413-4dd1-94ff-5d57ee4bee4a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:07.853204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-680fbe9e-3413-4dd1-94ff-5d57ee4bee4a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:07.996628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-427e40e2-1926-44a2-aa19-c37b81436f8b req-c0d74a83-c646-41cc-be87-70813fa311a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "926785df-7955-4e58-a0ae-dc896b2b3f2c", "name": "network-vif-plugged", "status": "completed", "tag": "3f362b45-57dc-4ae2-9d2e-6280d7bf36e2"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:08.009505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-427e40e2-1926-44a2-aa19-c37b81436f8b req-c0d74a83-c646-41cc-be87-70813fa311a7 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:08.010257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-427e40e2-1926-44a2-aa19-c37b81436f8b req-c0d74a83-c646-41cc-be87-70813fa311a7 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:08.026674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-427e40e2-1926-44a2-aa19-c37b81436f8b req-c0d74a83-c646-41cc-be87-70813fa311a7 service nova] Creating event network-vif-plugged:3f362b45-57dc-4ae2-9d2e-6280d7bf36e2 for instance 926785df-7955-4e58-a0ae-dc896b2b3f2c on hv-cinder-83694 Apr 07 12:59:08.034796 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-427e40e2-1926-44a2-aa19-c37b81436f8b req-c0d74a83-c646-41cc-be87-70813fa311a7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042518 Apr 07 12:59:08.035988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 226/447] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 12:59:08.250926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-680fbe9e-3413-4dd1-94ff-5d57ee4bee4a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:08.267669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-680fbe9e-3413-4dd1-94ff-5d57ee4bee4a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:08.269490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-680fbe9e-3413-4dd1-94ff-5d57ee4bee4a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:08.271013 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-680fbe9e-3413-4dd1-94ff-5d57ee4bee4a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.441792 Apr 07 12:59:08.271866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 222/448] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:07 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:08.419731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d03b5826-c964-4c3f-a981-bb486bb4a912 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:08.420888 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d03b5826-c964-4c3f-a981-bb486bb4a912 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:08.428287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d03b5826-c964-4c3f-a981-bb486bb4a912 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:08.428888 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d03b5826-c964-4c3f-a981-bb486bb4a912 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:08.429745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d03b5826-c964-4c3f-a981-bb486bb4a912 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:08.430328 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d03b5826-c964-4c3f-a981-bb486bb4a912 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:08.575029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d03b5826-c964-4c3f-a981-bb486bb4a912 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:08.582989 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d03b5826-c964-4c3f-a981-bb486bb4a912 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.167597 Apr 07 12:59:08.584706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 227/449] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:08 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:59:09.291306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-465ce58f-5eb9-4bb5-9f7a-11d3037b78d7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:09.292048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-465ce58f-5eb9-4bb5-9f7a-11d3037b78d7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:09.299361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-465ce58f-5eb9-4bb5-9f7a-11d3037b78d7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:09.301930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-465ce58f-5eb9-4bb5-9f7a-11d3037b78d7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:09.305251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-465ce58f-5eb9-4bb5-9f7a-11d3037b78d7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:09.305960 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-465ce58f-5eb9-4bb5-9f7a-11d3037b78d7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:09.330971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-d4986acd-d4b7-4f26-a509-09b6efec2caf req-edeb1e6a-7824-40f4-9fd1-6a1cbfcf273d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb36ce2a-6233-4601-85c0-35c550476cea", "tag": "1d264377-61da-43aa-ba85-52dd323d34d8"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:09.342091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-d4986acd-d4b7-4f26-a509-09b6efec2caf req-edeb1e6a-7824-40f4-9fd1-6a1cbfcf273d service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:09.342544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-d4986acd-d4b7-4f26-a509-09b6efec2caf req-edeb1e6a-7824-40f4-9fd1-6a1cbfcf273d service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:09.363320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-d4986acd-d4b7-4f26-a509-09b6efec2caf req-edeb1e6a-7824-40f4-9fd1-6a1cbfcf273d service nova] Creating event network-changed:1d264377-61da-43aa-ba85-52dd323d34d8 for instance cb36ce2a-6233-4601-85c0-35c550476cea on hv-cinder-83694 Apr 07 12:59:09.368560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-d4986acd-d4b7-4f26-a509-09b6efec2caf req-edeb1e6a-7824-40f4-9fd1-6a1cbfcf273d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042162 Apr 07 12:59:09.369218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 228/450] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 12:59:09.467363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-465ce58f-5eb9-4bb5-9f7a-11d3037b78d7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:09.477364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-465ce58f-5eb9-4bb5-9f7a-11d3037b78d7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:09.478970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-465ce58f-5eb9-4bb5-9f7a-11d3037b78d7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:09.480300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-465ce58f-5eb9-4bb5-9f7a-11d3037b78d7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.193443 Apr 07 12:59:09.480927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 223/451] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:09 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:09.602487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b412a6c8-2366-4b40-83cb-a9919d546865 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:09.610408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b412a6c8-2366-4b40-83cb-a9919d546865 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:09.625671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b412a6c8-2366-4b40-83cb-a9919d546865 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:09.626534 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b412a6c8-2366-4b40-83cb-a9919d546865 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:09.629107 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b412a6c8-2366-4b40-83cb-a9919d546865 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:09.629998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b412a6c8-2366-4b40-83cb-a9919d546865 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:09.788029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b412a6c8-2366-4b40-83cb-a9919d546865 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:09.795532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b412a6c8-2366-4b40-83cb-a9919d546865 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1358 microversion: 2.1 time: 0.197843 Apr 07 12:59:09.801810 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 229/452] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:09 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:59:10.499441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6d1a3961-4803-41bb-9877-bd74303382eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:10.500171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6d1a3961-4803-41bb-9877-bd74303382eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:10.506985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d1a3961-4803-41bb-9877-bd74303382eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:10.507443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d1a3961-4803-41bb-9877-bd74303382eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:10.508295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d1a3961-4803-41bb-9877-bd74303382eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:10.509012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d1a3961-4803-41bb-9877-bd74303382eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:10.706613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6d1a3961-4803-41bb-9877-bd74303382eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:10.715321 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6d1a3961-4803-41bb-9877-bd74303382eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:10.716848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6d1a3961-4803-41bb-9877-bd74303382eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:10.718002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6d1a3961-4803-41bb-9877-bd74303382eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.222736 Apr 07 12:59:10.718547 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 224/453] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:10 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:10.813440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6baf97a5-2ec2-411e-a345-e892fc841483 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:10.814577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6baf97a5-2ec2-411e-a345-e892fc841483 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:10.821560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6baf97a5-2ec2-411e-a345-e892fc841483 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:10.822013 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6baf97a5-2ec2-411e-a345-e892fc841483 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:10.822791 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6baf97a5-2ec2-411e-a345-e892fc841483 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:10.823232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6baf97a5-2ec2-411e-a345-e892fc841483 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:10.984116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6baf97a5-2ec2-411e-a345-e892fc841483 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:10.994714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6baf97a5-2ec2-411e-a345-e892fc841483 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1548 microversion: 2.1 time: 0.185192 Apr 07 12:59:10.995400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 230/454] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:10 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1548 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:11.011480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-de5721c8-eff4-4abd-980a-46be92e0b558 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:11.012087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-de5721c8-eff4-4abd-980a-46be92e0b558 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:11.019088 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de5721c8-eff4-4abd-980a-46be92e0b558 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:11.019630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de5721c8-eff4-4abd-980a-46be92e0b558 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:11.020457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de5721c8-eff4-4abd-980a-46be92e0b558 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:11.020897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de5721c8-eff4-4abd-980a-46be92e0b558 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:11.168002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-de5721c8-eff4-4abd-980a-46be92e0b558 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:11.175938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-de5721c8-eff4-4abd-980a-46be92e0b558 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1548 microversion: 2.1 time: 0.168225 Apr 07 12:59:11.176532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 225/455] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:11 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:11.193805 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c0278db1-532a-4cc5-8bbc-c5e54377b6d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:11.197247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c0278db1-532a-4cc5-8bbc-c5e54377b6d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:11.198010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c0278db1-532a-4cc5-8bbc-c5e54377b6d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Searching by: {'deleted': False, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b'} {{(pid=116892) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 07 12:59:11.205339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c0278db1-532a-4cc5-8bbc-c5e54377b6d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:11.205791 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c0278db1-532a-4cc5-8bbc-c5e54377b6d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:11.206599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c0278db1-532a-4cc5-8bbc-c5e54377b6d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:11.207030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c0278db1-532a-4cc5-8bbc-c5e54377b6d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:11.307343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.multi_cell_list [None req-c0278db1-532a-4cc5-8bbc-c5e54377b6d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116892) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 07 12:59:11.407679 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c0278db1-532a-4cc5-8bbc-c5e54377b6d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.217768 Apr 07 12:59:11.408750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 231/456] 10.222.0.15 () {58 vars in 1124 bytes} [Thu Apr 7 12:59:11 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:59:11.419275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d4db3652-fab2-4ecb-affc-f29d2fc970b7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:11.419902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d4db3652-fab2-4ecb-affc-f29d2fc970b7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:11.426307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4db3652-fab2-4ecb-affc-f29d2fc970b7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:11.427000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4db3652-fab2-4ecb-affc-f29d2fc970b7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:11.427931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4db3652-fab2-4ecb-affc-f29d2fc970b7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:11.428540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4db3652-fab2-4ecb-affc-f29d2fc970b7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:11.575048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d4db3652-fab2-4ecb-affc-f29d2fc970b7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:11.586042 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d4db3652-fab2-4ecb-affc-f29d2fc970b7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1548 microversion: 2.1 time: 0.170450 Apr 07 12:59:11.586641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 226/457] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:11 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:11.737188 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c7473ed2-6323-4961-bbde-2866cea749f3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:11.737774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c7473ed2-6323-4961-bbde-2866cea749f3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:11.744706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7473ed2-6323-4961-bbde-2866cea749f3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:11.745496 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7473ed2-6323-4961-bbde-2866cea749f3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:11.746597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7473ed2-6323-4961-bbde-2866cea749f3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:11.747099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7473ed2-6323-4961-bbde-2866cea749f3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:11.932915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c7473ed2-6323-4961-bbde-2866cea749f3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:11.944529 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c7473ed2-6323-4961-bbde-2866cea749f3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:11.946234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c7473ed2-6323-4961-bbde-2866cea749f3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:11.947711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c7473ed2-6323-4961-bbde-2866cea749f3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.214646 Apr 07 12:59:11.958881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 232/458] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:11 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:12.966939 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ee20278e-e710-4a3f-988d-8a94864f1038 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:12.967555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ee20278e-e710-4a3f-988d-8a94864f1038 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:12.975582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ee20278e-e710-4a3f-988d-8a94864f1038 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:12.976198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ee20278e-e710-4a3f-988d-8a94864f1038 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:12.977007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ee20278e-e710-4a3f-988d-8a94864f1038 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:12.977438 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ee20278e-e710-4a3f-988d-8a94864f1038 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:13.165338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ee20278e-e710-4a3f-988d-8a94864f1038 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:13.175087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ee20278e-e710-4a3f-988d-8a94864f1038 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:13.176871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ee20278e-e710-4a3f-988d-8a94864f1038 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:13.178202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ee20278e-e710-4a3f-988d-8a94864f1038 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.215952 Apr 07 12:59:13.180176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 227/459] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:12 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:13.205077 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-95731554-da55-436c-80b5-2be54bc84b1a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f65d3f1-3aeb-4048-8926-1531e4cebe2c"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:13.206397 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-95731554-da55-436c-80b5-2be54bc84b1a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:13.213628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-95731554-da55-436c-80b5-2be54bc84b1a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:13.214347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-95731554-da55-436c-80b5-2be54bc84b1a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:13.214920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-95731554-da55-436c-80b5-2be54bc84b1a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:13.215479 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-95731554-da55-436c-80b5-2be54bc84b1a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:14.197139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0605e211-dd37-4577-b823-0fb0c22ea20f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:14.197753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0605e211-dd37-4577-b823-0fb0c22ea20f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:14.203976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0605e211-dd37-4577-b823-0fb0c22ea20f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:14.204958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0605e211-dd37-4577-b823-0fb0c22ea20f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:14.205738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0605e211-dd37-4577-b823-0fb0c22ea20f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:14.206176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0605e211-dd37-4577-b823-0fb0c22ea20f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:14.353025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0605e211-dd37-4577-b823-0fb0c22ea20f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:14.363329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0605e211-dd37-4577-b823-0fb0c22ea20f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:14.364985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0605e211-dd37-4577-b823-0fb0c22ea20f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:14.366520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0605e211-dd37-4577-b823-0fb0c22ea20f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.173101 Apr 07 12:59:14.367265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 228/460] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:14 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:59:15.384917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c653ad2e-ccfb-45de-9a7f-c0c952f99603 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:15.385635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c653ad2e-ccfb-45de-9a7f-c0c952f99603 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:15.393634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c653ad2e-ccfb-45de-9a7f-c0c952f99603 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:15.394081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c653ad2e-ccfb-45de-9a7f-c0c952f99603 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:15.394852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c653ad2e-ccfb-45de-9a7f-c0c952f99603 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:15.395284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c653ad2e-ccfb-45de-9a7f-c0c952f99603 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:15.550649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c653ad2e-ccfb-45de-9a7f-c0c952f99603 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:15.561882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c653ad2e-ccfb-45de-9a7f-c0c952f99603 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:15.563672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c653ad2e-ccfb-45de-9a7f-c0c952f99603 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:15.565167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c653ad2e-ccfb-45de-9a7f-c0c952f99603 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.184126 Apr 07 12:59:15.566109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 229/461] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:15 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:16.584840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-342bc93c-4059-4555-b4b3-4c749fe73d67 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:16.585604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-342bc93c-4059-4555-b4b3-4c749fe73d67 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:16.592763 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-342bc93c-4059-4555-b4b3-4c749fe73d67 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:16.593553 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-342bc93c-4059-4555-b4b3-4c749fe73d67 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:16.594637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-342bc93c-4059-4555-b4b3-4c749fe73d67 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:16.595770 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-342bc93c-4059-4555-b4b3-4c749fe73d67 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:16.738671 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-342bc93c-4059-4555-b4b3-4c749fe73d67 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:16.746458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-342bc93c-4059-4555-b4b3-4c749fe73d67 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:16.748166 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-342bc93c-4059-4555-b4b3-4c749fe73d67 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:16.749489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-342bc93c-4059-4555-b4b3-4c749fe73d67 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.170599 Apr 07 12:59:16.750055 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 230/462] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:16 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:59:17.768737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d9e04e70-7523-4d94-be34-20e6fe0e0691 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:17.769477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d9e04e70-7523-4d94-be34-20e6fe0e0691 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:17.775320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d9e04e70-7523-4d94-be34-20e6fe0e0691 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:17.775890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d9e04e70-7523-4d94-be34-20e6fe0e0691 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:17.776842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d9e04e70-7523-4d94-be34-20e6fe0e0691 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:17.777279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d9e04e70-7523-4d94-be34-20e6fe0e0691 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:17.926857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d9e04e70-7523-4d94-be34-20e6fe0e0691 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:17.936115 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d9e04e70-7523-4d94-be34-20e6fe0e0691 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:17.937915 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d9e04e70-7523-4d94-be34-20e6fe0e0691 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:17.939256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d9e04e70-7523-4d94-be34-20e6fe0e0691 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.174517 Apr 07 12:59:17.940092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 231/463] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:17 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:59:18.958308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c5bd5cc0-f002-42b3-9fb7-8d71bccc43e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:18.959057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c5bd5cc0-f002-42b3-9fb7-8d71bccc43e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:18.965637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c5bd5cc0-f002-42b3-9fb7-8d71bccc43e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:18.966323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c5bd5cc0-f002-42b3-9fb7-8d71bccc43e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:18.967198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c5bd5cc0-f002-42b3-9fb7-8d71bccc43e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:18.967650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c5bd5cc0-f002-42b3-9fb7-8d71bccc43e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:19.112816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c5bd5cc0-f002-42b3-9fb7-8d71bccc43e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:19.121242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c5bd5cc0-f002-42b3-9fb7-8d71bccc43e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:19.122773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c5bd5cc0-f002-42b3-9fb7-8d71bccc43e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:19.123961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c5bd5cc0-f002-42b3-9fb7-8d71bccc43e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.170147 Apr 07 12:59:19.124560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 232/464] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:18 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:59:20.144280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a49f92ca-7178-41f8-a75a-72528af2385e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:20.144943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a49f92ca-7178-41f8-a75a-72528af2385e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:20.151194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a49f92ca-7178-41f8-a75a-72528af2385e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:20.151641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a49f92ca-7178-41f8-a75a-72528af2385e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:20.152422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a49f92ca-7178-41f8-a75a-72528af2385e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:20.152854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a49f92ca-7178-41f8-a75a-72528af2385e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:20.289623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a49f92ca-7178-41f8-a75a-72528af2385e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:20.298455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a49f92ca-7178-41f8-a75a-72528af2385e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:20.299931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a49f92ca-7178-41f8-a75a-72528af2385e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:20.301099 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a49f92ca-7178-41f8-a75a-72528af2385e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.162206 Apr 07 12:59:20.301653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 233/465] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:20 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:59:21.319430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1e151d73-3ce1-4c99-a15c-d546ebac2eee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:21.320107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1e151d73-3ce1-4c99-a15c-d546ebac2eee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:21.325748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e151d73-3ce1-4c99-a15c-d546ebac2eee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:21.326448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e151d73-3ce1-4c99-a15c-d546ebac2eee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:21.327766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e151d73-3ce1-4c99-a15c-d546ebac2eee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:21.328609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e151d73-3ce1-4c99-a15c-d546ebac2eee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:21.474729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1e151d73-3ce1-4c99-a15c-d546ebac2eee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:21.482921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1e151d73-3ce1-4c99-a15c-d546ebac2eee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:21.484482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1e151d73-3ce1-4c99-a15c-d546ebac2eee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:21.486128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1e151d73-3ce1-4c99-a15c-d546ebac2eee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.170163 Apr 07 12:59:21.486783 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 234/466] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:21 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 12:59:21.703967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e407e2e6-5b70-400d-8a2c-a66bfcffcaa7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6ee47b1-8e86-4db8-a8b0-06dbfac3a118", "device": "/dev/sdb"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:21.706210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e407e2e6-5b70-400d-8a2c-a66bfcffcaa7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:21.712156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e407e2e6-5b70-400d-8a2c-a66bfcffcaa7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:21.712699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e407e2e6-5b70-400d-8a2c-a66bfcffcaa7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:21.713529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e407e2e6-5b70-400d-8a2c-a66bfcffcaa7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:21.714028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e407e2e6-5b70-400d-8a2c-a66bfcffcaa7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:22.617437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-95731554-da55-436c-80b5-2be54bc84b1a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "POST /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.416893 Apr 07 12:59:22.618390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 233/467] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Apr 7 12:59:13 2022] POST /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments => generated 194 bytes in 9419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:59:22.623726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1cdcb216-ce2b-4ade-85c1-cf3c472585ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:22.624677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1cdcb216-ce2b-4ade-85c1-cf3c472585ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:22.633603 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1cdcb216-ce2b-4ade-85c1-cf3c472585ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:22.634450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1cdcb216-ce2b-4ade-85c1-cf3c472585ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:22.635406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1cdcb216-ce2b-4ade-85c1-cf3c472585ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:22.636031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1cdcb216-ce2b-4ade-85c1-cf3c472585ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:22.691529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e407e2e6-5b70-400d-8a2c-a66bfcffcaa7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "POST /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991522 Apr 07 12:59:22.693133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 235/468] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Apr 7 12:59:21 2022] POST /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:59:22.863418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1cdcb216-ce2b-4ade-85c1-cf3c472585ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:22.871986 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1cdcb216-ce2b-4ade-85c1-cf3c472585ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:22.873497 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1cdcb216-ce2b-4ade-85c1-cf3c472585ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:22.874660 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1cdcb216-ce2b-4ade-85c1-cf3c472585ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.254893 Apr 07 12:59:22.875217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 234/469] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:23.059427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-77331731-3b47-4bbd-b1d0-2e7d3dc0ea46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:23.059891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-77331731-3b47-4bbd-b1d0-2e7d3dc0ea46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:23.066881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-77331731-3b47-4bbd-b1d0-2e7d3dc0ea46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:23.067494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-77331731-3b47-4bbd-b1d0-2e7d3dc0ea46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:23.068282 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-77331731-3b47-4bbd-b1d0-2e7d3dc0ea46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:23.068714 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-77331731-3b47-4bbd-b1d0-2e7d3dc0ea46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:23.191613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-77331731-3b47-4bbd-b1d0-2e7d3dc0ea46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lazy-loading 'services' on Instance uuid 34baf697-0c75-496f-a1fe-fef1314f1a9a {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 12:59:23.301896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-77331731-3b47-4bbd-b1d0-2e7d3dc0ea46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "DELETE /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/os-volume_attachments/83191d90-351c-40aa-8bf7-e460aeec0a7c" status: 202 len: 0 microversion: 2.1 time: 0.247230 Apr 07 12:59:23.302468 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 236/470] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 12:59:23 2022] DELETE /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/os-volume_attachments/83191d90-351c-40aa-8bf7-e460aeec0a7c => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 12:59:23.892896 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-954053d6-50ee-4348-a989-411b07e738b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:23.893502 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-954053d6-50ee-4348-a989-411b07e738b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:23.899785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-954053d6-50ee-4348-a989-411b07e738b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:23.900271 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-954053d6-50ee-4348-a989-411b07e738b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:23.901144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-954053d6-50ee-4348-a989-411b07e738b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:23.901588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-954053d6-50ee-4348-a989-411b07e738b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:24.030889 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-954053d6-50ee-4348-a989-411b07e738b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:24.039291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-954053d6-50ee-4348-a989-411b07e738b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:24.040803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-954053d6-50ee-4348-a989-411b07e738b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:24.041958 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-954053d6-50ee-4348-a989-411b07e738b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.153054 Apr 07 12:59:24.042522 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 235/471] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:23 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:25.061660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c6e48eea-5320-4cce-9130-8b5ca897902e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:25.062358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c6e48eea-5320-4cce-9130-8b5ca897902e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:25.069120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c6e48eea-5320-4cce-9130-8b5ca897902e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:25.069578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c6e48eea-5320-4cce-9130-8b5ca897902e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:25.070340 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c6e48eea-5320-4cce-9130-8b5ca897902e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:25.070777 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c6e48eea-5320-4cce-9130-8b5ca897902e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:25.202911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c6e48eea-5320-4cce-9130-8b5ca897902e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:25.211479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c6e48eea-5320-4cce-9130-8b5ca897902e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:25.212987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c6e48eea-5320-4cce-9130-8b5ca897902e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:25.214130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c6e48eea-5320-4cce-9130-8b5ca897902e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.157144 Apr 07 12:59:25.214681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 237/472] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:25 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:26.232637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a762849b-5768-463b-9fee-c72c89fa13ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:26.233244 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a762849b-5768-463b-9fee-c72c89fa13ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:26.240122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a762849b-5768-463b-9fee-c72c89fa13ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:26.240604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a762849b-5768-463b-9fee-c72c89fa13ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:26.241366 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a762849b-5768-463b-9fee-c72c89fa13ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:26.241800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a762849b-5768-463b-9fee-c72c89fa13ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:26.381648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a762849b-5768-463b-9fee-c72c89fa13ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:26.389860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a762849b-5768-463b-9fee-c72c89fa13ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:26.391408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a762849b-5768-463b-9fee-c72c89fa13ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:26.392706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a762849b-5768-463b-9fee-c72c89fa13ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.163973 Apr 07 12:59:26.393260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 236/473] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:26 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:26.649103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-72698bb0-62c3-4b2a-bd9c-6fc1a463110a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c376a3d-f46d-4e82-aff9-f7ee5ea10b93"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:26.650729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-72698bb0-62c3-4b2a-bd9c-6fc1a463110a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:26.657686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72698bb0-62c3-4b2a-bd9c-6fc1a463110a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:26.658146 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72698bb0-62c3-4b2a-bd9c-6fc1a463110a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:26.658926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72698bb0-62c3-4b2a-bd9c-6fc1a463110a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:26.659349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72698bb0-62c3-4b2a-bd9c-6fc1a463110a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:26.904087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-72698bb0-62c3-4b2a-bd9c-6fc1a463110a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "POST /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258805 Apr 07 12:59:26.904963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 238/474] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Apr 7 12:59:26 2022] POST /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:59:27.410867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ef4a1e7e-cefd-44b6-a961-b03ec5a42f86 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:27.411504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ef4a1e7e-cefd-44b6-a961-b03ec5a42f86 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:27.417823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef4a1e7e-cefd-44b6-a961-b03ec5a42f86 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:27.418276 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef4a1e7e-cefd-44b6-a961-b03ec5a42f86 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:27.419037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef4a1e7e-cefd-44b6-a961-b03ec5a42f86 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:27.419475 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef4a1e7e-cefd-44b6-a961-b03ec5a42f86 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:27.551013 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ef4a1e7e-cefd-44b6-a961-b03ec5a42f86 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:27.559881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ef4a1e7e-cefd-44b6-a961-b03ec5a42f86 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:27.561426 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ef4a1e7e-cefd-44b6-a961-b03ec5a42f86 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:27.562590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ef4a1e7e-cefd-44b6-a961-b03ec5a42f86 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.155665 Apr 07 12:59:27.563198 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 237/475] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:27 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:28.582821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-99a24d89-9ade-4559-a0b5-23c25307837f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:28.583235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-99a24d89-9ade-4559-a0b5-23c25307837f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:28.589629 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-99a24d89-9ade-4559-a0b5-23c25307837f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:28.590086 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-99a24d89-9ade-4559-a0b5-23c25307837f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:28.590862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-99a24d89-9ade-4559-a0b5-23c25307837f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:28.591310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-99a24d89-9ade-4559-a0b5-23c25307837f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:28.726986 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-99a24d89-9ade-4559-a0b5-23c25307837f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:28.735123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-99a24d89-9ade-4559-a0b5-23c25307837f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:28.736684 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-99a24d89-9ade-4559-a0b5-23c25307837f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:28.737828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-99a24d89-9ade-4559-a0b5-23c25307837f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.159769 Apr 07 12:59:28.738386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 239/476] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:28 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:29.755882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0e16b122-4e38-4d55-9300-530317808d6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:29.756627 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0e16b122-4e38-4d55-9300-530317808d6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:29.762995 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e16b122-4e38-4d55-9300-530317808d6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:29.763449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e16b122-4e38-4d55-9300-530317808d6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:29.764231 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e16b122-4e38-4d55-9300-530317808d6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:29.764662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e16b122-4e38-4d55-9300-530317808d6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:29.903952 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0e16b122-4e38-4d55-9300-530317808d6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:29.913687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0e16b122-4e38-4d55-9300-530317808d6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:29.915498 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0e16b122-4e38-4d55-9300-530317808d6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:29.916919 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0e16b122-4e38-4d55-9300-530317808d6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.164866 Apr 07 12:59:29.917955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 238/477] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:29 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:30.249502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f833207b-dfde-41e0-ad12-cf88dd946e74 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:30.250116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f833207b-dfde-41e0-ad12-cf88dd946e74 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:30.257017 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f833207b-dfde-41e0-ad12-cf88dd946e74 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:30.257468 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f833207b-dfde-41e0-ad12-cf88dd946e74 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:30.258231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f833207b-dfde-41e0-ad12-cf88dd946e74 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:30.258663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f833207b-dfde-41e0-ad12-cf88dd946e74 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:30.398159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f833207b-dfde-41e0-ad12-cf88dd946e74 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:30.407762 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f833207b-dfde-41e0-ad12-cf88dd946e74 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1594 microversion: 2.1 time: 0.161966 Apr 07 12:59:30.408538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 240/478] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:30 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:30.936094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eb794571-6461-403d-9b3c-f8e24bdc6950 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:30.936751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-eb794571-6461-403d-9b3c-f8e24bdc6950 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:30.943852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb794571-6461-403d-9b3c-f8e24bdc6950 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:30.944347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb794571-6461-403d-9b3c-f8e24bdc6950 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:30.945126 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb794571-6461-403d-9b3c-f8e24bdc6950 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:30.945568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb794571-6461-403d-9b3c-f8e24bdc6950 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:31.081835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eb794571-6461-403d-9b3c-f8e24bdc6950 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:31.090203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eb794571-6461-403d-9b3c-f8e24bdc6950 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:31.091699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eb794571-6461-403d-9b3c-f8e24bdc6950 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:31.092890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eb794571-6461-403d-9b3c-f8e24bdc6950 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.160921 Apr 07 12:59:31.093456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 239/479] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:30 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:32.053572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-a7bbf880-2bed-4397-9599-b2a61f37e575 req-551c7be5-d862-4022-a449-c798c4a27493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c9a464-496a-4aa9-80dd-f9ec66f515ae", "name": "network-vif-plugged", "status": "completed", "tag": "b25fac27-5301-4311-8e84-5721b8cac04c"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:32.062655 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-a7bbf880-2bed-4397-9599-b2a61f37e575 req-551c7be5-d862-4022-a449-c798c4a27493 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:32.064162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-a7bbf880-2bed-4397-9599-b2a61f37e575 req-551c7be5-d862-4022-a449-c798c4a27493 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:32.078882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-a7bbf880-2bed-4397-9599-b2a61f37e575 req-551c7be5-d862-4022-a449-c798c4a27493 service nova] Creating event network-vif-plugged:b25fac27-5301-4311-8e84-5721b8cac04c for instance 58c9a464-496a-4aa9-80dd-f9ec66f515ae on hv-cinder-83694 Apr 07 12:59:32.084570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-a7bbf880-2bed-4397-9599-b2a61f37e575 req-551c7be5-d862-4022-a449-c798c4a27493 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035903 Apr 07 12:59:32.085488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 241/480] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:59:32.123871 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e4ba81b8-6732-413b-86e4-0bee92d1d544 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:32.127215 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e4ba81b8-6732-413b-86e4-0bee92d1d544 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:32.139127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4ba81b8-6732-413b-86e4-0bee92d1d544 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:32.139689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4ba81b8-6732-413b-86e4-0bee92d1d544 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:32.140763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4ba81b8-6732-413b-86e4-0bee92d1d544 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:32.141587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4ba81b8-6732-413b-86e4-0bee92d1d544 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:32.292797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e4ba81b8-6732-413b-86e4-0bee92d1d544 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:32.302240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e4ba81b8-6732-413b-86e4-0bee92d1d544 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:32.303776 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e4ba81b8-6732-413b-86e4-0bee92d1d544 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:32.304991 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e4ba81b8-6732-413b-86e4-0bee92d1d544 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.196495 Apr 07 12:59:32.315799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 240/481] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:32 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:32.430970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-ae0ce523-994a-4025-bc2c-ca2ba042852f req-09a156cd-defd-409f-871d-1d44747a19ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926785df-7955-4e58-a0ae-dc896b2b3f2c", "tag": "3f362b45-57dc-4ae2-9d2e-6280d7bf36e2"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:32.440491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-ae0ce523-994a-4025-bc2c-ca2ba042852f req-09a156cd-defd-409f-871d-1d44747a19ce service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:32.441196 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-ae0ce523-994a-4025-bc2c-ca2ba042852f req-09a156cd-defd-409f-871d-1d44747a19ce service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:32.455088 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-ae0ce523-994a-4025-bc2c-ca2ba042852f req-09a156cd-defd-409f-871d-1d44747a19ce service nova] Creating event network-changed:3f362b45-57dc-4ae2-9d2e-6280d7bf36e2 for instance 926785df-7955-4e58-a0ae-dc896b2b3f2c on hv-cinder-83694 Apr 07 12:59:32.459982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-ae0ce523-994a-4025-bc2c-ca2ba042852f req-09a156cd-defd-409f-871d-1d44747a19ce service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033104 Apr 07 12:59:32.460691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 242/482] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 12:59:33.322631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4f67f2fe-2655-47cc-9d3b-908dcc25726d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:33.324053 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4f67f2fe-2655-47cc-9d3b-908dcc25726d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:33.333332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4f67f2fe-2655-47cc-9d3b-908dcc25726d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:33.333960 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4f67f2fe-2655-47cc-9d3b-908dcc25726d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:33.335054 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4f67f2fe-2655-47cc-9d3b-908dcc25726d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:33.335632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4f67f2fe-2655-47cc-9d3b-908dcc25726d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:33.443182 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0cc13005-f7cf-4304-af8c-5228e27e84c4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1712445778"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:33.443957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0cc13005-f7cf-4304-af8c-5228e27e84c4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:33.450329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0cc13005-f7cf-4304-af8c-5228e27e84c4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:33.450964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0cc13005-f7cf-4304-af8c-5228e27e84c4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:33.452460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0cc13005-f7cf-4304-af8c-5228e27e84c4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:33.452901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0cc13005-f7cf-4304-af8c-5228e27e84c4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:33.547165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4f67f2fe-2655-47cc-9d3b-908dcc25726d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:33.556571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4f67f2fe-2655-47cc-9d3b-908dcc25726d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:33.558204 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4f67f2fe-2655-47cc-9d3b-908dcc25726d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:33.559593 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4f67f2fe-2655-47cc-9d3b-908dcc25726d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.240915 Apr 07 12:59:33.560667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 241/483] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:33 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:33.604976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.network.security_group_api [None req-0cc13005-f7cf-4304-af8c-5228e27e84c4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Adding security group 472cc598-edcf-402a-9dd7-b505f5390bd2 to port 3f362b45-57dc-4ae2-9d2e-6280d7bf36e2 Apr 07 12:59:33.966943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0cc13005-f7cf-4304-af8c-5228e27e84c4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "POST /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/action" status: 202 len: 0 microversion: 2.1 time: 0.528405 Apr 07 12:59:33.968100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 243/484] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 12:59:33 2022] POST /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 07 12:59:33.978125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3ca637fe-85f1-47b9-8783-089ce7ba10b8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:33.978888 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3ca637fe-85f1-47b9-8783-089ce7ba10b8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:33.990751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3ca637fe-85f1-47b9-8783-089ce7ba10b8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:33.991404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3ca637fe-85f1-47b9-8783-089ce7ba10b8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:33.992756 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3ca637fe-85f1-47b9-8783-089ce7ba10b8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:33.993405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3ca637fe-85f1-47b9-8783-089ce7ba10b8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:34.157787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3ca637fe-85f1-47b9-8783-089ce7ba10b8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:34.166154 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3ca637fe-85f1-47b9-8783-089ce7ba10b8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1760 microversion: 2.1 time: 0.194116 Apr 07 12:59:34.166716 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 242/485] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:33 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1760 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:59:34.475820 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-570f5afb-2e44-4e85-afe4-1155e29cc749 req-8640a053-0701-4161-bb68-2f09d1846e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926785df-7955-4e58-a0ae-dc896b2b3f2c", "tag": "3f362b45-57dc-4ae2-9d2e-6280d7bf36e2"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:34.484131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-570f5afb-2e44-4e85-afe4-1155e29cc749 req-8640a053-0701-4161-bb68-2f09d1846e35 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:34.484623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-570f5afb-2e44-4e85-afe4-1155e29cc749 req-8640a053-0701-4161-bb68-2f09d1846e35 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:34.496044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-570f5afb-2e44-4e85-afe4-1155e29cc749 req-8640a053-0701-4161-bb68-2f09d1846e35 service nova] Creating event network-changed:3f362b45-57dc-4ae2-9d2e-6280d7bf36e2 for instance 926785df-7955-4e58-a0ae-dc896b2b3f2c on hv-cinder-83694 Apr 07 12:59:34.501463 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-570f5afb-2e44-4e85-afe4-1155e29cc749 req-8640a053-0701-4161-bb68-2f09d1846e35 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029030 Apr 07 12:59:34.502091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 244/486] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 12:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 12:59:34.578909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8d5c1f0e-9f0e-410a-b8d3-b11f081cd9f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:34.579638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8d5c1f0e-9f0e-410a-b8d3-b11f081cd9f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:34.587459 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d5c1f0e-9f0e-410a-b8d3-b11f081cd9f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:34.587909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d5c1f0e-9f0e-410a-b8d3-b11f081cd9f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:34.588731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d5c1f0e-9f0e-410a-b8d3-b11f081cd9f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:34.589165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d5c1f0e-9f0e-410a-b8d3-b11f081cd9f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:34.720984 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8d5c1f0e-9f0e-410a-b8d3-b11f081cd9f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:34.729476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8d5c1f0e-9f0e-410a-b8d3-b11f081cd9f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:34.730962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8d5c1f0e-9f0e-410a-b8d3-b11f081cd9f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:34.732120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8d5c1f0e-9f0e-410a-b8d3-b11f081cd9f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.157251 Apr 07 12:59:34.732707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 243/487] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:34 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:35.752051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d768a28e-9a33-490e-8fc9-93239d7e367b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:35.752703 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d768a28e-9a33-490e-8fc9-93239d7e367b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:35.758756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d768a28e-9a33-490e-8fc9-93239d7e367b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:35.759200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d768a28e-9a33-490e-8fc9-93239d7e367b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:35.759948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d768a28e-9a33-490e-8fc9-93239d7e367b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:35.760409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d768a28e-9a33-490e-8fc9-93239d7e367b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:35.896828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d768a28e-9a33-490e-8fc9-93239d7e367b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:35.905315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d768a28e-9a33-490e-8fc9-93239d7e367b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:35.907436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d768a28e-9a33-490e-8fc9-93239d7e367b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:35.908818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d768a28e-9a33-490e-8fc9-93239d7e367b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1808 microversion: 2.20 time: 0.162030 Apr 07 12:59:35.909381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 245/488] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:35 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:36.927728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4b46d840-102b-4ee1-8717-dad58a64946b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:36.928371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4b46d840-102b-4ee1-8717-dad58a64946b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:36.934667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b46d840-102b-4ee1-8717-dad58a64946b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:36.935138 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b46d840-102b-4ee1-8717-dad58a64946b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:36.935904 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b46d840-102b-4ee1-8717-dad58a64946b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:36.936379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b46d840-102b-4ee1-8717-dad58a64946b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:37.095691 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4b46d840-102b-4ee1-8717-dad58a64946b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:37.104324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4b46d840-102b-4ee1-8717-dad58a64946b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:37.105955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4b46d840-102b-4ee1-8717-dad58a64946b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:37.107353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4b46d840-102b-4ee1-8717-dad58a64946b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1795 microversion: 2.20 time: 0.183487 Apr 07 12:59:37.107991 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 244/489] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 12:59:36 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1795 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 12:59:38.118608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9c871fc3-475e-4ed2-9111-59125b9b5771 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:38.124893 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c871fc3-475e-4ed2-9111-59125b9b5771 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:38.125972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c871fc3-475e-4ed2-9111-59125b9b5771 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:38.146459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9c871fc3-475e-4ed2-9111-59125b9b5771 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Going to try to stop instance {{(pid=116893) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 07 12:59:38.186377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9c871fc3-475e-4ed2-9111-59125b9b5771 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "POST /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/action" status: 202 len: 0 microversion: 2.1 time: 0.071287 Apr 07 12:59:38.187086 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 246/490] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 12:59:38 2022] POST /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 12:59:38.195746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fc77b2ea-d26e-4c82-b666-7e19188f6dfb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:38.196570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fc77b2ea-d26e-4c82-b666-7e19188f6dfb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:38.202837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc77b2ea-d26e-4c82-b666-7e19188f6dfb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:38.203295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc77b2ea-d26e-4c82-b666-7e19188f6dfb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:38.204130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc77b2ea-d26e-4c82-b666-7e19188f6dfb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:38.204629 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc77b2ea-d26e-4c82-b666-7e19188f6dfb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:38.336759 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fc77b2ea-d26e-4c82-b666-7e19188f6dfb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:38.344504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fc77b2ea-d26e-4c82-b666-7e19188f6dfb tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.152120 Apr 07 12:59:38.345645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 245/491] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:38 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 12:59:39.363335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-82838e8d-0dcb-408a-bd5c-ec47f458333d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:39.364029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-82838e8d-0dcb-408a-bd5c-ec47f458333d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:39.370080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-82838e8d-0dcb-408a-bd5c-ec47f458333d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:39.370532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-82838e8d-0dcb-408a-bd5c-ec47f458333d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:39.371288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-82838e8d-0dcb-408a-bd5c-ec47f458333d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:39.371724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-82838e8d-0dcb-408a-bd5c-ec47f458333d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:39.503725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-82838e8d-0dcb-408a-bd5c-ec47f458333d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:39.511079 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-82838e8d-0dcb-408a-bd5c-ec47f458333d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.152443 Apr 07 12:59:39.511644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 247/492] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:39 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:40.528764 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4777ee51-af99-4f18-bc25-6b97e0ca38ed tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:40.529291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4777ee51-af99-4f18-bc25-6b97e0ca38ed tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:40.535982 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4777ee51-af99-4f18-bc25-6b97e0ca38ed tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:40.536483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4777ee51-af99-4f18-bc25-6b97e0ca38ed tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:40.537255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4777ee51-af99-4f18-bc25-6b97e0ca38ed tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:40.537699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4777ee51-af99-4f18-bc25-6b97e0ca38ed tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:40.670483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4777ee51-af99-4f18-bc25-6b97e0ca38ed tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:40.678565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4777ee51-af99-4f18-bc25-6b97e0ca38ed tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.153772 Apr 07 12:59:40.679140 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 246/493] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:40 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:41.695235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f8d91a68-dbd0-4357-9434-67b9defc1908 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:41.695844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f8d91a68-dbd0-4357-9434-67b9defc1908 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:41.702123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8d91a68-dbd0-4357-9434-67b9defc1908 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:41.702575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8d91a68-dbd0-4357-9434-67b9defc1908 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:41.703398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8d91a68-dbd0-4357-9434-67b9defc1908 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:41.703835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8d91a68-dbd0-4357-9434-67b9defc1908 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:41.835647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f8d91a68-dbd0-4357-9434-67b9defc1908 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:41.842940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f8d91a68-dbd0-4357-9434-67b9defc1908 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.151516 Apr 07 12:59:41.843515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 248/494] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:41 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:42.860648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c57ea756-6ffd-43c9-a9db-efb999a483d1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:42.861267 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c57ea756-6ffd-43c9-a9db-efb999a483d1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:42.867571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c57ea756-6ffd-43c9-a9db-efb999a483d1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:42.868030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c57ea756-6ffd-43c9-a9db-efb999a483d1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:42.868833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c57ea756-6ffd-43c9-a9db-efb999a483d1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:42.869277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c57ea756-6ffd-43c9-a9db-efb999a483d1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:43.003713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c57ea756-6ffd-43c9-a9db-efb999a483d1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:43.011106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c57ea756-6ffd-43c9-a9db-efb999a483d1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.154873 Apr 07 12:59:43.011676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 247/495] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:42 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:44.028009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3daedaaa-b906-42d7-84c8-e8adb18678ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:44.028657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3daedaaa-b906-42d7-84c8-e8adb18678ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:44.035379 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3daedaaa-b906-42d7-84c8-e8adb18678ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:44.035834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3daedaaa-b906-42d7-84c8-e8adb18678ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:44.036641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3daedaaa-b906-42d7-84c8-e8adb18678ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:44.037080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3daedaaa-b906-42d7-84c8-e8adb18678ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:44.170946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3daedaaa-b906-42d7-84c8-e8adb18678ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:44.178637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3daedaaa-b906-42d7-84c8-e8adb18678ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.154396 Apr 07 12:59:44.179198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 249/496] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:44 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:45.196192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e552d433-299d-4c62-ae4d-f55822723fb9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:45.196721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e552d433-299d-4c62-ae4d-f55822723fb9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:45.203322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e552d433-299d-4c62-ae4d-f55822723fb9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:45.204025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e552d433-299d-4c62-ae4d-f55822723fb9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:45.204821 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e552d433-299d-4c62-ae4d-f55822723fb9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:45.205257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e552d433-299d-4c62-ae4d-f55822723fb9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:45.336096 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e552d433-299d-4c62-ae4d-f55822723fb9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:45.343323 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e552d433-299d-4c62-ae4d-f55822723fb9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.151041 Apr 07 12:59:45.344226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 248/497] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:45 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:46.360643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-295813df-d6ea-4ceb-9d8e-ae184db29468 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:46.361251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-295813df-d6ea-4ceb-9d8e-ae184db29468 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:46.367480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-295813df-d6ea-4ceb-9d8e-ae184db29468 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:46.367931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-295813df-d6ea-4ceb-9d8e-ae184db29468 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:46.368726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-295813df-d6ea-4ceb-9d8e-ae184db29468 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:46.369158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-295813df-d6ea-4ceb-9d8e-ae184db29468 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:46.497819 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-295813df-d6ea-4ceb-9d8e-ae184db29468 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:46.505300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-295813df-d6ea-4ceb-9d8e-ae184db29468 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.148730 Apr 07 12:59:46.505863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 250/498] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:46 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:47.522578 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-967d290e-b1ce-46b8-abe5-3b200c8b33ab tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:47.523196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-967d290e-b1ce-46b8-abe5-3b200c8b33ab tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:47.529799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-967d290e-b1ce-46b8-abe5-3b200c8b33ab tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:47.530260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-967d290e-b1ce-46b8-abe5-3b200c8b33ab tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:47.531030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-967d290e-b1ce-46b8-abe5-3b200c8b33ab tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:47.532017 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-967d290e-b1ce-46b8-abe5-3b200c8b33ab tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:47.664583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-967d290e-b1ce-46b8-abe5-3b200c8b33ab tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:47.672416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-967d290e-b1ce-46b8-abe5-3b200c8b33ab tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.153080 Apr 07 12:59:47.672959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 249/499] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:47 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:48.688681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2658f20c-d2fe-4b2d-965a-578ea3fcdd6f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:48.689298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2658f20c-d2fe-4b2d-965a-578ea3fcdd6f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:48.695562 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2658f20c-d2fe-4b2d-965a-578ea3fcdd6f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:48.696015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2658f20c-d2fe-4b2d-965a-578ea3fcdd6f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:48.696820 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2658f20c-d2fe-4b2d-965a-578ea3fcdd6f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:48.697261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2658f20c-d2fe-4b2d-965a-578ea3fcdd6f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:48.830429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2658f20c-d2fe-4b2d-965a-578ea3fcdd6f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:48.837671 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2658f20c-d2fe-4b2d-965a-578ea3fcdd6f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.152694 Apr 07 12:59:48.838184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 251/500] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:48 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:49.855139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-032df832-aa2f-401f-8037-4b24f0c19d59 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:49.855744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-032df832-aa2f-401f-8037-4b24f0c19d59 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:49.862873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-032df832-aa2f-401f-8037-4b24f0c19d59 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:49.863317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-032df832-aa2f-401f-8037-4b24f0c19d59 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:49.864079 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-032df832-aa2f-401f-8037-4b24f0c19d59 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:49.864536 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-032df832-aa2f-401f-8037-4b24f0c19d59 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:49.994505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-032df832-aa2f-401f-8037-4b24f0c19d59 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:50.001921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-032df832-aa2f-401f-8037-4b24f0c19d59 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.150623 Apr 07 12:59:50.002485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 250/501] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:49 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:51.018426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e38dfa96-a2a0-4107-b79b-fd2c88898747 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:51.019071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e38dfa96-a2a0-4107-b79b-fd2c88898747 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:51.025290 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e38dfa96-a2a0-4107-b79b-fd2c88898747 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:51.025737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e38dfa96-a2a0-4107-b79b-fd2c88898747 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:51.026491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e38dfa96-a2a0-4107-b79b-fd2c88898747 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:51.026923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e38dfa96-a2a0-4107-b79b-fd2c88898747 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:51.160787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e38dfa96-a2a0-4107-b79b-fd2c88898747 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:51.168033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e38dfa96-a2a0-4107-b79b-fd2c88898747 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.153810 Apr 07 12:59:51.168612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 252/502] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:51 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:52.185911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e25cd754-7ef1-48dd-9a38-787f59b2e941 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:52.186520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e25cd754-7ef1-48dd-9a38-787f59b2e941 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:52.192902 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e25cd754-7ef1-48dd-9a38-787f59b2e941 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:52.193347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e25cd754-7ef1-48dd-9a38-787f59b2e941 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:52.194102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e25cd754-7ef1-48dd-9a38-787f59b2e941 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:52.194533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e25cd754-7ef1-48dd-9a38-787f59b2e941 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:52.323888 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e25cd754-7ef1-48dd-9a38-787f59b2e941 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:52.331741 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e25cd754-7ef1-48dd-9a38-787f59b2e941 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.149591 Apr 07 12:59:52.332321 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 251/503] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:52 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:53.348818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7ced0f65-1f38-474b-95ee-0f0d4bc5c9fa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:53.349419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7ced0f65-1f38-474b-95ee-0f0d4bc5c9fa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:53.355260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ced0f65-1f38-474b-95ee-0f0d4bc5c9fa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:53.355707 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ced0f65-1f38-474b-95ee-0f0d4bc5c9fa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:53.356494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ced0f65-1f38-474b-95ee-0f0d4bc5c9fa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:53.356923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ced0f65-1f38-474b-95ee-0f0d4bc5c9fa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:53.498594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7ced0f65-1f38-474b-95ee-0f0d4bc5c9fa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:53.505893 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7ced0f65-1f38-474b-95ee-0f0d4bc5c9fa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.160875 Apr 07 12:59:53.506454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 253/504] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:53 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:54.522518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c0d2e324-a5c2-473d-b6ba-5aadca376505 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:54.523052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c0d2e324-a5c2-473d-b6ba-5aadca376505 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:54.529367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c0d2e324-a5c2-473d-b6ba-5aadca376505 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:54.530071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c0d2e324-a5c2-473d-b6ba-5aadca376505 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:54.530833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c0d2e324-a5c2-473d-b6ba-5aadca376505 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:54.531545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c0d2e324-a5c2-473d-b6ba-5aadca376505 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:54.665601 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c0d2e324-a5c2-473d-b6ba-5aadca376505 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:54.673623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c0d2e324-a5c2-473d-b6ba-5aadca376505 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.154952 Apr 07 12:59:54.674178 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 252/505] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:54 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:55.691701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-283c58c1-58ab-4283-a95f-cf421d10b3c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:55.692373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-283c58c1-58ab-4283-a95f-cf421d10b3c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:55.698786 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-283c58c1-58ab-4283-a95f-cf421d10b3c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:55.699234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-283c58c1-58ab-4283-a95f-cf421d10b3c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:55.699990 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-283c58c1-58ab-4283-a95f-cf421d10b3c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:55.700457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-283c58c1-58ab-4283-a95f-cf421d10b3c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:55.831824 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-283c58c1-58ab-4283-a95f-cf421d10b3c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:55.839184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-283c58c1-58ab-4283-a95f-cf421d10b3c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.152432 Apr 07 12:59:55.839684 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 254/506] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:55 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:56.856880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-380e52b0-8564-4cc4-a448-5643054fd94f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:56.857509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-380e52b0-8564-4cc4-a448-5643054fd94f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:56.871833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-380e52b0-8564-4cc4-a448-5643054fd94f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:56.872316 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-380e52b0-8564-4cc4-a448-5643054fd94f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:56.873329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-380e52b0-8564-4cc4-a448-5643054fd94f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:56.874016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-380e52b0-8564-4cc4-a448-5643054fd94f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:57.014457 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-380e52b0-8564-4cc4-a448-5643054fd94f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:57.022571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-380e52b0-8564-4cc4-a448-5643054fd94f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.170501 Apr 07 12:59:57.023139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 253/507] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:56 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:58.044109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0b254554-4e30-4d3f-a8c7-1ee9543cbaf9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:58.044754 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0b254554-4e30-4d3f-a8c7-1ee9543cbaf9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:58.051353 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0b254554-4e30-4d3f-a8c7-1ee9543cbaf9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:58.051808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0b254554-4e30-4d3f-a8c7-1ee9543cbaf9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:58.052603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0b254554-4e30-4d3f-a8c7-1ee9543cbaf9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:58.053040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0b254554-4e30-4d3f-a8c7-1ee9543cbaf9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:58.183401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0b254554-4e30-4d3f-a8c7-1ee9543cbaf9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:58.191418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0b254554-4e30-4d3f-a8c7-1ee9543cbaf9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.151202 Apr 07 12:59:58.191977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 255/508] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:58 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:59.209718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-733ba348-956f-4f32-8375-4825b26e5301 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:59.210328 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-733ba348-956f-4f32-8375-4825b26e5301 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:59.216616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-733ba348-956f-4f32-8375-4825b26e5301 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:59.217099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-733ba348-956f-4f32-8375-4825b26e5301 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:59.217851 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-733ba348-956f-4f32-8375-4825b26e5301 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:59.218283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-733ba348-956f-4f32-8375-4825b26e5301 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:59.350297 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-733ba348-956f-4f32-8375-4825b26e5301 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 12:59:59.357518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-733ba348-956f-4f32-8375-4825b26e5301 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.151597 Apr 07 12:59:59.358081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 254/509] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:59 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 12:59:59.853880 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-dad86a26-044a-41bb-bf42-74f8d57f1453 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 12:59:59.854940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-dad86a26-044a-41bb-bf42-74f8d57f1453 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:59.861915 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dad86a26-044a-41bb-bf42-74f8d57f1453 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:59.862367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dad86a26-044a-41bb-bf42-74f8d57f1453 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:59.863130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dad86a26-044a-41bb-bf42-74f8d57f1453 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:59.863567 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dad86a26-044a-41bb-bf42-74f8d57f1453 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:59.933922 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-dad86a26-044a-41bb-bf42-74f8d57f1453 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "POST /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/action" status: 202 len: 0 microversion: 2.1 time: 0.083696 Apr 07 12:59:59.934695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 256/510] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 12:59:59 2022] POST /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 12:59:59.942531 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-307648e0-ffcc-48c5-a6ef-0ea67ac293a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 12:59:59.943379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-307648e0-ffcc-48c5-a6ef-0ea67ac293a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 12:59:59.949916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-307648e0-ffcc-48c5-a6ef-0ea67ac293a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:59.950367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-307648e0-ffcc-48c5-a6ef-0ea67ac293a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 12:59:59.951128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-307648e0-ffcc-48c5-a6ef-0ea67ac293a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 12:59:59.951559 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-307648e0-ffcc-48c5-a6ef-0ea67ac293a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:00.098866 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-307648e0-ffcc-48c5-a6ef-0ea67ac293a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:00.106713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-307648e0-ffcc-48c5-a6ef-0ea67ac293a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.167783 Apr 07 13:00:00.107209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 255/511] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 12:59:59 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:00.376545 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4f5eb3ef-b189-4c40-805d-7c790583ec09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:00.377224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4f5eb3ef-b189-4c40-805d-7c790583ec09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:00.383185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f5eb3ef-b189-4c40-805d-7c790583ec09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:00.383646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f5eb3ef-b189-4c40-805d-7c790583ec09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:00.384435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f5eb3ef-b189-4c40-805d-7c790583ec09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:00.384865 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f5eb3ef-b189-4c40-805d-7c790583ec09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:00.525002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4f5eb3ef-b189-4c40-805d-7c790583ec09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:00.533878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4f5eb3ef-b189-4c40-805d-7c790583ec09 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.162843 Apr 07 13:00:00.534459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 257/512] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:00 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:01.124551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7693fbb7-f984-4404-bd66-831db1c2de20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:01.125355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7693fbb7-f984-4404-bd66-831db1c2de20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:01.131613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7693fbb7-f984-4404-bd66-831db1c2de20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:01.132065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7693fbb7-f984-4404-bd66-831db1c2de20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:01.132864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7693fbb7-f984-4404-bd66-831db1c2de20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:01.133305 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7693fbb7-f984-4404-bd66-831db1c2de20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:01.278979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7693fbb7-f984-4404-bd66-831db1c2de20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:01.287694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7693fbb7-f984-4404-bd66-831db1c2de20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.166989 Apr 07 13:00:01.288274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 256/513] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:01 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:01.550747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d0879f55-0d7d-49f6-ab9d-0cf5637d8e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:01.551362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d0879f55-0d7d-49f6-ab9d-0cf5637d8e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:01.557652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0879f55-0d7d-49f6-ab9d-0cf5637d8e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:01.558100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0879f55-0d7d-49f6-ab9d-0cf5637d8e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:01.558859 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0879f55-0d7d-49f6-ab9d-0cf5637d8e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:01.559291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0879f55-0d7d-49f6-ab9d-0cf5637d8e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:01.690254 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d0879f55-0d7d-49f6-ab9d-0cf5637d8e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:01.697818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d0879f55-0d7d-49f6-ab9d-0cf5637d8e86 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.151492 Apr 07 13:00:01.698392 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 258/514] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:01 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:02.304134 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-36f748b4-2e33-4cf4-9d45-b4c32c847ad2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:02.304769 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-36f748b4-2e33-4cf4-9d45-b4c32c847ad2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:02.311026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-36f748b4-2e33-4cf4-9d45-b4c32c847ad2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:02.311464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-36f748b4-2e33-4cf4-9d45-b4c32c847ad2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:02.313106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-36f748b4-2e33-4cf4-9d45-b4c32c847ad2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:02.313433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-36f748b4-2e33-4cf4-9d45-b4c32c847ad2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:02.455018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-36f748b4-2e33-4cf4-9d45-b4c32c847ad2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:02.462695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-36f748b4-2e33-4cf4-9d45-b4c32c847ad2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.162377 Apr 07 13:00:02.463246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 257/515] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:02 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:02.714676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-804dde00-e112-4a6f-8496-efbdd206eee5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:02.715319 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-804dde00-e112-4a6f-8496-efbdd206eee5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:02.722521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-804dde00-e112-4a6f-8496-efbdd206eee5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:02.722975 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-804dde00-e112-4a6f-8496-efbdd206eee5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:02.723738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-804dde00-e112-4a6f-8496-efbdd206eee5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:02.724195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-804dde00-e112-4a6f-8496-efbdd206eee5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:02.857524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-804dde00-e112-4a6f-8496-efbdd206eee5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:02.865027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-804dde00-e112-4a6f-8496-efbdd206eee5 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.154165 Apr 07 13:00:02.865587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 259/516] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:02 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:03.479974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bf36cc65-dfbf-4813-8406-482a397f0dab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:03.480633 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bf36cc65-dfbf-4813-8406-482a397f0dab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:03.487061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf36cc65-dfbf-4813-8406-482a397f0dab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:03.487517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf36cc65-dfbf-4813-8406-482a397f0dab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:03.488323 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf36cc65-dfbf-4813-8406-482a397f0dab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:03.488766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf36cc65-dfbf-4813-8406-482a397f0dab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:03.629770 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bf36cc65-dfbf-4813-8406-482a397f0dab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:03.637556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bf36cc65-dfbf-4813-8406-482a397f0dab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.161343 Apr 07 13:00:03.638112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 258/517] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:03 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:03.881668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-80f025de-c7be-47e6-acde-1362ae45995e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:03.882277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-80f025de-c7be-47e6-acde-1362ae45995e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:03.888608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80f025de-c7be-47e6-acde-1362ae45995e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:03.889062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80f025de-c7be-47e6-acde-1362ae45995e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:03.889819 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80f025de-c7be-47e6-acde-1362ae45995e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:03.890285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80f025de-c7be-47e6-acde-1362ae45995e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:04.019561 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-80f025de-c7be-47e6-acde-1362ae45995e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:04.026751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-80f025de-c7be-47e6-acde-1362ae45995e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.148833 Apr 07 13:00:04.027310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 260/518] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:03 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:04.654373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fab6ae46-cc8d-4ca5-a49f-7cc169220c12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:04.655249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fab6ae46-cc8d-4ca5-a49f-7cc169220c12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:04.661775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fab6ae46-cc8d-4ca5-a49f-7cc169220c12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:04.662231 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fab6ae46-cc8d-4ca5-a49f-7cc169220c12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:04.663005 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fab6ae46-cc8d-4ca5-a49f-7cc169220c12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:04.663445 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fab6ae46-cc8d-4ca5-a49f-7cc169220c12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:04.816124 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fab6ae46-cc8d-4ca5-a49f-7cc169220c12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:04.823925 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fab6ae46-cc8d-4ca5-a49f-7cc169220c12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.173557 Apr 07 13:00:04.824523 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 259/519] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:04 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:05.044321 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e9d462ab-dcab-4223-ba79-48c305c76e2a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:05.044882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e9d462ab-dcab-4223-ba79-48c305c76e2a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:05.052080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e9d462ab-dcab-4223-ba79-48c305c76e2a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:05.052942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e9d462ab-dcab-4223-ba79-48c305c76e2a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:05.054306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e9d462ab-dcab-4223-ba79-48c305c76e2a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:05.055112 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e9d462ab-dcab-4223-ba79-48c305c76e2a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:05.196508 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e9d462ab-dcab-4223-ba79-48c305c76e2a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:05.204561 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e9d462ab-dcab-4223-ba79-48c305c76e2a tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.164013 Apr 07 13:00:05.205122 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 261/520] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:05 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:05.841390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-71632a3f-7db6-47a1-8130-3a8017d5b708 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:05.841918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-71632a3f-7db6-47a1-8130-3a8017d5b708 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:05.849921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71632a3f-7db6-47a1-8130-3a8017d5b708 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:05.850529 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71632a3f-7db6-47a1-8130-3a8017d5b708 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:05.851509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71632a3f-7db6-47a1-8130-3a8017d5b708 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:05.852206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71632a3f-7db6-47a1-8130-3a8017d5b708 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:05.995413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-71632a3f-7db6-47a1-8130-3a8017d5b708 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:06.004287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-71632a3f-7db6-47a1-8130-3a8017d5b708 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.166714 Apr 07 13:00:06.004865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 260/521] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:05 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:06.222200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8ab2d311-c3d6-4347-85b6-c2924be4c8b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:06.223080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8ab2d311-c3d6-4347-85b6-c2924be4c8b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:06.229555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ab2d311-c3d6-4347-85b6-c2924be4c8b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:06.230003 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ab2d311-c3d6-4347-85b6-c2924be4c8b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:06.230762 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ab2d311-c3d6-4347-85b6-c2924be4c8b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:06.231195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ab2d311-c3d6-4347-85b6-c2924be4c8b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:06.367119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8ab2d311-c3d6-4347-85b6-c2924be4c8b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:06.374522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8ab2d311-c3d6-4347-85b6-c2924be4c8b3 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.157238 Apr 07 13:00:06.375089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 262/522] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:06 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:07.022669 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e5ed5e83-571c-4139-a7ae-afcdcc46f7db tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:07.023258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e5ed5e83-571c-4139-a7ae-afcdcc46f7db tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:07.029807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e5ed5e83-571c-4139-a7ae-afcdcc46f7db tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:07.030255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e5ed5e83-571c-4139-a7ae-afcdcc46f7db tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:07.031597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e5ed5e83-571c-4139-a7ae-afcdcc46f7db tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:07.032031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e5ed5e83-571c-4139-a7ae-afcdcc46f7db tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:07.180709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e5ed5e83-571c-4139-a7ae-afcdcc46f7db tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:07.189493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e5ed5e83-571c-4139-a7ae-afcdcc46f7db tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.170848 Apr 07 13:00:07.190075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 261/523] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:07 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:07.391608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f31190d7-6526-4aa2-978a-aa31c504e1be tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:07.392232 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f31190d7-6526-4aa2-978a-aa31c504e1be tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:07.398470 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f31190d7-6526-4aa2-978a-aa31c504e1be tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:07.398920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f31190d7-6526-4aa2-978a-aa31c504e1be tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:07.399667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f31190d7-6526-4aa2-978a-aa31c504e1be tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:07.400097 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f31190d7-6526-4aa2-978a-aa31c504e1be tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:07.528355 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f31190d7-6526-4aa2-978a-aa31c504e1be tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:07.535927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f31190d7-6526-4aa2-978a-aa31c504e1be tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.148223 Apr 07 13:00:07.536513 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 263/524] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:07 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:08.206386 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f57342a8-7cf1-4b76-93b6-671dd2b47974 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:08.206998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f57342a8-7cf1-4b76-93b6-671dd2b47974 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:08.213263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f57342a8-7cf1-4b76-93b6-671dd2b47974 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:08.213714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f57342a8-7cf1-4b76-93b6-671dd2b47974 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:08.214477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f57342a8-7cf1-4b76-93b6-671dd2b47974 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:08.214917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f57342a8-7cf1-4b76-93b6-671dd2b47974 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:08.356960 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f57342a8-7cf1-4b76-93b6-671dd2b47974 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:08.365401 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f57342a8-7cf1-4b76-93b6-671dd2b47974 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.162832 Apr 07 13:00:08.365961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 262/525] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:08 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:08.552884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1219db62-799b-4301-9415-6c59d9857067 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:08.553408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1219db62-799b-4301-9415-6c59d9857067 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:08.559750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1219db62-799b-4301-9415-6c59d9857067 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:08.560235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1219db62-799b-4301-9415-6c59d9857067 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:08.561071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1219db62-799b-4301-9415-6c59d9857067 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:08.561509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1219db62-799b-4301-9415-6c59d9857067 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:08.698279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1219db62-799b-4301-9415-6c59d9857067 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:08.705591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1219db62-799b-4301-9415-6c59d9857067 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.156535 Apr 07 13:00:08.706200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 264/526] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:08 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:09.382337 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8483e1aa-b9b7-4953-9d96-2eb055488dae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:09.382982 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8483e1aa-b9b7-4953-9d96-2eb055488dae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:09.389337 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8483e1aa-b9b7-4953-9d96-2eb055488dae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:09.389860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8483e1aa-b9b7-4953-9d96-2eb055488dae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:09.390629 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8483e1aa-b9b7-4953-9d96-2eb055488dae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:09.391068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8483e1aa-b9b7-4953-9d96-2eb055488dae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:09.532587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8483e1aa-b9b7-4953-9d96-2eb055488dae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:09.540357 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8483e1aa-b9b7-4953-9d96-2eb055488dae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.161828 Apr 07 13:00:09.540920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 263/527] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:09 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:09.723089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-48e6ef42-3458-473c-990b-3d5be1ceaa2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:09.723618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-48e6ef42-3458-473c-990b-3d5be1ceaa2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:09.729781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-48e6ef42-3458-473c-990b-3d5be1ceaa2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:09.730228 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-48e6ef42-3458-473c-990b-3d5be1ceaa2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:09.730981 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-48e6ef42-3458-473c-990b-3d5be1ceaa2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:09.731411 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-48e6ef42-3458-473c-990b-3d5be1ceaa2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:09.860879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-48e6ef42-3458-473c-990b-3d5be1ceaa2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:09.868130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-48e6ef42-3458-473c-990b-3d5be1ceaa2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.148890 Apr 07 13:00:09.868717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 265/528] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:09 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:10.369052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ebc328cf-25b1-4735-88fa-d83265bcd510 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:10.369470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ebc328cf-25b1-4735-88fa-d83265bcd510 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:10.375361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ebc328cf-25b1-4735-88fa-d83265bcd510 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:10.375810 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ebc328cf-25b1-4735-88fa-d83265bcd510 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:10.376609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ebc328cf-25b1-4735-88fa-d83265bcd510 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:10.377043 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ebc328cf-25b1-4735-88fa-d83265bcd510 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:10.408714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ebc328cf-25b1-4735-88fa-d83265bcd510 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments/b54a146f-ce55-4109-8f45-d02eacadc203" status: 200 len: 194 microversion: 2.20 time: 0.043692 Apr 07 13:00:10.409320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 264/529] 10.222.0.15 () {60 vars in 1453 bytes} [Thu Apr 7 13:00:10 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments/b54a146f-ce55-4109-8f45-d02eacadc203 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:10.470226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d6b3608c-8c30-4f03-8bd2-ee6d670ba1fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:10.470721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d6b3608c-8c30-4f03-8bd2-ee6d670ba1fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:10.476574 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6b3608c-8c30-4f03-8bd2-ee6d670ba1fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:10.477024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6b3608c-8c30-4f03-8bd2-ee6d670ba1fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:10.477777 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6b3608c-8c30-4f03-8bd2-ee6d670ba1fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:10.478206 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6b3608c-8c30-4f03-8bd2-ee6d670ba1fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:10.554728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-d6b3608c-8c30-4f03-8bd2-ee6d670ba1fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lazy-loading 'services' on Instance uuid 58c9a464-496a-4aa9-80dd-f9ec66f515ae {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:00:10.557226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b3a1558b-7ebf-4602-ba33-01124f3000b9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:10.558219 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b3a1558b-7ebf-4602-ba33-01124f3000b9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:10.565207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3a1558b-7ebf-4602-ba33-01124f3000b9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:10.565655 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3a1558b-7ebf-4602-ba33-01124f3000b9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:10.566410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3a1558b-7ebf-4602-ba33-01124f3000b9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:10.566842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3a1558b-7ebf-4602-ba33-01124f3000b9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:10.628653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d6b3608c-8c30-4f03-8bd2-ee6d670ba1fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "DELETE /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments/b54a146f-ce55-4109-8f45-d02eacadc203" status: 202 len: 0 microversion: 2.20 time: 0.163119 Apr 07 13:00:10.629198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 266/530] 10.222.0.15 () {60 vars in 1456 bytes} [Thu Apr 7 13:00:10 2022] DELETE /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments/b54a146f-ce55-4109-8f45-d02eacadc203 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:00:10.637859 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7f4d4ef7-5d9a-4583-b771-d0b23bd06758 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:10.638918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7f4d4ef7-5d9a-4583-b771-d0b23bd06758 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:10.645755 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f4d4ef7-5d9a-4583-b771-d0b23bd06758 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:10.646209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f4d4ef7-5d9a-4583-b771-d0b23bd06758 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:10.647036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f4d4ef7-5d9a-4583-b771-d0b23bd06758 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:10.647466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f4d4ef7-5d9a-4583-b771-d0b23bd06758 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:10.677453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7f4d4ef7-5d9a-4583-b771-d0b23bd06758 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043633 Apr 07 13:00:10.678190 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 267/531] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:10 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:10.721235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b3a1558b-7ebf-4602-ba33-01124f3000b9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:10.728991 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b3a1558b-7ebf-4602-ba33-01124f3000b9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.175626 Apr 07 13:00:10.729553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 265/532] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:10 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:10.885181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-39eee72a-506b-417e-87d6-e63aa141e008 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:10.885718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-39eee72a-506b-417e-87d6-e63aa141e008 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:10.892280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39eee72a-506b-417e-87d6-e63aa141e008 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:10.892741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39eee72a-506b-417e-87d6-e63aa141e008 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:10.893514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39eee72a-506b-417e-87d6-e63aa141e008 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:10.893952 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39eee72a-506b-417e-87d6-e63aa141e008 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:11.026727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-39eee72a-506b-417e-87d6-e63aa141e008 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:11.034414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-39eee72a-506b-417e-87d6-e63aa141e008 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.153142 Apr 07 13:00:11.034974 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 268/533] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:10 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:11.689739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6d90e858-537a-4291-9036-6c1c7d5748da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:11.690770 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6d90e858-537a-4291-9036-6c1c7d5748da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:11.697142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6d90e858-537a-4291-9036-6c1c7d5748da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:11.697591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6d90e858-537a-4291-9036-6c1c7d5748da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:11.698356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6d90e858-537a-4291-9036-6c1c7d5748da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:11.698797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6d90e858-537a-4291-9036-6c1c7d5748da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:11.727449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6d90e858-537a-4291-9036-6c1c7d5748da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041757 Apr 07 13:00:11.727993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 266/534] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:11 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:11.746505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c414b2c1-14fb-4bae-b084-df7830932152 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:11.747110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c414b2c1-14fb-4bae-b084-df7830932152 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:11.752892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c414b2c1-14fb-4bae-b084-df7830932152 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:11.753332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c414b2c1-14fb-4bae-b084-df7830932152 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:11.754084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c414b2c1-14fb-4bae-b084-df7830932152 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:11.754539 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c414b2c1-14fb-4bae-b084-df7830932152 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:11.897227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c414b2c1-14fb-4bae-b084-df7830932152 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:11.905184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c414b2c1-14fb-4bae-b084-df7830932152 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.162476 Apr 07 13:00:11.906398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 269/535] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:11 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:12.051005 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1e438b8e-edad-468e-abb1-42a5bd48ca46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:12.051644 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1e438b8e-edad-468e-abb1-42a5bd48ca46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:12.057540 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e438b8e-edad-468e-abb1-42a5bd48ca46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:12.057987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e438b8e-edad-468e-abb1-42a5bd48ca46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:12.058740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e438b8e-edad-468e-abb1-42a5bd48ca46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:12.059181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e438b8e-edad-468e-abb1-42a5bd48ca46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:12.187787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1e438b8e-edad-468e-abb1-42a5bd48ca46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:12.195034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1e438b8e-edad-468e-abb1-42a5bd48ca46 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.147800 Apr 07 13:00:12.195591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 267/536] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:12 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:12.738819 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-de5014c0-2470-4980-9735-6d41f4bc6b88 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:12.739811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-de5014c0-2470-4980-9735-6d41f4bc6b88 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:12.745653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de5014c0-2470-4980-9735-6d41f4bc6b88 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:12.746094 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de5014c0-2470-4980-9735-6d41f4bc6b88 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:12.746841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de5014c0-2470-4980-9735-6d41f4bc6b88 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:12.747269 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de5014c0-2470-4980-9735-6d41f4bc6b88 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:12.774891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-de5014c0-2470-4980-9735-6d41f4bc6b88 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039982 Apr 07 13:00:12.775422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 270/537] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:12 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:12.922308 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e4f973f2-ad3a-4a12-b2ec-676401794a16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:12.922925 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e4f973f2-ad3a-4a12-b2ec-676401794a16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:12.929175 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4f973f2-ad3a-4a12-b2ec-676401794a16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:12.929629 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4f973f2-ad3a-4a12-b2ec-676401794a16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:12.930393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4f973f2-ad3a-4a12-b2ec-676401794a16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:12.930829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4f973f2-ad3a-4a12-b2ec-676401794a16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:13.079441 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e4f973f2-ad3a-4a12-b2ec-676401794a16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:13.087166 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e4f973f2-ad3a-4a12-b2ec-676401794a16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.168701 Apr 07 13:00:13.087735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 268/538] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:12 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:13.212784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-befdac01-7a4f-46df-8a5d-0be71aab5d6b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:13.213404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-befdac01-7a4f-46df-8a5d-0be71aab5d6b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:13.219876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-befdac01-7a4f-46df-8a5d-0be71aab5d6b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:13.220363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-befdac01-7a4f-46df-8a5d-0be71aab5d6b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:13.221126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-befdac01-7a4f-46df-8a5d-0be71aab5d6b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:13.221564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-befdac01-7a4f-46df-8a5d-0be71aab5d6b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:13.358995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-befdac01-7a4f-46df-8a5d-0be71aab5d6b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:13.366364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-befdac01-7a4f-46df-8a5d-0be71aab5d6b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.157544 Apr 07 13:00:13.366920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 271/539] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:13 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:13.786930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6bc56e3a-a555-4983-9c4d-a9bb6075b862 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:13.787889 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6bc56e3a-a555-4983-9c4d-a9bb6075b862 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:13.793775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bc56e3a-a555-4983-9c4d-a9bb6075b862 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:13.794225 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bc56e3a-a555-4983-9c4d-a9bb6075b862 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:13.794986 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bc56e3a-a555-4983-9c4d-a9bb6075b862 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:13.795418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bc56e3a-a555-4983-9c4d-a9bb6075b862 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:13.823671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6bc56e3a-a555-4983-9c4d-a9bb6075b862 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040667 Apr 07 13:00:13.824228 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 269/540] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:13 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:14.104298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-116eaaa1-ab5e-40cb-bd3c-8e263955e4a2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:14.104908 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-116eaaa1-ab5e-40cb-bd3c-8e263955e4a2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:14.110852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-116eaaa1-ab5e-40cb-bd3c-8e263955e4a2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:14.111299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-116eaaa1-ab5e-40cb-bd3c-8e263955e4a2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:14.112056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-116eaaa1-ab5e-40cb-bd3c-8e263955e4a2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:14.112518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-116eaaa1-ab5e-40cb-bd3c-8e263955e4a2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:14.255870 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-116eaaa1-ab5e-40cb-bd3c-8e263955e4a2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:14.264030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-116eaaa1-ab5e-40cb-bd3c-8e263955e4a2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.163592 Apr 07 13:00:14.265144 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 272/541] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:14 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:14.383635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0e1b3483-74e1-40cf-980e-1cf9366b28bd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:14.384297 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0e1b3483-74e1-40cf-980e-1cf9366b28bd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:14.391145 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e1b3483-74e1-40cf-980e-1cf9366b28bd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:14.391591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e1b3483-74e1-40cf-980e-1cf9366b28bd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:14.392387 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e1b3483-74e1-40cf-980e-1cf9366b28bd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:14.392831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e1b3483-74e1-40cf-980e-1cf9366b28bd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:14.520848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0e1b3483-74e1-40cf-980e-1cf9366b28bd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:14.528017 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0e1b3483-74e1-40cf-980e-1cf9366b28bd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.148105 Apr 07 13:00:14.528614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 270/542] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:14 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:14.834827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-edaf6946-dc6a-497a-97ee-20005bbcd8f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:14.835788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-edaf6946-dc6a-497a-97ee-20005bbcd8f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:14.841757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-edaf6946-dc6a-497a-97ee-20005bbcd8f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:14.842198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-edaf6946-dc6a-497a-97ee-20005bbcd8f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:14.842985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-edaf6946-dc6a-497a-97ee-20005bbcd8f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:14.843417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-edaf6946-dc6a-497a-97ee-20005bbcd8f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:14.873111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-edaf6946-dc6a-497a-97ee-20005bbcd8f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042217 Apr 07 13:00:14.873655 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 273/543] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:14 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:15.282868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9a7da950-7740-4c0d-abe4-5f8315e4ff63 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:15.283476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9a7da950-7740-4c0d-abe4-5f8315e4ff63 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:15.289324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a7da950-7740-4c0d-abe4-5f8315e4ff63 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:15.289770 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a7da950-7740-4c0d-abe4-5f8315e4ff63 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:15.290521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a7da950-7740-4c0d-abe4-5f8315e4ff63 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:15.290953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a7da950-7740-4c0d-abe4-5f8315e4ff63 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:15.442660 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9a7da950-7740-4c0d-abe4-5f8315e4ff63 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:15.450564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9a7da950-7740-4c0d-abe4-5f8315e4ff63 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.172337 Apr 07 13:00:15.451207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 271/544] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:15 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:15.545114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fd422494-c9f1-4c8d-9907-cf2e1b0fb8f6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:15.545657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fd422494-c9f1-4c8d-9907-cf2e1b0fb8f6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:15.552565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd422494-c9f1-4c8d-9907-cf2e1b0fb8f6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:15.553017 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd422494-c9f1-4c8d-9907-cf2e1b0fb8f6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:15.553773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd422494-c9f1-4c8d-9907-cf2e1b0fb8f6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:15.554207 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd422494-c9f1-4c8d-9907-cf2e1b0fb8f6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:15.687615 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fd422494-c9f1-4c8d-9907-cf2e1b0fb8f6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:15.694928 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fd422494-c9f1-4c8d-9907-cf2e1b0fb8f6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.153654 Apr 07 13:00:15.695514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 274/545] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:15 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:15.886249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b9d2fbb1-0deb-43a8-893b-b29ac88cc34f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:15.887173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b9d2fbb1-0deb-43a8-893b-b29ac88cc34f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:15.893115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9d2fbb1-0deb-43a8-893b-b29ac88cc34f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:15.893572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9d2fbb1-0deb-43a8-893b-b29ac88cc34f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:15.894336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9d2fbb1-0deb-43a8-893b-b29ac88cc34f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:15.894775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9d2fbb1-0deb-43a8-893b-b29ac88cc34f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:15.923703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b9d2fbb1-0deb-43a8-893b-b29ac88cc34f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041470 Apr 07 13:00:15.924283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 272/546] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:15 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:16.467224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4d068f55-94fd-4eeb-afad-44ca67756e82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:16.467920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4d068f55-94fd-4eeb-afad-44ca67756e82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:16.473791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d068f55-94fd-4eeb-afad-44ca67756e82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:16.474321 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d068f55-94fd-4eeb-afad-44ca67756e82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:16.475080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d068f55-94fd-4eeb-afad-44ca67756e82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:16.475526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d068f55-94fd-4eeb-afad-44ca67756e82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:16.622140 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4d068f55-94fd-4eeb-afad-44ca67756e82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:16.630571 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4d068f55-94fd-4eeb-afad-44ca67756e82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.167182 Apr 07 13:00:16.631152 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 275/547] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:16 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:16.711632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2e02ee88-7c74-4013-84e8-fc90ac293d49 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:16.712276 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2e02ee88-7c74-4013-84e8-fc90ac293d49 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:16.718959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2e02ee88-7c74-4013-84e8-fc90ac293d49 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:16.719405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2e02ee88-7c74-4013-84e8-fc90ac293d49 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:16.720180 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2e02ee88-7c74-4013-84e8-fc90ac293d49 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:16.720614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2e02ee88-7c74-4013-84e8-fc90ac293d49 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:16.853729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2e02ee88-7c74-4013-84e8-fc90ac293d49 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:16.861167 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2e02ee88-7c74-4013-84e8-fc90ac293d49 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.153265 Apr 07 13:00:16.861740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 273/548] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:16 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:16.934827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-82b195db-edc1-42e3-a576-d89c382d33ab tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:16.935782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-82b195db-edc1-42e3-a576-d89c382d33ab tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:16.942323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-82b195db-edc1-42e3-a576-d89c382d33ab tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:16.942772 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-82b195db-edc1-42e3-a576-d89c382d33ab tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:16.943532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-82b195db-edc1-42e3-a576-d89c382d33ab tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:16.943964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-82b195db-edc1-42e3-a576-d89c382d33ab tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:16.971638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-82b195db-edc1-42e3-a576-d89c382d33ab tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040733 Apr 07 13:00:16.972214 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 276/549] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:16 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:17.648634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e3d07472-0400-450d-9fcd-a0fafa3e6bd5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:17.649183 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e3d07472-0400-450d-9fcd-a0fafa3e6bd5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:17.655935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e3d07472-0400-450d-9fcd-a0fafa3e6bd5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:17.656419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e3d07472-0400-450d-9fcd-a0fafa3e6bd5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:17.657185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e3d07472-0400-450d-9fcd-a0fafa3e6bd5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:17.657623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e3d07472-0400-450d-9fcd-a0fafa3e6bd5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:17.798107 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e3d07472-0400-450d-9fcd-a0fafa3e6bd5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:17.805819 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e3d07472-0400-450d-9fcd-a0fafa3e6bd5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.161018 Apr 07 13:00:17.806376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 274/550] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:17 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:17.877490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-87e8fb82-bb38-4854-adb6-12e126471037 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:17.878106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-87e8fb82-bb38-4854-adb6-12e126471037 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:17.884388 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-87e8fb82-bb38-4854-adb6-12e126471037 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:17.884850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-87e8fb82-bb38-4854-adb6-12e126471037 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:17.885610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-87e8fb82-bb38-4854-adb6-12e126471037 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:17.886046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-87e8fb82-bb38-4854-adb6-12e126471037 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:17.982527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-42a9e8ca-00d8-44b1-a7b3-25c01e32b495 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:17.983486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-42a9e8ca-00d8-44b1-a7b3-25c01e32b495 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:17.989371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-42a9e8ca-00d8-44b1-a7b3-25c01e32b495 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:17.989827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-42a9e8ca-00d8-44b1-a7b3-25c01e32b495 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:17.990599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-42a9e8ca-00d8-44b1-a7b3-25c01e32b495 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:17.991040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-42a9e8ca-00d8-44b1-a7b3-25c01e32b495 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:18.016973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-87e8fb82-bb38-4854-adb6-12e126471037 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:18.020412 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-42a9e8ca-00d8-44b1-a7b3-25c01e32b495 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041715 Apr 07 13:00:18.020982 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 275/551] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:17 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:18.024491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-87e8fb82-bb38-4854-adb6-12e126471037 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.150917 Apr 07 13:00:18.025049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 277/552] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:17 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:18.822826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e95db8e1-1d0f-4e16-ad03-a65492a66a4d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:18.823344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e95db8e1-1d0f-4e16-ad03-a65492a66a4d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:18.829830 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e95db8e1-1d0f-4e16-ad03-a65492a66a4d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:18.830283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e95db8e1-1d0f-4e16-ad03-a65492a66a4d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:18.831069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e95db8e1-1d0f-4e16-ad03-a65492a66a4d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:18.831504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e95db8e1-1d0f-4e16-ad03-a65492a66a4d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:18.980119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e95db8e1-1d0f-4e16-ad03-a65492a66a4d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:18.989434 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e95db8e1-1d0f-4e16-ad03-a65492a66a4d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.170399 Apr 07 13:00:18.990024 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 276/553] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:18 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:19.032162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-414c1821-24e5-402b-b10b-faf09fe348a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:19.033090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-414c1821-24e5-402b-b10b-faf09fe348a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:19.039553 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-414c1821-24e5-402b-b10b-faf09fe348a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:19.040011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-414c1821-24e5-402b-b10b-faf09fe348a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:19.040794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-414c1821-24e5-402b-b10b-faf09fe348a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:19.041226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-414c1821-24e5-402b-b10b-faf09fe348a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:19.042621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-96b3d33c-4376-4b96-a0a0-85c1bcc35437 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:19.043235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-96b3d33c-4376-4b96-a0a0-85c1bcc35437 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:19.049604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-96b3d33c-4376-4b96-a0a0-85c1bcc35437 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:19.050052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-96b3d33c-4376-4b96-a0a0-85c1bcc35437 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:19.050817 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-96b3d33c-4376-4b96-a0a0-85c1bcc35437 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:19.051253 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-96b3d33c-4376-4b96-a0a0-85c1bcc35437 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:19.071898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-414c1821-24e5-402b-b10b-faf09fe348a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043876 Apr 07 13:00:19.072688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 278/554] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:19 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:19.180797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-96b3d33c-4376-4b96-a0a0-85c1bcc35437 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:19.188715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-96b3d33c-4376-4b96-a0a0-85c1bcc35437 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.149960 Apr 07 13:00:19.189284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 277/555] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:19 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:20.007032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e0446230-4913-41c4-9c61-a6624e424ca9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:20.007644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e0446230-4913-41c4-9c61-a6624e424ca9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:20.013579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0446230-4913-41c4-9c61-a6624e424ca9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:20.014023 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0446230-4913-41c4-9c61-a6624e424ca9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:20.014939 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0446230-4913-41c4-9c61-a6624e424ca9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:20.015199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0446230-4913-41c4-9c61-a6624e424ca9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:20.083481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3ed0963f-c267-42d1-8098-0d44bc0d303f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:20.084543 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3ed0963f-c267-42d1-8098-0d44bc0d303f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:20.090740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3ed0963f-c267-42d1-8098-0d44bc0d303f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:20.091280 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3ed0963f-c267-42d1-8098-0d44bc0d303f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:20.092112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3ed0963f-c267-42d1-8098-0d44bc0d303f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:20.093291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3ed0963f-c267-42d1-8098-0d44bc0d303f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:20.123038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3ed0963f-c267-42d1-8098-0d44bc0d303f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043570 Apr 07 13:00:20.123740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 278/556] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:20 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:20.157610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e0446230-4913-41c4-9c61-a6624e424ca9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:20.165296 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e0446230-4913-41c4-9c61-a6624e424ca9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.162067 Apr 07 13:00:20.165849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 279/557] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:20 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:20.205845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c1620daa-2a5b-467d-bec7-c4a86e84e935 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:20.206479 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c1620daa-2a5b-467d-bec7-c4a86e84e935 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:20.212412 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1620daa-2a5b-467d-bec7-c4a86e84e935 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:20.212859 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1620daa-2a5b-467d-bec7-c4a86e84e935 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:20.213617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1620daa-2a5b-467d-bec7-c4a86e84e935 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:20.214046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1620daa-2a5b-467d-bec7-c4a86e84e935 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:20.352922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c1620daa-2a5b-467d-bec7-c4a86e84e935 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:20.359873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c1620daa-2a5b-467d-bec7-c4a86e84e935 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.158189 Apr 07 13:00:20.360477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 279/558] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:20 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:21.134990 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cf44dfe6-c525-4579-8a34-3e0fe32f760c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:21.135915 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cf44dfe6-c525-4579-8a34-3e0fe32f760c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:21.142286 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cf44dfe6-c525-4579-8a34-3e0fe32f760c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:21.142741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cf44dfe6-c525-4579-8a34-3e0fe32f760c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:21.143508 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cf44dfe6-c525-4579-8a34-3e0fe32f760c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:21.143947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cf44dfe6-c525-4579-8a34-3e0fe32f760c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:21.172092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cf44dfe6-c525-4579-8a34-3e0fe32f760c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040620 Apr 07 13:00:21.172775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 280/559] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:21 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:21.182593 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-83b3dfcf-6b3c-4fab-a9ff-56cc8f9e11cf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:21.183202 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-83b3dfcf-6b3c-4fab-a9ff-56cc8f9e11cf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:21.190117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83b3dfcf-6b3c-4fab-a9ff-56cc8f9e11cf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:21.190570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83b3dfcf-6b3c-4fab-a9ff-56cc8f9e11cf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:21.191333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83b3dfcf-6b3c-4fab-a9ff-56cc8f9e11cf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:21.191773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83b3dfcf-6b3c-4fab-a9ff-56cc8f9e11cf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:21.335158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-83b3dfcf-6b3c-4fab-a9ff-56cc8f9e11cf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:21.342932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-83b3dfcf-6b3c-4fab-a9ff-56cc8f9e11cf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.164220 Apr 07 13:00:21.343645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 280/560] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:21 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:21.378529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-25136257-c570-4920-a2f2-82018ce802ad tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:21.379142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-25136257-c570-4920-a2f2-82018ce802ad tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:21.384907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-25136257-c570-4920-a2f2-82018ce802ad tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:21.385358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-25136257-c570-4920-a2f2-82018ce802ad tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:21.386300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-25136257-c570-4920-a2f2-82018ce802ad tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:21.386737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-25136257-c570-4920-a2f2-82018ce802ad tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:21.519215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-25136257-c570-4920-a2f2-82018ce802ad tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:21.526573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-25136257-c570-4920-a2f2-82018ce802ad tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.152688 Apr 07 13:00:21.527139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 281/561] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:21 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:22.183737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-00cb8ce3-c0bf-4c58-8571-cdb27f7aa1de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:22.184693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-00cb8ce3-c0bf-4c58-8571-cdb27f7aa1de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:22.191630 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-00cb8ce3-c0bf-4c58-8571-cdb27f7aa1de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:22.192079 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-00cb8ce3-c0bf-4c58-8571-cdb27f7aa1de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:22.192870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-00cb8ce3-c0bf-4c58-8571-cdb27f7aa1de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:22.193303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-00cb8ce3-c0bf-4c58-8571-cdb27f7aa1de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:22.221513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-00cb8ce3-c0bf-4c58-8571-cdb27f7aa1de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041739 Apr 07 13:00:22.222063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 281/562] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:22.360680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3b3057a7-9d72-417a-aa65-247b0e2729d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:22.361287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3b3057a7-9d72-417a-aa65-247b0e2729d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:22.367095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b3057a7-9d72-417a-aa65-247b0e2729d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:22.367535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b3057a7-9d72-417a-aa65-247b0e2729d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:22.368349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b3057a7-9d72-417a-aa65-247b0e2729d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:22.368784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b3057a7-9d72-417a-aa65-247b0e2729d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:22.510704 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3b3057a7-9d72-417a-aa65-247b0e2729d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:22.518579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3b3057a7-9d72-417a-aa65-247b0e2729d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.162480 Apr 07 13:00:22.519148 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 282/563] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:22 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:22.544116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-09f95bbd-a492-4ddc-aa9d-f2d218826877 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:22.544752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-09f95bbd-a492-4ddc-aa9d-f2d218826877 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:22.551336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-09f95bbd-a492-4ddc-aa9d-f2d218826877 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:22.551786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-09f95bbd-a492-4ddc-aa9d-f2d218826877 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:22.552593 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-09f95bbd-a492-4ddc-aa9d-f2d218826877 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:22.553034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-09f95bbd-a492-4ddc-aa9d-f2d218826877 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:22.689583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-09f95bbd-a492-4ddc-aa9d-f2d218826877 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:22.696887 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-09f95bbd-a492-4ddc-aa9d-f2d218826877 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.156558 Apr 07 13:00:22.697447 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 282/564] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:22 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:23.233154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4f142341-3461-4866-a1b9-6e8f3bea2ffa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:23.234065 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4f142341-3461-4866-a1b9-6e8f3bea2ffa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:23.239948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f142341-3461-4866-a1b9-6e8f3bea2ffa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:23.240426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f142341-3461-4866-a1b9-6e8f3bea2ffa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:23.241183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f142341-3461-4866-a1b9-6e8f3bea2ffa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:23.241609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f142341-3461-4866-a1b9-6e8f3bea2ffa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:23.271452 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4f142341-3461-4866-a1b9-6e8f3bea2ffa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042221 Apr 07 13:00:23.272010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 283/565] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:23 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:23.535949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8bef8d25-fca9-4173-bb04-00a339a324a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:23.536518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8bef8d25-fca9-4173-bb04-00a339a324a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:23.542816 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8bef8d25-fca9-4173-bb04-00a339a324a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:23.543269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8bef8d25-fca9-4173-bb04-00a339a324a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:23.544028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8bef8d25-fca9-4173-bb04-00a339a324a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:23.544504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8bef8d25-fca9-4173-bb04-00a339a324a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:23.688635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8bef8d25-fca9-4173-bb04-00a339a324a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:23.696700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8bef8d25-fca9-4173-bb04-00a339a324a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.164593 Apr 07 13:00:23.697303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 283/566] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:23 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:23.714534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c529b5c6-91ca-4e71-87c0-f1621f2e3fdd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:23.715145 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c529b5c6-91ca-4e71-87c0-f1621f2e3fdd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:23.721400 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c529b5c6-91ca-4e71-87c0-f1621f2e3fdd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:23.721853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c529b5c6-91ca-4e71-87c0-f1621f2e3fdd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:23.722614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c529b5c6-91ca-4e71-87c0-f1621f2e3fdd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:23.723051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c529b5c6-91ca-4e71-87c0-f1621f2e3fdd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:23.860243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c529b5c6-91ca-4e71-87c0-f1621f2e3fdd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:23.867506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c529b5c6-91ca-4e71-87c0-f1621f2e3fdd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.156776 Apr 07 13:00:23.868068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 284/567] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:23 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:24.283893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-67b903d1-f96b-49b1-a351-5b7a1aedea2d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:24.284838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-67b903d1-f96b-49b1-a351-5b7a1aedea2d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:24.290709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-67b903d1-f96b-49b1-a351-5b7a1aedea2d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:24.291161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-67b903d1-f96b-49b1-a351-5b7a1aedea2d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:24.291915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-67b903d1-f96b-49b1-a351-5b7a1aedea2d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:24.292385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-67b903d1-f96b-49b1-a351-5b7a1aedea2d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:24.319581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-67b903d1-f96b-49b1-a351-5b7a1aedea2d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040586 Apr 07 13:00:24.320124 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 284/568] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:24 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:24.714276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-39fae937-0661-49b4-a2b6-6b5ecb4a0a21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:24.714887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-39fae937-0661-49b4-a2b6-6b5ecb4a0a21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:24.721237 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39fae937-0661-49b4-a2b6-6b5ecb4a0a21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:24.721685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39fae937-0661-49b4-a2b6-6b5ecb4a0a21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:24.722449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39fae937-0661-49b4-a2b6-6b5ecb4a0a21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:24.722885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39fae937-0661-49b4-a2b6-6b5ecb4a0a21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:24.865091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-39fae937-0661-49b4-a2b6-6b5ecb4a0a21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:24.873104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-39fae937-0661-49b4-a2b6-6b5ecb4a0a21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.162613 Apr 07 13:00:24.873665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 285/569] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:24 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:24.884975 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0cefc1d1-3b06-4d2e-9b3d-f0e325fffd06 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:24.885596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0cefc1d1-3b06-4d2e-9b3d-f0e325fffd06 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:24.892920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0cefc1d1-3b06-4d2e-9b3d-f0e325fffd06 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:24.893376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0cefc1d1-3b06-4d2e-9b3d-f0e325fffd06 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:24.894144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0cefc1d1-3b06-4d2e-9b3d-f0e325fffd06 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:24.894586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0cefc1d1-3b06-4d2e-9b3d-f0e325fffd06 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:25.048797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0cefc1d1-3b06-4d2e-9b3d-f0e325fffd06 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:25.056092 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0cefc1d1-3b06-4d2e-9b3d-f0e325fffd06 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.174837 Apr 07 13:00:25.056677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 285/570] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:24 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:25.331872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b34e7814-21dd-48aa-b135-db526d2c9cb0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:25.332827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b34e7814-21dd-48aa-b135-db526d2c9cb0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:25.338695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b34e7814-21dd-48aa-b135-db526d2c9cb0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:25.339140 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b34e7814-21dd-48aa-b135-db526d2c9cb0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:25.339895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b34e7814-21dd-48aa-b135-db526d2c9cb0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:25.340359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b34e7814-21dd-48aa-b135-db526d2c9cb0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:25.367836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b34e7814-21dd-48aa-b135-db526d2c9cb0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040587 Apr 07 13:00:25.368415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 286/571] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:25 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:25.890091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ef811f64-5d64-4225-8581-ad070743c897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:25.891117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ef811f64-5d64-4225-8581-ad070743c897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:25.896958 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef811f64-5d64-4225-8581-ad070743c897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:25.897534 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef811f64-5d64-4225-8581-ad070743c897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:25.898318 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef811f64-5d64-4225-8581-ad070743c897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:25.898762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef811f64-5d64-4225-8581-ad070743c897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:26.051179 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ef811f64-5d64-4225-8581-ad070743c897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:26.059015 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ef811f64-5d64-4225-8581-ad070743c897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.172826 Apr 07 13:00:26.059573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 286/572] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:25 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:26.073577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c03bbf5b-77f7-41b6-97b0-1e1beca581a9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:26.074192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c03bbf5b-77f7-41b6-97b0-1e1beca581a9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:26.080606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c03bbf5b-77f7-41b6-97b0-1e1beca581a9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:26.081062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c03bbf5b-77f7-41b6-97b0-1e1beca581a9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:26.081829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c03bbf5b-77f7-41b6-97b0-1e1beca581a9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:26.082270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c03bbf5b-77f7-41b6-97b0-1e1beca581a9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:26.214897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c03bbf5b-77f7-41b6-97b0-1e1beca581a9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:26.223016 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c03bbf5b-77f7-41b6-97b0-1e1beca581a9 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.153228 Apr 07 13:00:26.223578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 287/573] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:26 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:26.379298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-39dfc180-9e81-4897-bdcd-2d38d40c7fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:26.380244 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-39dfc180-9e81-4897-bdcd-2d38d40c7fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:26.386567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-39dfc180-9e81-4897-bdcd-2d38d40c7fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:26.387013 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-39dfc180-9e81-4897-bdcd-2d38d40c7fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:26.387776 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-39dfc180-9e81-4897-bdcd-2d38d40c7fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:26.388231 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-39dfc180-9e81-4897-bdcd-2d38d40c7fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:26.417256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-39dfc180-9e81-4897-bdcd-2d38d40c7fef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041573 Apr 07 13:00:26.418142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 287/574] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:26 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:27.076637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5a0b35b7-301b-44ba-a08c-ab06d816f47d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:27.077252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5a0b35b7-301b-44ba-a08c-ab06d816f47d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:27.083728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a0b35b7-301b-44ba-a08c-ab06d816f47d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:27.084208 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a0b35b7-301b-44ba-a08c-ab06d816f47d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:27.084970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a0b35b7-301b-44ba-a08c-ab06d816f47d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:27.085407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a0b35b7-301b-44ba-a08c-ab06d816f47d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:27.228707 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5a0b35b7-301b-44ba-a08c-ab06d816f47d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:27.238154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5a0b35b7-301b-44ba-a08c-ab06d816f47d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.165400 Apr 07 13:00:27.238721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 288/575] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:27 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:27.240640 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8e36b950-86a6-4c58-bb7f-736b1930878f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:27.241260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8e36b950-86a6-4c58-bb7f-736b1930878f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:27.247444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8e36b950-86a6-4c58-bb7f-736b1930878f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:27.247902 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8e36b950-86a6-4c58-bb7f-736b1930878f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:27.248705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8e36b950-86a6-4c58-bb7f-736b1930878f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:27.249150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8e36b950-86a6-4c58-bb7f-736b1930878f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:27.379708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8e36b950-86a6-4c58-bb7f-736b1930878f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:27.386921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8e36b950-86a6-4c58-bb7f-736b1930878f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.150137 Apr 07 13:00:27.387479 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 288/576] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:27 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:27.429145 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-098058be-580e-4c31-892d-b5f03b5027ca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:27.430063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-098058be-580e-4c31-892d-b5f03b5027ca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:27.435818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-098058be-580e-4c31-892d-b5f03b5027ca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:27.436309 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-098058be-580e-4c31-892d-b5f03b5027ca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:27.437070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-098058be-580e-4c31-892d-b5f03b5027ca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:27.437505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-098058be-580e-4c31-892d-b5f03b5027ca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:27.464502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-098058be-580e-4c31-892d-b5f03b5027ca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039255 Apr 07 13:00:27.465049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 289/577] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:27 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:28.255343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e4fcc960-e8b3-44f6-b98a-192238aa6adf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:28.255901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e4fcc960-e8b3-44f6-b98a-192238aa6adf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:28.262212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4fcc960-e8b3-44f6-b98a-192238aa6adf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:28.262806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4fcc960-e8b3-44f6-b98a-192238aa6adf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:28.263442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4fcc960-e8b3-44f6-b98a-192238aa6adf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:28.263882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4fcc960-e8b3-44f6-b98a-192238aa6adf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:28.403628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-03b8c3df-6a3c-4ba6-b2f8-ca2b5c20be0b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:28.404287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-03b8c3df-6a3c-4ba6-b2f8-ca2b5c20be0b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:28.408035 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e4fcc960-e8b3-44f6-b98a-192238aa6adf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:28.410839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03b8c3df-6a3c-4ba6-b2f8-ca2b5c20be0b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:28.411291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03b8c3df-6a3c-4ba6-b2f8-ca2b5c20be0b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:28.412061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03b8c3df-6a3c-4ba6-b2f8-ca2b5c20be0b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:28.412521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03b8c3df-6a3c-4ba6-b2f8-ca2b5c20be0b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:28.416037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e4fcc960-e8b3-44f6-b98a-192238aa6adf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.164499 Apr 07 13:00:28.416657 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 289/578] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:28 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:28.475435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-002c08a8-949d-4579-b832-371139f6cc95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:28.476469 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-002c08a8-949d-4579-b832-371139f6cc95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:28.482270 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-002c08a8-949d-4579-b832-371139f6cc95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:28.482741 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-002c08a8-949d-4579-b832-371139f6cc95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:28.483501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-002c08a8-949d-4579-b832-371139f6cc95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:28.483940 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-002c08a8-949d-4579-b832-371139f6cc95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:28.512774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-002c08a8-949d-4579-b832-371139f6cc95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041161 Apr 07 13:00:28.513295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 290/579] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:28 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:28.546261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-03b8c3df-6a3c-4ba6-b2f8-ca2b5c20be0b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:28.554142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-03b8c3df-6a3c-4ba6-b2f8-ca2b5c20be0b tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.154286 Apr 07 13:00:28.554709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 290/580] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:28 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:29.433141 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ca69fc4c-a6dc-49d0-a8de-8a941108ea8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:29.433751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ca69fc4c-a6dc-49d0-a8de-8a941108ea8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:29.440761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca69fc4c-a6dc-49d0-a8de-8a941108ea8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:29.441206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca69fc4c-a6dc-49d0-a8de-8a941108ea8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:29.441967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca69fc4c-a6dc-49d0-a8de-8a941108ea8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:29.442400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca69fc4c-a6dc-49d0-a8de-8a941108ea8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:29.525556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3bdcd97e-153f-4154-afe8-42f6c799791a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:29.526476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3bdcd97e-153f-4154-afe8-42f6c799791a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:29.533207 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bdcd97e-153f-4154-afe8-42f6c799791a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:29.533658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bdcd97e-153f-4154-afe8-42f6c799791a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:29.534427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bdcd97e-153f-4154-afe8-42f6c799791a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:29.534860 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bdcd97e-153f-4154-afe8-42f6c799791a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:29.563871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3bdcd97e-153f-4154-afe8-42f6c799791a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042231 Apr 07 13:00:29.564471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 291/581] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:29 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:29.571451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f7cf95d6-777d-44fb-b99e-98bd0202cd4e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:29.572058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f7cf95d6-777d-44fb-b99e-98bd0202cd4e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:29.577748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7cf95d6-777d-44fb-b99e-98bd0202cd4e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:29.578423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7cf95d6-777d-44fb-b99e-98bd0202cd4e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:29.579200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7cf95d6-777d-44fb-b99e-98bd0202cd4e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:29.579641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7cf95d6-777d-44fb-b99e-98bd0202cd4e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:29.587428 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ca69fc4c-a6dc-49d0-a8de-8a941108ea8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:29.596431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ca69fc4c-a6dc-49d0-a8de-8a941108ea8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.167011 Apr 07 13:00:29.597013 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 291/582] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:29 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:29.714627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f7cf95d6-777d-44fb-b99e-98bd0202cd4e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:29.722652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f7cf95d6-777d-44fb-b99e-98bd0202cd4e tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.154691 Apr 07 13:00:29.723218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 292/583] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:29 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:30.575676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4476c043-e75f-48a8-bb6d-b87e2a8c48ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:30.577274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4476c043-e75f-48a8-bb6d-b87e2a8c48ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:30.584437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4476c043-e75f-48a8-bb6d-b87e2a8c48ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:30.584896 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4476c043-e75f-48a8-bb6d-b87e2a8c48ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:30.585701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4476c043-e75f-48a8-bb6d-b87e2a8c48ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:30.586143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4476c043-e75f-48a8-bb6d-b87e2a8c48ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:30.613260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fb1b6543-13a5-4f68-87e7-8a8a529b4be9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:30.613868 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fb1b6543-13a5-4f68-87e7-8a8a529b4be9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:30.614542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4476c043-e75f-48a8-bb6d-b87e2a8c48ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043021 Apr 07 13:00:30.615282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 292/584] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:30 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:30.620343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb1b6543-13a5-4f68-87e7-8a8a529b4be9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:30.620791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb1b6543-13a5-4f68-87e7-8a8a529b4be9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:30.621587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb1b6543-13a5-4f68-87e7-8a8a529b4be9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:30.622021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb1b6543-13a5-4f68-87e7-8a8a529b4be9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:30.739420 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9d672c4d-c48f-4f0d-aeea-d8d012915241 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:30.740049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9d672c4d-c48f-4f0d-aeea-d8d012915241 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:30.745784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d672c4d-c48f-4f0d-aeea-d8d012915241 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:30.746234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d672c4d-c48f-4f0d-aeea-d8d012915241 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:30.747001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d672c4d-c48f-4f0d-aeea-d8d012915241 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:30.747449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d672c4d-c48f-4f0d-aeea-d8d012915241 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:30.766570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fb1b6543-13a5-4f68-87e7-8a8a529b4be9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:30.774346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fb1b6543-13a5-4f68-87e7-8a8a529b4be9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.164880 Apr 07 13:00:30.774940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 293/585] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:30 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:30.879116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9d672c4d-c48f-4f0d-aeea-d8d012915241 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:30.886305 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9d672c4d-c48f-4f0d-aeea-d8d012915241 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.150776 Apr 07 13:00:30.886865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 293/586] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:30 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:31.627020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-47cf5246-0dcb-432e-b029-ca10ee9b8473 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:31.627935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-47cf5246-0dcb-432e-b029-ca10ee9b8473 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:31.634273 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-47cf5246-0dcb-432e-b029-ca10ee9b8473 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:31.634718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-47cf5246-0dcb-432e-b029-ca10ee9b8473 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:31.635467 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-47cf5246-0dcb-432e-b029-ca10ee9b8473 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:31.635894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-47cf5246-0dcb-432e-b029-ca10ee9b8473 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:31.663280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-47cf5246-0dcb-432e-b029-ca10ee9b8473 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041055 Apr 07 13:00:31.663809 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 294/587] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:31 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:31.792110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b9fb3a5e-e5e7-41c1-bd64-66b26c80c773 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:31.792754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b9fb3a5e-e5e7-41c1-bd64-66b26c80c773 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:31.799508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9fb3a5e-e5e7-41c1-bd64-66b26c80c773 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:31.799965 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9fb3a5e-e5e7-41c1-bd64-66b26c80c773 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:31.800774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9fb3a5e-e5e7-41c1-bd64-66b26c80c773 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:31.801218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9fb3a5e-e5e7-41c1-bd64-66b26c80c773 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:31.903883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6d33a530-19e1-45c8-b18b-57925752e8aa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:31.904789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6d33a530-19e1-45c8-b18b-57925752e8aa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:31.911219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d33a530-19e1-45c8-b18b-57925752e8aa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:31.911670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d33a530-19e1-45c8-b18b-57925752e8aa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:31.912457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d33a530-19e1-45c8-b18b-57925752e8aa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:31.912895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d33a530-19e1-45c8-b18b-57925752e8aa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:31.946639 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b9fb3a5e-e5e7-41c1-bd64-66b26c80c773 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:31.954600 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b9fb3a5e-e5e7-41c1-bd64-66b26c80c773 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.166294 Apr 07 13:00:31.955175 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 294/588] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:31 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:32.045472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6d33a530-19e1-45c8-b18b-57925752e8aa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:32.052821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6d33a530-19e1-45c8-b18b-57925752e8aa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.152714 Apr 07 13:00:32.053391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 295/589] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:31 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:32.674945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f94f4564-b4ba-4057-87ee-3f54ea2e84e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:32.675866 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f94f4564-b4ba-4057-87ee-3f54ea2e84e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:32.681795 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f94f4564-b4ba-4057-87ee-3f54ea2e84e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:32.682253 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f94f4564-b4ba-4057-87ee-3f54ea2e84e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:32.683018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f94f4564-b4ba-4057-87ee-3f54ea2e84e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:32.683457 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f94f4564-b4ba-4057-87ee-3f54ea2e84e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:32.711862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f94f4564-b4ba-4057-87ee-3f54ea2e84e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040904 Apr 07 13:00:32.712439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 295/590] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:32 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:32.971867 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8779214e-a5d9-4954-bd5f-2c3cafb5186f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:32.972523 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8779214e-a5d9-4954-bd5f-2c3cafb5186f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:32.978948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8779214e-a5d9-4954-bd5f-2c3cafb5186f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:32.979394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8779214e-a5d9-4954-bd5f-2c3cafb5186f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:32.980170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8779214e-a5d9-4954-bd5f-2c3cafb5186f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:32.980604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8779214e-a5d9-4954-bd5f-2c3cafb5186f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:33.070527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5ab3d4a6-effa-4263-a3be-6302246145df tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:33.071144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5ab3d4a6-effa-4263-a3be-6302246145df tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:33.077438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ab3d4a6-effa-4263-a3be-6302246145df tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:33.078271 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ab3d4a6-effa-4263-a3be-6302246145df tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:33.079145 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ab3d4a6-effa-4263-a3be-6302246145df tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:33.079592 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ab3d4a6-effa-4263-a3be-6302246145df tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:33.123460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8779214e-a5d9-4954-bd5f-2c3cafb5186f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:33.131881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8779214e-a5d9-4954-bd5f-2c3cafb5186f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.164017 Apr 07 13:00:33.132484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 296/591] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:32 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:33.210009 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5ab3d4a6-effa-4263-a3be-6302246145df tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:33.217503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5ab3d4a6-effa-4263-a3be-6302246145df tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1679 microversion: 2.1 time: 0.150700 Apr 07 13:00:33.218061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 296/592] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:33 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:33.723434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3c4e5dfb-389f-4c76-87d3-711eb5672535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:33.724384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3c4e5dfb-389f-4c76-87d3-711eb5672535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:33.730220 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c4e5dfb-389f-4c76-87d3-711eb5672535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:33.730669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c4e5dfb-389f-4c76-87d3-711eb5672535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:33.731421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c4e5dfb-389f-4c76-87d3-711eb5672535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:33.731858 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c4e5dfb-389f-4c76-87d3-711eb5672535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:33.759445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3c4e5dfb-389f-4c76-87d3-711eb5672535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039998 Apr 07 13:00:33.759988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 297/593] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:33 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:34.149252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dda84976-f17f-44dc-b44b-3c1d6be490bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:34.149867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dda84976-f17f-44dc-b44b-3c1d6be490bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:34.156808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dda84976-f17f-44dc-b44b-3c1d6be490bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:34.157264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dda84976-f17f-44dc-b44b-3c1d6be490bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:34.158049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dda84976-f17f-44dc-b44b-3c1d6be490bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:34.158488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dda84976-f17f-44dc-b44b-3c1d6be490bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:34.234871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-983372fa-34ca-4711-b77f-215c719aacc7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:34.236810 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-983372fa-34ca-4711-b77f-215c719aacc7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:34.243913 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-983372fa-34ca-4711-b77f-215c719aacc7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:34.244471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-983372fa-34ca-4711-b77f-215c719aacc7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:34.245333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-983372fa-34ca-4711-b77f-215c719aacc7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:34.245852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-983372fa-34ca-4711-b77f-215c719aacc7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:34.303211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dda84976-f17f-44dc-b44b-3c1d6be490bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:34.311175 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dda84976-f17f-44dc-b44b-3c1d6be490bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.165700 Apr 07 13:00:34.312040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 297/594] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:34 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:34.387041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-983372fa-34ca-4711-b77f-215c719aacc7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:34.395606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-983372fa-34ca-4711-b77f-215c719aacc7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1656 microversion: 2.1 time: 0.165105 Apr 07 13:00:34.396475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 298/595] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:34 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1656 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:34.413955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b9678fdc-07ae-4b6e-8bce-4f14a937008d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:00:34.421030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9678fdc-07ae-4b6e-8bce-4f14a937008d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:34.422233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9678fdc-07ae-4b6e-8bce-4f14a937008d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:34.446251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b9678fdc-07ae-4b6e-8bce-4f14a937008d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Going to try to start instance {{(pid=116892) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 07 13:00:34.496779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b9678fdc-07ae-4b6e-8bce-4f14a937008d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "POST /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/action" status: 202 len: 0 microversion: 2.1 time: 0.086699 Apr 07 13:00:34.497303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 298/596] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 13:00:34 2022] POST /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:00:34.506093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-de522645-4a72-43c6-8470-5acb1bdee982 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:34.506704 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-de522645-4a72-43c6-8470-5acb1bdee982 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:34.512548 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de522645-4a72-43c6-8470-5acb1bdee982 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:34.513008 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de522645-4a72-43c6-8470-5acb1bdee982 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:34.513771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de522645-4a72-43c6-8470-5acb1bdee982 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:34.514209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de522645-4a72-43c6-8470-5acb1bdee982 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:34.648186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-de522645-4a72-43c6-8470-5acb1bdee982 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:34.656439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-de522645-4a72-43c6-8470-5acb1bdee982 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1665 microversion: 2.1 time: 0.153400 Apr 07 13:00:34.657070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 299/597] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:34 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:34.772427 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-11c3c4f0-8227-432d-8cae-59f098636ed3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:34.773373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-11c3c4f0-8227-432d-8cae-59f098636ed3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:34.779770 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11c3c4f0-8227-432d-8cae-59f098636ed3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:34.780251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11c3c4f0-8227-432d-8cae-59f098636ed3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:34.781680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11c3c4f0-8227-432d-8cae-59f098636ed3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:34.782185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11c3c4f0-8227-432d-8cae-59f098636ed3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:34.821558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-11c3c4f0-8227-432d-8cae-59f098636ed3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053286 Apr 07 13:00:34.822588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 299/598] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:34 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:35.330326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f2b36a74-2edb-4294-833e-603cf19834ee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:35.330326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f2b36a74-2edb-4294-833e-603cf19834ee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:35.336505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f2b36a74-2edb-4294-833e-603cf19834ee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:35.337018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f2b36a74-2edb-4294-833e-603cf19834ee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:35.337776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f2b36a74-2edb-4294-833e-603cf19834ee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:35.338206 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f2b36a74-2edb-4294-833e-603cf19834ee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:35.467716 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ba8355fc-5572-44e4-9732-6fdf349d7cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:00:35.468939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ba8355fc-5572-44e4-9732-6fdf349d7cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:35.475196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ba8355fc-5572-44e4-9732-6fdf349d7cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:35.475653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ba8355fc-5572-44e4-9732-6fdf349d7cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:35.476717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ba8355fc-5572-44e4-9732-6fdf349d7cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:35.477147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ba8355fc-5572-44e4-9732-6fdf349d7cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:35.494816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f2b36a74-2edb-4294-833e-603cf19834ee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:35.501754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-ba8355fc-5572-44e4-9732-6fdf349d7cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'flavor' on Instance uuid 1c2c5542-86c5-4fe4-9287-ed9dc322b189 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:00:35.503129 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f2b36a74-2edb-4294-833e-603cf19834ee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1752 microversion: 2.1 time: 0.178589 Apr 07 13:00:35.503817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 300/599] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:35 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:35.632918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ba8355fc-5572-44e4-9732-6fdf349d7cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "POST /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/action" status: 200 len: 32 microversion: 2.1 time: 0.168730 Apr 07 13:00:35.633654 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 300/600] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 13:00:35 2022] POST /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 07 13:00:35.643736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-51928a96-6d2a-4ed0-87ef-9d155bc2196b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:35.644572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-51928a96-6d2a-4ed0-87ef-9d155bc2196b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:35.652005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51928a96-6d2a-4ed0-87ef-9d155bc2196b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:35.652504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51928a96-6d2a-4ed0-87ef-9d155bc2196b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:35.653536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51928a96-6d2a-4ed0-87ef-9d155bc2196b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:35.654136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51928a96-6d2a-4ed0-87ef-9d155bc2196b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:35.675338 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-19d5a4fc-be3e-410b-a8b6-879eba8ed060 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:35.676131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-19d5a4fc-be3e-410b-a8b6-879eba8ed060 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:35.682946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-19d5a4fc-be3e-410b-a8b6-879eba8ed060 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:35.683614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-19d5a4fc-be3e-410b-a8b6-879eba8ed060 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:35.684592 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-19d5a4fc-be3e-410b-a8b6-879eba8ed060 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:35.685183 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-19d5a4fc-be3e-410b-a8b6-879eba8ed060 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:35.892517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-51928a96-6d2a-4ed0-87ef-9d155bc2196b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:35.901226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-51928a96-6d2a-4ed0-87ef-9d155bc2196b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.262258 Apr 07 13:00:35.902347 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 301/601] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:35 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:35.908917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3ea6e891-9a2e-4dda-a303-e2df31b73bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:35.910159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3ea6e891-9a2e-4dda-a303-e2df31b73bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:35.918388 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3ea6e891-9a2e-4dda-a303-e2df31b73bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:35.919158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3ea6e891-9a2e-4dda-a303-e2df31b73bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:35.920224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3ea6e891-9a2e-4dda-a303-e2df31b73bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:35.920670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3ea6e891-9a2e-4dda-a303-e2df31b73bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:35.958483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3ea6e891-9a2e-4dda-a303-e2df31b73bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054440 Apr 07 13:00:35.959409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 302/602] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:35 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:36.056383 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-19d5a4fc-be3e-410b-a8b6-879eba8ed060 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:36.064557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-19d5a4fc-be3e-410b-a8b6-879eba8ed060 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1665 microversion: 2.1 time: 0.394363 Apr 07 13:00:36.065144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 301/603] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:35 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1665 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:36.520719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-91f97ca3-a2d3-42f1-be5d-4895bdc033ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:36.521325 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-91f97ca3-a2d3-42f1-be5d-4895bdc033ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:36.527441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91f97ca3-a2d3-42f1-be5d-4895bdc033ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:36.527884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91f97ca3-a2d3-42f1-be5d-4895bdc033ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:36.528687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91f97ca3-a2d3-42f1-be5d-4895bdc033ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:36.529117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91f97ca3-a2d3-42f1-be5d-4895bdc033ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:36.672492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-91f97ca3-a2d3-42f1-be5d-4895bdc033ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:36.680297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-91f97ca3-a2d3-42f1-be5d-4895bdc033ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.163337 Apr 07 13:00:36.680858 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 303/604] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:36 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:36.919504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-70f05462-5b9a-4853-a67c-72b92e63dfea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:36.920042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-70f05462-5b9a-4853-a67c-72b92e63dfea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:36.926624 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-70f05462-5b9a-4853-a67c-72b92e63dfea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:36.927106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-70f05462-5b9a-4853-a67c-72b92e63dfea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:36.927890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-70f05462-5b9a-4853-a67c-72b92e63dfea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:36.928372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-70f05462-5b9a-4853-a67c-72b92e63dfea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:36.970345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8a7e4bf3-7c34-4ba9-9021-84c8a2e44472 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:36.971274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8a7e4bf3-7c34-4ba9-9021-84c8a2e44472 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:36.977180 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a7e4bf3-7c34-4ba9-9021-84c8a2e44472 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:36.977631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a7e4bf3-7c34-4ba9-9021-84c8a2e44472 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:36.978398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a7e4bf3-7c34-4ba9-9021-84c8a2e44472 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:36.978836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a7e4bf3-7c34-4ba9-9021-84c8a2e44472 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:37.007120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8a7e4bf3-7c34-4ba9-9021-84c8a2e44472 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041337 Apr 07 13:00:37.007684 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 304/605] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:36 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:37.059587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-70f05462-5b9a-4853-a67c-72b92e63dfea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:37.067860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-70f05462-5b9a-4853-a67c-72b92e63dfea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152235 Apr 07 13:00:37.068455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 302/606] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:36 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:37.082452 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ac8d7f0d-25cf-4b41-b554-7d95921fcdc6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:37.083077 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ac8d7f0d-25cf-4b41-b554-7d95921fcdc6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:37.089050 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ac8d7f0d-25cf-4b41-b554-7d95921fcdc6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:37.089500 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ac8d7f0d-25cf-4b41-b554-7d95921fcdc6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:37.090262 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ac8d7f0d-25cf-4b41-b554-7d95921fcdc6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:37.090700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ac8d7f0d-25cf-4b41-b554-7d95921fcdc6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:37.221649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ac8d7f0d-25cf-4b41-b554-7d95921fcdc6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:37.228893 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ac8d7f0d-25cf-4b41-b554-7d95921fcdc6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1669 microversion: 2.1 time: 0.150227 Apr 07 13:00:37.229454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 305/607] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:37 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:37.697281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cf888de0-5181-4a2a-b380-a268ffda769b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:37.698281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cf888de0-5181-4a2a-b380-a268ffda769b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:37.704674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf888de0-5181-4a2a-b380-a268ffda769b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:37.705121 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf888de0-5181-4a2a-b380-a268ffda769b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:37.705878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf888de0-5181-4a2a-b380-a268ffda769b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:37.706309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf888de0-5181-4a2a-b380-a268ffda769b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:37.853713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cf888de0-5181-4a2a-b380-a268ffda769b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:37.862174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cf888de0-5181-4a2a-b380-a268ffda769b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.169115 Apr 07 13:00:37.862751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 303/608] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:37 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:38.019144 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fd9736b1-eed8-4fff-85f4-0c7ac9bd32b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:38.020111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fd9736b1-eed8-4fff-85f4-0c7ac9bd32b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:38.026430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd9736b1-eed8-4fff-85f4-0c7ac9bd32b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:38.026876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd9736b1-eed8-4fff-85f4-0c7ac9bd32b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:38.027627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd9736b1-eed8-4fff-85f4-0c7ac9bd32b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:38.028053 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd9736b1-eed8-4fff-85f4-0c7ac9bd32b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:38.058271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fd9736b1-eed8-4fff-85f4-0c7ac9bd32b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043399 Apr 07 13:00:38.058795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 306/609] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:38 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:38.084415 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-77ed1e73-6762-4179-ad38-615d33d8ddf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:38.085025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-77ed1e73-6762-4179-ad38-615d33d8ddf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:38.091220 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77ed1e73-6762-4179-ad38-615d33d8ddf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:38.091668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77ed1e73-6762-4179-ad38-615d33d8ddf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:38.092456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77ed1e73-6762-4179-ad38-615d33d8ddf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:38.093439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77ed1e73-6762-4179-ad38-615d33d8ddf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:38.224242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-77ed1e73-6762-4179-ad38-615d33d8ddf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:38.232018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-77ed1e73-6762-4179-ad38-615d33d8ddf5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151344 Apr 07 13:00:38.232602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 304/610] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:38.879687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3f5984bc-84d1-4a0b-89c1-1c55b6664d1c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:38.880331 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3f5984bc-84d1-4a0b-89c1-1c55b6664d1c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:38.886211 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f5984bc-84d1-4a0b-89c1-1c55b6664d1c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:38.886661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f5984bc-84d1-4a0b-89c1-1c55b6664d1c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:38.887445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f5984bc-84d1-4a0b-89c1-1c55b6664d1c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:38.887879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f5984bc-84d1-4a0b-89c1-1c55b6664d1c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:39.028448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3f5984bc-84d1-4a0b-89c1-1c55b6664d1c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:39.036543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3f5984bc-84d1-4a0b-89c1-1c55b6664d1c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.160463 Apr 07 13:00:39.037106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 307/611] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:38 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:39.070152 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ea9380c8-7f36-4ec4-b2cd-72dbf367e524 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:39.071162 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ea9380c8-7f36-4ec4-b2cd-72dbf367e524 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:39.077053 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea9380c8-7f36-4ec4-b2cd-72dbf367e524 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:39.077617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea9380c8-7f36-4ec4-b2cd-72dbf367e524 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:39.078387 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea9380c8-7f36-4ec4-b2cd-72dbf367e524 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:39.078826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea9380c8-7f36-4ec4-b2cd-72dbf367e524 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:39.106073 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ea9380c8-7f36-4ec4-b2cd-72dbf367e524 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039842 Apr 07 13:00:39.106644 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 305/612] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:39 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:39.248815 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-04637b6a-7675-4876-b4d8-dbc3413ebf67 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:39.250140 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-04637b6a-7675-4876-b4d8-dbc3413ebf67 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:39.255971 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04637b6a-7675-4876-b4d8-dbc3413ebf67 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:39.256459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04637b6a-7675-4876-b4d8-dbc3413ebf67 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:39.257227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04637b6a-7675-4876-b4d8-dbc3413ebf67 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:39.257666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04637b6a-7675-4876-b4d8-dbc3413ebf67 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:39.391331 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-04637b6a-7675-4876-b4d8-dbc3413ebf67 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:39.399340 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-04637b6a-7675-4876-b4d8-dbc3413ebf67 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154371 Apr 07 13:00:39.399887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 308/613] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:39 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:40.053566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ea132f16-4245-4065-baf7-b656db42d78d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:40.054175 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ea132f16-4245-4065-baf7-b656db42d78d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:40.060213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea132f16-4245-4065-baf7-b656db42d78d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:40.060667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea132f16-4245-4065-baf7-b656db42d78d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:40.061422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea132f16-4245-4065-baf7-b656db42d78d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:40.062641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea132f16-4245-4065-baf7-b656db42d78d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:40.118590 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f6bcb68d-cb92-439f-94d3-5525bfc17734 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:40.119569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f6bcb68d-cb92-439f-94d3-5525bfc17734 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:40.126014 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f6bcb68d-cb92-439f-94d3-5525bfc17734 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:40.126470 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f6bcb68d-cb92-439f-94d3-5525bfc17734 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:40.127892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f6bcb68d-cb92-439f-94d3-5525bfc17734 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:40.128741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f6bcb68d-cb92-439f-94d3-5525bfc17734 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:40.158547 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f6bcb68d-cb92-439f-94d3-5525bfc17734 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043913 Apr 07 13:00:40.159119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 309/614] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:40 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:40.204374 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ea132f16-4245-4065-baf7-b656db42d78d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:40.212114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ea132f16-4245-4065-baf7-b656db42d78d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.162317 Apr 07 13:00:40.212704 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 306/615] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:40 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:40.417646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1e44f8de-0952-4ad1-b150-9914453a6d6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:40.418294 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1e44f8de-0952-4ad1-b150-9914453a6d6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:40.426440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e44f8de-0952-4ad1-b150-9914453a6d6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:40.426906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e44f8de-0952-4ad1-b150-9914453a6d6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:40.427689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e44f8de-0952-4ad1-b150-9914453a6d6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:40.428124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e44f8de-0952-4ad1-b150-9914453a6d6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:40.564853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1e44f8de-0952-4ad1-b150-9914453a6d6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:40.572579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1e44f8de-0952-4ad1-b150-9914453a6d6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.159016 Apr 07 13:00:40.573148 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 310/616] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:40 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:41.170310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1dfb6522-daa1-430c-adad-3eb2063d4227 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:41.171822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1dfb6522-daa1-430c-adad-3eb2063d4227 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:41.178216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1dfb6522-daa1-430c-adad-3eb2063d4227 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:41.178674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1dfb6522-daa1-430c-adad-3eb2063d4227 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:41.179441 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1dfb6522-daa1-430c-adad-3eb2063d4227 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:41.179883 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1dfb6522-daa1-430c-adad-3eb2063d4227 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:41.207304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1dfb6522-daa1-430c-adad-3eb2063d4227 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041009 Apr 07 13:00:41.207920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 307/617] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:41 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:41.229525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8d4e3988-bf2f-45b4-9fd8-7651dcd09f31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:41.230128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8d4e3988-bf2f-45b4-9fd8-7651dcd09f31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:41.237181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d4e3988-bf2f-45b4-9fd8-7651dcd09f31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:41.237623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d4e3988-bf2f-45b4-9fd8-7651dcd09f31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:41.238369 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d4e3988-bf2f-45b4-9fd8-7651dcd09f31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:41.238795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d4e3988-bf2f-45b4-9fd8-7651dcd09f31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:41.385449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8d4e3988-bf2f-45b4-9fd8-7651dcd09f31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:41.394375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8d4e3988-bf2f-45b4-9fd8-7651dcd09f31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.168499 Apr 07 13:00:41.394945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 311/618] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:41 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:41.590163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0e87d2f0-ec9e-418b-9a3a-d8dc633eb88a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:41.590779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0e87d2f0-ec9e-418b-9a3a-d8dc633eb88a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:41.597782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e87d2f0-ec9e-418b-9a3a-d8dc633eb88a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:41.598234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e87d2f0-ec9e-418b-9a3a-d8dc633eb88a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:41.599006 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e87d2f0-ec9e-418b-9a3a-d8dc633eb88a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:41.599451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e87d2f0-ec9e-418b-9a3a-d8dc633eb88a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:41.731706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0e87d2f0-ec9e-418b-9a3a-d8dc633eb88a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:41.739726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0e87d2f0-ec9e-418b-9a3a-d8dc633eb88a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153452 Apr 07 13:00:41.740304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 308/619] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:41 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:42.219559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f54e5f68-02be-4f8e-bd63-4e3ad96969df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:42.220504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f54e5f68-02be-4f8e-bd63-4e3ad96969df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:42.226361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f54e5f68-02be-4f8e-bd63-4e3ad96969df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:42.226811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f54e5f68-02be-4f8e-bd63-4e3ad96969df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:42.227567 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f54e5f68-02be-4f8e-bd63-4e3ad96969df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:42.228002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f54e5f68-02be-4f8e-bd63-4e3ad96969df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:42.255832 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f54e5f68-02be-4f8e-bd63-4e3ad96969df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040825 Apr 07 13:00:42.256622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 312/620] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:42 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:42.411355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5fc422cb-2074-43ff-9fbd-699473bdbc57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:42.411949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5fc422cb-2074-43ff-9fbd-699473bdbc57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:42.418196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5fc422cb-2074-43ff-9fbd-699473bdbc57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:42.418670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5fc422cb-2074-43ff-9fbd-699473bdbc57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:42.419435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5fc422cb-2074-43ff-9fbd-699473bdbc57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:42.419872 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5fc422cb-2074-43ff-9fbd-699473bdbc57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:42.564604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5fc422cb-2074-43ff-9fbd-699473bdbc57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:42.572395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5fc422cb-2074-43ff-9fbd-699473bdbc57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.164776 Apr 07 13:00:42.572960 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 309/621] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:42 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:42.756603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f0242bdc-d728-4c44-b717-adc874b3aecf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:42.757136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f0242bdc-d728-4c44-b717-adc874b3aecf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:42.762983 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f0242bdc-d728-4c44-b717-adc874b3aecf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:42.763430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f0242bdc-d728-4c44-b717-adc874b3aecf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:42.764208 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f0242bdc-d728-4c44-b717-adc874b3aecf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:42.765405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f0242bdc-d728-4c44-b717-adc874b3aecf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:42.898708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f0242bdc-d728-4c44-b717-adc874b3aecf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:42.906854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f0242bdc-d728-4c44-b717-adc874b3aecf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154119 Apr 07 13:00:42.907407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 313/622] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:42 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:43.267891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-864172f1-74e4-4359-8ddf-b4909a6c3369 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:43.268773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-864172f1-74e4-4359-8ddf-b4909a6c3369 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:43.274809 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-864172f1-74e4-4359-8ddf-b4909a6c3369 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:43.275256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-864172f1-74e4-4359-8ddf-b4909a6c3369 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:43.276006 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-864172f1-74e4-4359-8ddf-b4909a6c3369 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:43.276468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-864172f1-74e4-4359-8ddf-b4909a6c3369 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:43.305038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-864172f1-74e4-4359-8ddf-b4909a6c3369 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041482 Apr 07 13:00:43.305581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 310/623] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:43 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:43.590385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-dadd68d6-65fb-447f-bbc7-859dcaedc196 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:43.591030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-dadd68d6-65fb-447f-bbc7-859dcaedc196 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:43.597658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dadd68d6-65fb-447f-bbc7-859dcaedc196 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:43.598325 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dadd68d6-65fb-447f-bbc7-859dcaedc196 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:43.599095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dadd68d6-65fb-447f-bbc7-859dcaedc196 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:43.599527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dadd68d6-65fb-447f-bbc7-859dcaedc196 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:43.741828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-dadd68d6-65fb-447f-bbc7-859dcaedc196 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:43.750316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-dadd68d6-65fb-447f-bbc7-859dcaedc196 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.163092 Apr 07 13:00:43.750872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 314/624] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:43 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:43.923751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b8965ffd-5990-4046-b5e5-440f1e45328e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:43.924431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b8965ffd-5990-4046-b5e5-440f1e45328e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:43.931559 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b8965ffd-5990-4046-b5e5-440f1e45328e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:43.932013 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b8965ffd-5990-4046-b5e5-440f1e45328e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:43.932815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b8965ffd-5990-4046-b5e5-440f1e45328e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:43.933253 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b8965ffd-5990-4046-b5e5-440f1e45328e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:44.068700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b8965ffd-5990-4046-b5e5-440f1e45328e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:44.076392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b8965ffd-5990-4046-b5e5-440f1e45328e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156489 Apr 07 13:00:44.076956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 311/625] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:43 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:44.316427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fdc69ea7-deeb-4d3c-92fa-d9341f5ffe58 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:44.317350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fdc69ea7-deeb-4d3c-92fa-d9341f5ffe58 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:44.323225 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fdc69ea7-deeb-4d3c-92fa-d9341f5ffe58 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:44.323670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fdc69ea7-deeb-4d3c-92fa-d9341f5ffe58 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:44.324457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fdc69ea7-deeb-4d3c-92fa-d9341f5ffe58 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:44.324890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fdc69ea7-deeb-4d3c-92fa-d9341f5ffe58 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:44.353608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fdc69ea7-deeb-4d3c-92fa-d9341f5ffe58 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041243 Apr 07 13:00:44.354168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 315/626] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:44 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:44.767317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7ad1be54-6d7e-4cb5-8547-e71631bd23f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:44.767856 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7ad1be54-6d7e-4cb5-8547-e71631bd23f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:44.773958 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7ad1be54-6d7e-4cb5-8547-e71631bd23f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:44.774403 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7ad1be54-6d7e-4cb5-8547-e71631bd23f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:44.775164 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7ad1be54-6d7e-4cb5-8547-e71631bd23f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:44.775617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7ad1be54-6d7e-4cb5-8547-e71631bd23f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:44.917452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7ad1be54-6d7e-4cb5-8547-e71631bd23f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:44.925530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7ad1be54-6d7e-4cb5-8547-e71631bd23f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.162690 Apr 07 13:00:44.926131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 312/627] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:44 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:45.093880 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-34e1e607-15dc-44ba-9d1e-be39a708dafe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:45.094511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-34e1e607-15dc-44ba-9d1e-be39a708dafe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:45.100857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-34e1e607-15dc-44ba-9d1e-be39a708dafe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:45.101301 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-34e1e607-15dc-44ba-9d1e-be39a708dafe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:45.102052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-34e1e607-15dc-44ba-9d1e-be39a708dafe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:45.102485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-34e1e607-15dc-44ba-9d1e-be39a708dafe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:45.235847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-34e1e607-15dc-44ba-9d1e-be39a708dafe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:45.243555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-34e1e607-15dc-44ba-9d1e-be39a708dafe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153665 Apr 07 13:00:45.244117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 316/628] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:45 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:45.365708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2873b6ee-9ee0-4b04-8d18-4f8df1a97f5e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:45.366646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2873b6ee-9ee0-4b04-8d18-4f8df1a97f5e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:45.372862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2873b6ee-9ee0-4b04-8d18-4f8df1a97f5e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:45.373306 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2873b6ee-9ee0-4b04-8d18-4f8df1a97f5e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:45.374147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2873b6ee-9ee0-4b04-8d18-4f8df1a97f5e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:45.375421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2873b6ee-9ee0-4b04-8d18-4f8df1a97f5e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:45.403355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2873b6ee-9ee0-4b04-8d18-4f8df1a97f5e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041486 Apr 07 13:00:45.403909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 313/629] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:45 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:45.942632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-039e8220-ab9f-45db-845b-b0a3f92f218b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:45.943242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-039e8220-ab9f-45db-845b-b0a3f92f218b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:45.949176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-039e8220-ab9f-45db-845b-b0a3f92f218b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:45.949622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-039e8220-ab9f-45db-845b-b0a3f92f218b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:45.950372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-039e8220-ab9f-45db-845b-b0a3f92f218b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:45.950801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-039e8220-ab9f-45db-845b-b0a3f92f218b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:46.092389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-039e8220-ab9f-45db-845b-b0a3f92f218b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:46.101529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-039e8220-ab9f-45db-845b-b0a3f92f218b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.162651 Apr 07 13:00:46.102082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 317/630] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:45 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:46.261377 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ef5f9e73-e51a-4d7b-a5d6-a8604e56b157 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:46.262042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ef5f9e73-e51a-4d7b-a5d6-a8604e56b157 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:46.268671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef5f9e73-e51a-4d7b-a5d6-a8604e56b157 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:46.269129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef5f9e73-e51a-4d7b-a5d6-a8604e56b157 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:46.269903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef5f9e73-e51a-4d7b-a5d6-a8604e56b157 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:46.270341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef5f9e73-e51a-4d7b-a5d6-a8604e56b157 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:46.400544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ef5f9e73-e51a-4d7b-a5d6-a8604e56b157 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:46.409942 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ef5f9e73-e51a-4d7b-a5d6-a8604e56b157 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152308 Apr 07 13:00:46.410504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 314/631] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:46 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:46.415536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6bf9b202-3eeb-45b4-be0c-66d1fdf8a46c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:46.416565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6bf9b202-3eeb-45b4-be0c-66d1fdf8a46c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:46.423478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bf9b202-3eeb-45b4-be0c-66d1fdf8a46c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:46.423924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bf9b202-3eeb-45b4-be0c-66d1fdf8a46c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:46.424720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bf9b202-3eeb-45b4-be0c-66d1fdf8a46c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:46.425159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bf9b202-3eeb-45b4-be0c-66d1fdf8a46c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:46.452497 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6bf9b202-3eeb-45b4-be0c-66d1fdf8a46c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040973 Apr 07 13:00:46.453052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 318/632] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:46 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:47.118910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7692693f-fc20-49e0-956c-8e9d00594011 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:47.119542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7692693f-fc20-49e0-956c-8e9d00594011 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:47.125998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7692693f-fc20-49e0-956c-8e9d00594011 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:47.126452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7692693f-fc20-49e0-956c-8e9d00594011 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:47.127226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7692693f-fc20-49e0-956c-8e9d00594011 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:47.127667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7692693f-fc20-49e0-956c-8e9d00594011 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:47.269345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7692693f-fc20-49e0-956c-8e9d00594011 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:47.277139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7692693f-fc20-49e0-956c-8e9d00594011 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.162112 Apr 07 13:00:47.277710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 315/633] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:47 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:47.426895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8b283eba-be57-43cd-8d16-09b4e401aeb2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:47.427434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8b283eba-be57-43cd-8d16-09b4e401aeb2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:47.433754 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8b283eba-be57-43cd-8d16-09b4e401aeb2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:47.434213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8b283eba-be57-43cd-8d16-09b4e401aeb2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:47.434979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8b283eba-be57-43cd-8d16-09b4e401aeb2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:47.435415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8b283eba-be57-43cd-8d16-09b4e401aeb2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:47.463611 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9d50f293-0843-4878-b9bb-1272450dc3de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:47.464568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9d50f293-0843-4878-b9bb-1272450dc3de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:47.470862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d50f293-0843-4878-b9bb-1272450dc3de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:47.471314 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d50f293-0843-4878-b9bb-1272450dc3de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:47.472084 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d50f293-0843-4878-b9bb-1272450dc3de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:47.472549 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d50f293-0843-4878-b9bb-1272450dc3de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:47.503142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9d50f293-0843-4878-b9bb-1272450dc3de tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043335 Apr 07 13:00:47.503709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 316/634] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:47 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:47.566083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8b283eba-be57-43cd-8d16-09b4e401aeb2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:47.573805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8b283eba-be57-43cd-8d16-09b4e401aeb2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150791 Apr 07 13:00:47.574363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 319/635] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:47 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:48.298187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a19bd82e-642f-4d9b-940c-3810f169ffbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:48.298822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a19bd82e-642f-4d9b-940c-3810f169ffbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:48.304797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a19bd82e-642f-4d9b-940c-3810f169ffbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:48.305249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a19bd82e-642f-4d9b-940c-3810f169ffbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:48.306010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a19bd82e-642f-4d9b-940c-3810f169ffbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:48.306450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a19bd82e-642f-4d9b-940c-3810f169ffbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:48.450723 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a19bd82e-642f-4d9b-940c-3810f169ffbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:48.459200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a19bd82e-642f-4d9b-940c-3810f169ffbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.165344 Apr 07 13:00:48.459796 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 317/636] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:48 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:48.514375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-15477619-fd24-4f49-b8d2-4bbed72df3ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:48.516040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-15477619-fd24-4f49-b8d2-4bbed72df3ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:48.522311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15477619-fd24-4f49-b8d2-4bbed72df3ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:48.522768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15477619-fd24-4f49-b8d2-4bbed72df3ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:48.523531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15477619-fd24-4f49-b8d2-4bbed72df3ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:48.523967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15477619-fd24-4f49-b8d2-4bbed72df3ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:48.552376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-15477619-fd24-4f49-b8d2-4bbed72df3ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041953 Apr 07 13:00:48.552929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 320/637] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:48 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:48.590541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bca7bf60-863c-40bf-8b16-d7d6bc0478de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:48.591177 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bca7bf60-863c-40bf-8b16-d7d6bc0478de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:48.597890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bca7bf60-863c-40bf-8b16-d7d6bc0478de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:48.598336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bca7bf60-863c-40bf-8b16-d7d6bc0478de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:48.599095 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bca7bf60-863c-40bf-8b16-d7d6bc0478de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:48.599529 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bca7bf60-863c-40bf-8b16-d7d6bc0478de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:48.734085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bca7bf60-863c-40bf-8b16-d7d6bc0478de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:48.747159 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bca7bf60-863c-40bf-8b16-d7d6bc0478de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.160302 Apr 07 13:00:48.747735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 318/638] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:48 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:49.476498 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-651e93fa-7dc1-4fb9-b72d-7d000f7e661e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:49.477105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-651e93fa-7dc1-4fb9-b72d-7d000f7e661e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:49.482953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-651e93fa-7dc1-4fb9-b72d-7d000f7e661e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:49.484009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-651e93fa-7dc1-4fb9-b72d-7d000f7e661e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:49.484788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-651e93fa-7dc1-4fb9-b72d-7d000f7e661e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:49.485223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-651e93fa-7dc1-4fb9-b72d-7d000f7e661e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:49.564058 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-51cde716-f040-4e6a-94b1-59dfb1cd11a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:49.565155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-51cde716-f040-4e6a-94b1-59dfb1cd11a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:49.570874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-51cde716-f040-4e6a-94b1-59dfb1cd11a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:49.571317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-51cde716-f040-4e6a-94b1-59dfb1cd11a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:49.572072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-51cde716-f040-4e6a-94b1-59dfb1cd11a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:49.572531 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-51cde716-f040-4e6a-94b1-59dfb1cd11a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:49.602405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-51cde716-f040-4e6a-94b1-59dfb1cd11a7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042433 Apr 07 13:00:49.602966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 319/639] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:49 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:49.737666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-651e93fa-7dc1-4fb9-b72d-7d000f7e661e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:49.745452 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-651e93fa-7dc1-4fb9-b72d-7d000f7e661e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.272780 Apr 07 13:00:49.746021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 321/640] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:49 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:49.763898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6eab66a4-67b0-4265-9573-de16a203a3af tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:49.765040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6eab66a4-67b0-4265-9573-de16a203a3af tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:49.770904 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6eab66a4-67b0-4265-9573-de16a203a3af tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:49.771351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6eab66a4-67b0-4265-9573-de16a203a3af tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:49.772114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6eab66a4-67b0-4265-9573-de16a203a3af tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:49.772574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6eab66a4-67b0-4265-9573-de16a203a3af tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:49.902514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6eab66a4-67b0-4265-9573-de16a203a3af tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:49.911350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6eab66a4-67b0-4265-9573-de16a203a3af tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151243 Apr 07 13:00:49.911916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 320/641] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:49 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:50.614942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c229ab91-9c55-45d4-a4bb-80626ab57383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:50.615888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c229ab91-9c55-45d4-a4bb-80626ab57383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:50.622168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c229ab91-9c55-45d4-a4bb-80626ab57383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:50.622614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c229ab91-9c55-45d4-a4bb-80626ab57383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:50.623369 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c229ab91-9c55-45d4-a4bb-80626ab57383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:50.623801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c229ab91-9c55-45d4-a4bb-80626ab57383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:50.652103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c229ab91-9c55-45d4-a4bb-80626ab57383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041033 Apr 07 13:00:50.652687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 322/642] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:50 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:50.762923 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-31ce3b8a-2880-44af-bfff-db8dfa1669a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:50.763535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-31ce3b8a-2880-44af-bfff-db8dfa1669a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:50.769908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-31ce3b8a-2880-44af-bfff-db8dfa1669a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:50.770358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-31ce3b8a-2880-44af-bfff-db8dfa1669a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:50.771122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-31ce3b8a-2880-44af-bfff-db8dfa1669a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:50.771565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-31ce3b8a-2880-44af-bfff-db8dfa1669a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:50.928687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-47aca69e-a40d-4846-8116-b123bd31eb82 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:50.929300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-47aca69e-a40d-4846-8116-b123bd31eb82 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:50.935136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-47aca69e-a40d-4846-8116-b123bd31eb82 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:50.935585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-47aca69e-a40d-4846-8116-b123bd31eb82 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:50.936426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-47aca69e-a40d-4846-8116-b123bd31eb82 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:50.936901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-47aca69e-a40d-4846-8116-b123bd31eb82 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:50.976265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-31ce3b8a-2880-44af-bfff-db8dfa1669a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:50.984634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-31ce3b8a-2880-44af-bfff-db8dfa1669a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.225518 Apr 07 13:00:50.985207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 321/643] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:50 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:51.067104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-47aca69e-a40d-4846-8116-b123bd31eb82 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:51.074808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-47aca69e-a40d-4846-8116-b123bd31eb82 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150142 Apr 07 13:00:51.075374 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 323/644] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:51.663945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c84339b5-82d2-444b-baaf-7fe51852e764 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:51.664908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c84339b5-82d2-444b-baaf-7fe51852e764 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:51.670860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c84339b5-82d2-444b-baaf-7fe51852e764 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:51.671355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c84339b5-82d2-444b-baaf-7fe51852e764 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:51.672185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c84339b5-82d2-444b-baaf-7fe51852e764 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:51.672628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c84339b5-82d2-444b-baaf-7fe51852e764 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:51.701300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c84339b5-82d2-444b-baaf-7fe51852e764 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041237 Apr 07 13:00:51.701871 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 322/645] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:51 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:52.002492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bae9600f-1ed2-4cd5-86f5-756606ab7506 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:52.003103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bae9600f-1ed2-4cd5-86f5-756606ab7506 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:52.009197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bae9600f-1ed2-4cd5-86f5-756606ab7506 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:52.009645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bae9600f-1ed2-4cd5-86f5-756606ab7506 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:52.010404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bae9600f-1ed2-4cd5-86f5-756606ab7506 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:52.010842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bae9600f-1ed2-4cd5-86f5-756606ab7506 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:52.092766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6b9a34a0-47eb-4ab9-bfeb-e5ae93d748b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:52.093292 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6b9a34a0-47eb-4ab9-bfeb-e5ae93d748b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:52.099556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b9a34a0-47eb-4ab9-bfeb-e5ae93d748b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:52.100007 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b9a34a0-47eb-4ab9-bfeb-e5ae93d748b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:52.100836 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b9a34a0-47eb-4ab9-bfeb-e5ae93d748b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:52.101277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b9a34a0-47eb-4ab9-bfeb-e5ae93d748b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:52.161867 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bae9600f-1ed2-4cd5-86f5-756606ab7506 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:52.169667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bae9600f-1ed2-4cd5-86f5-756606ab7506 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1757 microversion: 2.1 time: 0.171803 Apr 07 13:00:52.170236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 324/646] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:51 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:52.233240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6b9a34a0-47eb-4ab9-bfeb-e5ae93d748b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:52.241712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6b9a34a0-47eb-4ab9-bfeb-e5ae93d748b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152967 Apr 07 13:00:52.242279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 323/647] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:52 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:52.713586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-647b8d59-c901-4e60-bca1-2a5d6dbc9db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:52.714529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-647b8d59-c901-4e60-bca1-2a5d6dbc9db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:52.721136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-647b8d59-c901-4e60-bca1-2a5d6dbc9db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:52.721586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-647b8d59-c901-4e60-bca1-2a5d6dbc9db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:52.722350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-647b8d59-c901-4e60-bca1-2a5d6dbc9db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:52.722785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-647b8d59-c901-4e60-bca1-2a5d6dbc9db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:52.751599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-647b8d59-c901-4e60-bca1-2a5d6dbc9db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041900 Apr 07 13:00:52.752165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 325/648] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:52 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:53.188913 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-51691a71-2c0a-4162-84aa-98eb45eaa42a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:53.189584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-51691a71-2c0a-4162-84aa-98eb45eaa42a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:53.195785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-51691a71-2c0a-4162-84aa-98eb45eaa42a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:53.196265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-51691a71-2c0a-4162-84aa-98eb45eaa42a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:53.197206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-51691a71-2c0a-4162-84aa-98eb45eaa42a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:53.197645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-51691a71-2c0a-4162-84aa-98eb45eaa42a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:53.258061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-257bb6e9-2da7-40e8-9e99-838cceef22de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:53.258801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-257bb6e9-2da7-40e8-9e99-838cceef22de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:53.265562 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-257bb6e9-2da7-40e8-9e99-838cceef22de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:53.266009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-257bb6e9-2da7-40e8-9e99-838cceef22de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:53.266767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-257bb6e9-2da7-40e8-9e99-838cceef22de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:53.267208 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-257bb6e9-2da7-40e8-9e99-838cceef22de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:53.345257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-51691a71-2c0a-4162-84aa-98eb45eaa42a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:53.353128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-51691a71-2c0a-4162-84aa-98eb45eaa42a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1760 microversion: 2.1 time: 0.168950 Apr 07 13:00:53.353696 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 324/649] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:53 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:53.402076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-257bb6e9-2da7-40e8-9e99-838cceef22de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:53.410505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-257bb6e9-2da7-40e8-9e99-838cceef22de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156259 Apr 07 13:00:53.411071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 326/650] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:53 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:53.762992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1f23c5c0-df5d-425d-8e45-b4fa589f80c6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:53.763916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1f23c5c0-df5d-425d-8e45-b4fa589f80c6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:53.769935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f23c5c0-df5d-425d-8e45-b4fa589f80c6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:53.770380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f23c5c0-df5d-425d-8e45-b4fa589f80c6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:53.771160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f23c5c0-df5d-425d-8e45-b4fa589f80c6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:53.771604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f23c5c0-df5d-425d-8e45-b4fa589f80c6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:53.801099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1f23c5c0-df5d-425d-8e45-b4fa589f80c6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042109 Apr 07 13:00:53.801952 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 325/651] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:53 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:54.427200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cfe0340d-3d13-4d9f-bcdd-c976afc6d4a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:54.427813 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cfe0340d-3d13-4d9f-bcdd-c976afc6d4a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:54.435054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cfe0340d-3d13-4d9f-bcdd-c976afc6d4a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:54.435510 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cfe0340d-3d13-4d9f-bcdd-c976afc6d4a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:54.436418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cfe0340d-3d13-4d9f-bcdd-c976afc6d4a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:54.437011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cfe0340d-3d13-4d9f-bcdd-c976afc6d4a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:54.570644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cfe0340d-3d13-4d9f-bcdd-c976afc6d4a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:54.578503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cfe0340d-3d13-4d9f-bcdd-c976afc6d4a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155111 Apr 07 13:00:54.579078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 327/652] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:54 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:54.813713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-59e6e1af-d210-4d56-8a34-fea48e85f731 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:54.814668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-59e6e1af-d210-4d56-8a34-fea48e85f731 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:54.820938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59e6e1af-d210-4d56-8a34-fea48e85f731 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:54.821394 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59e6e1af-d210-4d56-8a34-fea48e85f731 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:54.822158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59e6e1af-d210-4d56-8a34-fea48e85f731 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:54.822591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59e6e1af-d210-4d56-8a34-fea48e85f731 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:54.857048 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-59e6e1af-d210-4d56-8a34-fea48e85f731 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047175 Apr 07 13:00:54.857885 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 326/653] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:54 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:55.596346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-871d58bc-089e-40bd-bbfe-ace93deb7696 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:55.596988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-871d58bc-089e-40bd-bbfe-ace93deb7696 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:55.603872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-871d58bc-089e-40bd-bbfe-ace93deb7696 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:55.604359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-871d58bc-089e-40bd-bbfe-ace93deb7696 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:55.605127 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-871d58bc-089e-40bd-bbfe-ace93deb7696 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:55.605556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-871d58bc-089e-40bd-bbfe-ace93deb7696 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:55.734638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-871d58bc-089e-40bd-bbfe-ace93deb7696 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:55.742394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-871d58bc-089e-40bd-bbfe-ace93deb7696 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1716 microversion: 2.1 time: 0.151529 Apr 07 13:00:55.742961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 328/654] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:55 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:55.845640 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-653c8af9-3626-45e8-92a5-a8a6f19aea6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:55.846170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-653c8af9-3626-45e8-92a5-a8a6f19aea6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:55.853231 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-653c8af9-3626-45e8-92a5-a8a6f19aea6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:55.853692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-653c8af9-3626-45e8-92a5-a8a6f19aea6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:55.854464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-653c8af9-3626-45e8-92a5-a8a6f19aea6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:55.854902 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-653c8af9-3626-45e8-92a5-a8a6f19aea6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:55.870448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4636dd04-fd94-4f2a-b2eb-88551b942462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:55.871454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4636dd04-fd94-4f2a-b2eb-88551b942462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:55.878456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4636dd04-fd94-4f2a-b2eb-88551b942462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:55.878999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4636dd04-fd94-4f2a-b2eb-88551b942462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:55.879818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4636dd04-fd94-4f2a-b2eb-88551b942462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:55.880419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4636dd04-fd94-4f2a-b2eb-88551b942462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:55.910547 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4636dd04-fd94-4f2a-b2eb-88551b942462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043936 Apr 07 13:00:55.911111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 329/655] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:55 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:00:55.975674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-653c8af9-3626-45e8-92a5-a8a6f19aea6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] HTTP exception thrown: Cannot 'detach_volume' instance 1c2c5542-86c5-4fe4-9287-ed9dc322b189 while it is in vm_state rescued Apr 07 13:00:55.976320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-653c8af9-3626-45e8-92a5-a8a6f19aea6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Returning 409 to user: Cannot 'detach_volume' instance 1c2c5542-86c5-4fe4-9287-ed9dc322b189 while it is in vm_state rescued {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:00:55.977160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-653c8af9-3626-45e8-92a5-a8a6f19aea6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93" status: 409 len: 152 microversion: 2.1 time: 0.135712 Apr 07 13:00:55.977703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 327/656] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:00:55 2022] DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 => generated 152 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 07 13:00:55.986576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a48328d6-af62-4425-8699-fc3be87d75dd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:00:55.987109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a48328d6-af62-4425-8699-fc3be87d75dd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:55.992903 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a48328d6-af62-4425-8699-fc3be87d75dd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:55.993357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a48328d6-af62-4425-8699-fc3be87d75dd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:55.994124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a48328d6-af62-4425-8699-fc3be87d75dd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:55.994558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a48328d6-af62-4425-8699-fc3be87d75dd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:56.058722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a48328d6-af62-4425-8699-fc3be87d75dd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "POST /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/action" status: 202 len: 0 microversion: 2.1 time: 0.076408 Apr 07 13:00:56.059358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 330/657] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 13:00:55 2022] POST /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:00:56.067606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a408c3a1-b2cb-4de6-ada8-a519aa4f4d46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:56.068242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a408c3a1-b2cb-4de6-ada8-a519aa4f4d46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:56.074845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a408c3a1-b2cb-4de6-ada8-a519aa4f4d46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:56.075317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a408c3a1-b2cb-4de6-ada8-a519aa4f4d46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:56.076251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a408c3a1-b2cb-4de6-ada8-a519aa4f4d46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:56.076624 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a408c3a1-b2cb-4de6-ada8-a519aa4f4d46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:56.214324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a408c3a1-b2cb-4de6-ada8-a519aa4f4d46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:56.222212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a408c3a1-b2cb-4de6-ada8-a519aa4f4d46 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1724 microversion: 2.1 time: 0.158364 Apr 07 13:00:56.222783 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 328/658] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:56 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:56.924057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0a090b31-f064-4311-a0c5-08320820c1c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:56.925098 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0a090b31-f064-4311-a0c5-08320820c1c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:56.931150 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0a090b31-f064-4311-a0c5-08320820c1c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:56.931601 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0a090b31-f064-4311-a0c5-08320820c1c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:56.932386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0a090b31-f064-4311-a0c5-08320820c1c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:56.932826 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0a090b31-f064-4311-a0c5-08320820c1c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:56.960064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0a090b31-f064-4311-a0c5-08320820c1c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041471 Apr 07 13:00:56.960631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 331/659] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:56 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:57.239408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e6bd43c0-0735-4d6a-a668-c1f608c5fafb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:57.240005 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e6bd43c0-0735-4d6a-a668-c1f608c5fafb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:57.246322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6bd43c0-0735-4d6a-a668-c1f608c5fafb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:57.246787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6bd43c0-0735-4d6a-a668-c1f608c5fafb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:57.247532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6bd43c0-0735-4d6a-a668-c1f608c5fafb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:57.247976 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6bd43c0-0735-4d6a-a668-c1f608c5fafb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:57.376712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e6bd43c0-0735-4d6a-a668-c1f608c5fafb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:57.384489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e6bd43c0-0735-4d6a-a668-c1f608c5fafb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1724 microversion: 2.1 time: 0.148925 Apr 07 13:00:57.385054 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 329/660] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:57.971362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8d9edf7b-df3a-4444-bc70-f191f2ecc1e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:57.972322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8d9edf7b-df3a-4444-bc70-f191f2ecc1e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:57.979126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d9edf7b-df3a-4444-bc70-f191f2ecc1e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:57.979578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d9edf7b-df3a-4444-bc70-f191f2ecc1e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:57.980401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d9edf7b-df3a-4444-bc70-f191f2ecc1e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:57.980839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d9edf7b-df3a-4444-bc70-f191f2ecc1e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:58.010937 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8d9edf7b-df3a-4444-bc70-f191f2ecc1e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043781 Apr 07 13:00:58.011484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 332/661] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:57 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:58.402304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ddde79c9-1719-4b97-bf43-25b8c04c41c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:58.402915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ddde79c9-1719-4b97-bf43-25b8c04c41c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:58.410426 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ddde79c9-1719-4b97-bf43-25b8c04c41c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:58.410887 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ddde79c9-1719-4b97-bf43-25b8c04c41c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:58.411662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ddde79c9-1719-4b97-bf43-25b8c04c41c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:58.412101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ddde79c9-1719-4b97-bf43-25b8c04c41c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:58.558354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ddde79c9-1719-4b97-bf43-25b8c04c41c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:58.567301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ddde79c9-1719-4b97-bf43-25b8c04c41c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1724 microversion: 2.1 time: 0.168794 Apr 07 13:00:58.568229 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 330/662] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:00:59.024917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-aec919a8-37b6-4cf2-9b31-ebd0cc9761d3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:59.025847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-aec919a8-37b6-4cf2-9b31-ebd0cc9761d3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:59.032451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aec919a8-37b6-4cf2-9b31-ebd0cc9761d3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:59.032906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aec919a8-37b6-4cf2-9b31-ebd0cc9761d3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:59.033669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aec919a8-37b6-4cf2-9b31-ebd0cc9761d3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:59.034108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aec919a8-37b6-4cf2-9b31-ebd0cc9761d3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:59.062108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-aec919a8-37b6-4cf2-9b31-ebd0cc9761d3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040674 Apr 07 13:00:59.062660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 333/663] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:00:59 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:00:59.585528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e71f1716-4551-41d5-9ad2-6ea894049787 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:59.586140 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e71f1716-4551-41d5-9ad2-6ea894049787 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:59.592431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e71f1716-4551-41d5-9ad2-6ea894049787 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:59.592883 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e71f1716-4551-41d5-9ad2-6ea894049787 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:59.593650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e71f1716-4551-41d5-9ad2-6ea894049787 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:59.594085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e71f1716-4551-41d5-9ad2-6ea894049787 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:59.722612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e71f1716-4551-41d5-9ad2-6ea894049787 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:00:59.730200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e71f1716-4551-41d5-9ad2-6ea894049787 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1730 microversion: 2.1 time: 0.148516 Apr 07 13:00:59.730758 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 331/664] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:00:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:00:59.747454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8f29cc59-d005-467a-b698-f8c35251e88f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:00:59.747962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8f29cc59-d005-467a-b698-f8c35251e88f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:00:59.753791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8f29cc59-d005-467a-b698-f8c35251e88f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:59.754235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8f29cc59-d005-467a-b698-f8c35251e88f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:59.754989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8f29cc59-d005-467a-b698-f8c35251e88f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:00:59.755422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8f29cc59-d005-467a-b698-f8c35251e88f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:00:59.839641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8f29cc59-d005-467a-b698-f8c35251e88f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095906 Apr 07 13:00:59.840426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 334/665] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Apr 7 13:00:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:01:00.073846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bf716533-23f9-49e4-80c2-b3d70b6ee14e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:00.074867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bf716533-23f9-49e4-80c2-b3d70b6ee14e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:00.081153 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf716533-23f9-49e4-80c2-b3d70b6ee14e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:00.081608 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf716533-23f9-49e4-80c2-b3d70b6ee14e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:00.082382 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf716533-23f9-49e4-80c2-b3d70b6ee14e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:00.082820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf716533-23f9-49e4-80c2-b3d70b6ee14e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:00.112910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bf716533-23f9-49e4-80c2-b3d70b6ee14e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042950 Apr 07 13:01:00.113492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 332/666] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:00 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:00.985723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-00067eeb-11a3-463f-aa49-d66901f71804 req-b16d8771-48cb-4cd3-8d5c-85ace86a3c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2c5542-86c5-4fe4-9287-ed9dc322b189", "tag": "01b94e44-6b83-4805-bf7a-8c07a6310174"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:00.995116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-00067eeb-11a3-463f-aa49-d66901f71804 req-b16d8771-48cb-4cd3-8d5c-85ace86a3c43 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:00.995566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-00067eeb-11a3-463f-aa49-d66901f71804 req-b16d8771-48cb-4cd3-8d5c-85ace86a3c43 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:01.009694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-00067eeb-11a3-463f-aa49-d66901f71804 req-b16d8771-48cb-4cd3-8d5c-85ace86a3c43 service nova] Creating event network-changed:01b94e44-6b83-4805-bf7a-8c07a6310174 for instance 1c2c5542-86c5-4fe4-9287-ed9dc322b189 on hv-cinder-83694 Apr 07 13:01:01.015311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-00067eeb-11a3-463f-aa49-d66901f71804 req-b16d8771-48cb-4cd3-8d5c-85ace86a3c43 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034243 Apr 07 13:01:01.016068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 335/667] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:01:01.124983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e745b8ca-7141-443a-985d-43155418fbf2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:01.126037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e745b8ca-7141-443a-985d-43155418fbf2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:01.132434 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e745b8ca-7141-443a-985d-43155418fbf2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:01.132990 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e745b8ca-7141-443a-985d-43155418fbf2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:01.133844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e745b8ca-7141-443a-985d-43155418fbf2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:01.134357 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e745b8ca-7141-443a-985d-43155418fbf2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:01.166735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e745b8ca-7141-443a-985d-43155418fbf2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046061 Apr 07 13:01:01.167627 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 333/668] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:01 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:02.179618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f737ee45-4875-4b49-8264-27e20c585cc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:02.180660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f737ee45-4875-4b49-8264-27e20c585cc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:02.187414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f737ee45-4875-4b49-8264-27e20c585cc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:02.187867 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f737ee45-4875-4b49-8264-27e20c585cc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:02.188660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f737ee45-4875-4b49-8264-27e20c585cc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:02.189090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f737ee45-4875-4b49-8264-27e20c585cc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:02.217187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f737ee45-4875-4b49-8264-27e20c585cc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042307 Apr 07 13:01:02.217852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 336/669] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:02 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:03.028676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-1f3771db-1c73-48ab-a0f5-7effcfe937aa req-e81ea257-bfcb-4599-8da1-70ebbbd34457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2c5542-86c5-4fe4-9287-ed9dc322b189", "tag": "01b94e44-6b83-4805-bf7a-8c07a6310174"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:03.037825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-1f3771db-1c73-48ab-a0f5-7effcfe937aa req-e81ea257-bfcb-4599-8da1-70ebbbd34457 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:03.038274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-1f3771db-1c73-48ab-a0f5-7effcfe937aa req-e81ea257-bfcb-4599-8da1-70ebbbd34457 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:03.049499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-1f3771db-1c73-48ab-a0f5-7effcfe937aa req-e81ea257-bfcb-4599-8da1-70ebbbd34457 service nova] Creating event network-changed:01b94e44-6b83-4805-bf7a-8c07a6310174 for instance 1c2c5542-86c5-4fe4-9287-ed9dc322b189 on hv-cinder-83694 Apr 07 13:01:03.054418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-1f3771db-1c73-48ab-a0f5-7effcfe937aa req-e81ea257-bfcb-4599-8da1-70ebbbd34457 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029282 Apr 07 13:01:03.054973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 334/670] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:01:03.228834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d4e3dc47-3994-4601-9fe9-dd98e3ec1bcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:03.229772 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d4e3dc47-3994-4601-9fe9-dd98e3ec1bcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:03.236101 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4e3dc47-3994-4601-9fe9-dd98e3ec1bcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:03.236636 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4e3dc47-3994-4601-9fe9-dd98e3ec1bcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:03.237335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4e3dc47-3994-4601-9fe9-dd98e3ec1bcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:03.237764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4e3dc47-3994-4601-9fe9-dd98e3ec1bcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:03.265736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d4e3dc47-3994-4601-9fe9-dd98e3ec1bcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040794 Apr 07 13:01:03.266506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 337/671] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:03 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:04.278407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bda439c3-27c0-4a5a-a8d6-88592bce2f55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:04.279600 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bda439c3-27c0-4a5a-a8d6-88592bce2f55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:04.285868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bda439c3-27c0-4a5a-a8d6-88592bce2f55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:04.286324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bda439c3-27c0-4a5a-a8d6-88592bce2f55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:04.287087 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bda439c3-27c0-4a5a-a8d6-88592bce2f55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:04.287526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bda439c3-27c0-4a5a-a8d6-88592bce2f55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:04.315168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bda439c3-27c0-4a5a-a8d6-88592bce2f55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041603 Apr 07 13:01:04.315725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 335/672] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:04 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:05.327699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4f436884-519b-40dd-84f0-fd3ccdb06dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:05.328572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4f436884-519b-40dd-84f0-fd3ccdb06dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:05.334861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f436884-519b-40dd-84f0-fd3ccdb06dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:05.335315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f436884-519b-40dd-84f0-fd3ccdb06dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:05.336071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f436884-519b-40dd-84f0-fd3ccdb06dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:05.336535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f436884-519b-40dd-84f0-fd3ccdb06dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:05.364368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4f436884-519b-40dd-84f0-fd3ccdb06dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041460 Apr 07 13:01:05.364916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 338/673] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:05 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:06.376088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-754131f8-3a48-4efb-8d70-4d2b466620cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:06.377050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-754131f8-3a48-4efb-8d70-4d2b466620cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:06.384365 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-754131f8-3a48-4efb-8d70-4d2b466620cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:06.384815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-754131f8-3a48-4efb-8d70-4d2b466620cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:06.385568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-754131f8-3a48-4efb-8d70-4d2b466620cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:06.386000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-754131f8-3a48-4efb-8d70-4d2b466620cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:06.413625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-754131f8-3a48-4efb-8d70-4d2b466620cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041464 Apr 07 13:01:06.414162 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 336/674] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:06 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:07.426171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-aca4c844-f9bc-4e4b-9e20-c0e6fd29eab2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:07.427117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-aca4c844-f9bc-4e4b-9e20-c0e6fd29eab2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:07.433427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aca4c844-f9bc-4e4b-9e20-c0e6fd29eab2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:07.433875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aca4c844-f9bc-4e4b-9e20-c0e6fd29eab2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:07.434634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aca4c844-f9bc-4e4b-9e20-c0e6fd29eab2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:07.435067 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aca4c844-f9bc-4e4b-9e20-c0e6fd29eab2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:07.463549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-aca4c844-f9bc-4e4b-9e20-c0e6fd29eab2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041512 Apr 07 13:01:07.464093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 339/675] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:07 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:08.476418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3e8b2827-634a-4c16-86df-6ea6b4f86259 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:08.477256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3e8b2827-634a-4c16-86df-6ea6b4f86259 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:08.484278 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3e8b2827-634a-4c16-86df-6ea6b4f86259 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:08.484737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3e8b2827-634a-4c16-86df-6ea6b4f86259 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:08.485513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3e8b2827-634a-4c16-86df-6ea6b4f86259 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:08.485954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3e8b2827-634a-4c16-86df-6ea6b4f86259 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:08.514207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3e8b2827-634a-4c16-86df-6ea6b4f86259 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041857 Apr 07 13:01:08.514757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 337/676] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:08 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:09.525871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7ca5ac7b-58a7-4c9b-bba5-f192c96c7456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:09.526787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7ca5ac7b-58a7-4c9b-bba5-f192c96c7456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:09.533385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ca5ac7b-58a7-4c9b-bba5-f192c96c7456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:09.533833 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ca5ac7b-58a7-4c9b-bba5-f192c96c7456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:09.534591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ca5ac7b-58a7-4c9b-bba5-f192c96c7456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:09.535025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ca5ac7b-58a7-4c9b-bba5-f192c96c7456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:09.562717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7ca5ac7b-58a7-4c9b-bba5-f192c96c7456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040799 Apr 07 13:01:09.563256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 340/677] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:09 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:10.574034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6edfec9b-5550-4ea5-bb1d-1ddf732fa1c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:10.574882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6edfec9b-5550-4ea5-bb1d-1ddf732fa1c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:10.581500 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6edfec9b-5550-4ea5-bb1d-1ddf732fa1c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:10.582006 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6edfec9b-5550-4ea5-bb1d-1ddf732fa1c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:10.582789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6edfec9b-5550-4ea5-bb1d-1ddf732fa1c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:10.583259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6edfec9b-5550-4ea5-bb1d-1ddf732fa1c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:10.611376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6edfec9b-5550-4ea5-bb1d-1ddf732fa1c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041339 Apr 07 13:01:10.611928 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 338/678] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:10 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:11.622916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-36cfa84c-8a4d-4722-8d79-264d01c558f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:11.624048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-36cfa84c-8a4d-4722-8d79-264d01c558f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:11.630371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36cfa84c-8a4d-4722-8d79-264d01c558f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:11.630824 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36cfa84c-8a4d-4722-8d79-264d01c558f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:11.631580 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36cfa84c-8a4d-4722-8d79-264d01c558f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:11.632015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36cfa84c-8a4d-4722-8d79-264d01c558f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:11.660070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-36cfa84c-8a4d-4722-8d79-264d01c558f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041115 Apr 07 13:01:11.660645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 341/679] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:11 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:12.558876 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:01:12.559416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:01:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:01:12.672059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6602706b-fbc5-4954-94e8-625ec29726ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:12.673003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6602706b-fbc5-4954-94e8-625ec29726ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:12.679923 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6602706b-fbc5-4954-94e8-625ec29726ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:12.680406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6602706b-fbc5-4954-94e8-625ec29726ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:12.681166 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6602706b-fbc5-4954-94e8-625ec29726ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:12.681599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6602706b-fbc5-4954-94e8-625ec29726ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:12.709575 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6602706b-fbc5-4954-94e8-625ec29726ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042193 Apr 07 13:01:12.710118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 339/680] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:12 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:13.721312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-85523632-88a2-4472-ad86-95c9dfd94ce6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:13.722228 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-85523632-88a2-4472-ad86-95c9dfd94ce6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:13.728490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-85523632-88a2-4472-ad86-95c9dfd94ce6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:13.728941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-85523632-88a2-4472-ad86-95c9dfd94ce6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:13.729701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-85523632-88a2-4472-ad86-95c9dfd94ce6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:13.730144 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-85523632-88a2-4472-ad86-95c9dfd94ce6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:13.759098 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-85523632-88a2-4472-ad86-95c9dfd94ce6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041678 Apr 07 13:01:13.759673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 342/681] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:13 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:13.787506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:01:13.787700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:01:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:01:14.054927 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:01:14.055474 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:01:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:01:14.872489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f4b54b48-0f72-4634-a3f1-ec3417ab620c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:14.873707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f4b54b48-0f72-4634-a3f1-ec3417ab620c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:14.879622 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f4b54b48-0f72-4634-a3f1-ec3417ab620c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:14.880077 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f4b54b48-0f72-4634-a3f1-ec3417ab620c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:14.880912 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f4b54b48-0f72-4634-a3f1-ec3417ab620c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:14.881353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f4b54b48-0f72-4634-a3f1-ec3417ab620c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:14.915144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f4b54b48-0f72-4634-a3f1-ec3417ab620c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147568 Apr 07 13:01:14.915692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 340/682] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:14 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:15.840829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7ccd036a-462b-4fe2-b15b-ca99fa673e07 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:15.842373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7ccd036a-462b-4fe2-b15b-ca99fa673e07 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:15.849526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ccd036a-462b-4fe2-b15b-ca99fa673e07 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:15.849977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ccd036a-462b-4fe2-b15b-ca99fa673e07 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:15.850732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ccd036a-462b-4fe2-b15b-ca99fa673e07 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:15.851191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ccd036a-462b-4fe2-b15b-ca99fa673e07 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:15.879484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7ccd036a-462b-4fe2-b15b-ca99fa673e07 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042593 Apr 07 13:01:15.880029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 343/683] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:01:15 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 07 13:01:15.927283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f35f2b3f-5b34-4905-ae5b-c485b973976e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:15.928234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f35f2b3f-5b34-4905-ae5b-c485b973976e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:15.934482 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f35f2b3f-5b34-4905-ae5b-c485b973976e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:15.934935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f35f2b3f-5b34-4905-ae5b-c485b973976e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:15.935709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f35f2b3f-5b34-4905-ae5b-c485b973976e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:15.936288 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f35f2b3f-5b34-4905-ae5b-c485b973976e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:15.936526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-45a9c341-af1f-44e2-9511-0a8291cfb170 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:15.937030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-45a9c341-af1f-44e2-9511-0a8291cfb170 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:15.942768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45a9c341-af1f-44e2-9511-0a8291cfb170 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:15.943219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45a9c341-af1f-44e2-9511-0a8291cfb170 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:15.943984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45a9c341-af1f-44e2-9511-0a8291cfb170 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:15.944455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45a9c341-af1f-44e2-9511-0a8291cfb170 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:15.965091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f35f2b3f-5b34-4905-ae5b-c485b973976e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041720 Apr 07 13:01:15.965654 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 341/684] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:15 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:15.968504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-45a9c341-af1f-44e2-9511-0a8291cfb170 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:01:16.039659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-45a9c341-af1f-44e2-9511-0a8291cfb170 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "DELETE /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 204 len: 0 microversion: 2.1 time: 0.106732 Apr 07 13:01:16.040264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 344/685] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:01:15 2022] DELETE /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 07 13:01:16.049819 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5ab8519b-de31-48fd-b890-cf3d3f9d271d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:16.050467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5ab8519b-de31-48fd-b890-cf3d3f9d271d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:16.056504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ab8519b-de31-48fd-b890-cf3d3f9d271d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:16.056964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ab8519b-de31-48fd-b890-cf3d3f9d271d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:16.057736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ab8519b-de31-48fd-b890-cf3d3f9d271d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:16.058181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ab8519b-de31-48fd-b890-cf3d3f9d271d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:16.191987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5ab8519b-de31-48fd-b890-cf3d3f9d271d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:16.199395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5ab8519b-de31-48fd-b890-cf3d3f9d271d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1675 microversion: 2.1 time: 0.154170 Apr 07 13:01:16.199957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 342/686] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:16 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:16.977988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a88ced92-df40-4ed4-8fe8-8b278fa55650 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:16.978982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a88ced92-df40-4ed4-8fe8-8b278fa55650 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:16.985477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a88ced92-df40-4ed4-8fe8-8b278fa55650 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:16.985923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a88ced92-df40-4ed4-8fe8-8b278fa55650 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:16.986674 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a88ced92-df40-4ed4-8fe8-8b278fa55650 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:16.987098 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a88ced92-df40-4ed4-8fe8-8b278fa55650 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:17.015491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a88ced92-df40-4ed4-8fe8-8b278fa55650 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041777 Apr 07 13:01:17.016021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 345/687] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:16 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:17.218090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-db484796-8584-41b8-9d24-a5e3259761c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:17.218705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-db484796-8584-41b8-9d24-a5e3259761c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:17.224984 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db484796-8584-41b8-9d24-a5e3259761c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:17.225434 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db484796-8584-41b8-9d24-a5e3259761c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:17.226193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db484796-8584-41b8-9d24-a5e3259761c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:17.226631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db484796-8584-41b8-9d24-a5e3259761c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:17.355849 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-db484796-8584-41b8-9d24-a5e3259761c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:17.363299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-db484796-8584-41b8-9d24-a5e3259761c2 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1675 microversion: 2.1 time: 0.149684 Apr 07 13:01:17.363865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 343/688] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:17 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:18.027119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5aae4bd3-3533-4d42-80a0-234825e0b53c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:18.028071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5aae4bd3-3533-4d42-80a0-234825e0b53c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:18.035325 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5aae4bd3-3533-4d42-80a0-234825e0b53c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:18.035775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5aae4bd3-3533-4d42-80a0-234825e0b53c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:18.036609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5aae4bd3-3533-4d42-80a0-234825e0b53c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:18.037044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5aae4bd3-3533-4d42-80a0-234825e0b53c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:18.065851 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5aae4bd3-3533-4d42-80a0-234825e0b53c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042646 Apr 07 13:01:18.066415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 346/689] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:18 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:18.380740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ff1fa10d-caa5-420f-9dcf-08c2a92aec31 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:18.381132 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ff1fa10d-caa5-420f-9dcf-08c2a92aec31 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:18.388075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff1fa10d-caa5-420f-9dcf-08c2a92aec31 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:18.388559 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff1fa10d-caa5-420f-9dcf-08c2a92aec31 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:18.389443 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff1fa10d-caa5-420f-9dcf-08c2a92aec31 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:18.389975 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff1fa10d-caa5-420f-9dcf-08c2a92aec31 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:18.496067 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ffdb0868-37be-4cad-89a7-0fe71f67059d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:18.497038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ffdb0868-37be-4cad-89a7-0fe71f67059d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:18.503739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffdb0868-37be-4cad-89a7-0fe71f67059d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:18.503739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffdb0868-37be-4cad-89a7-0fe71f67059d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:18.504571 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffdb0868-37be-4cad-89a7-0fe71f67059d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:18.505003 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffdb0868-37be-4cad-89a7-0fe71f67059d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:18.523984 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ff1fa10d-caa5-420f-9dcf-08c2a92aec31 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:18.528986 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ffdb0868-37be-4cad-89a7-0fe71f67059d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:01:18.531995 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ff1fa10d-caa5-420f-9dcf-08c2a92aec31 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1675 microversion: 2.1 time: 0.155511 Apr 07 13:01:18.533382 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 344/690] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:18 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:18.612807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ffdb0868-37be-4cad-89a7-0fe71f67059d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 204 len: 0 microversion: 2.1 time: 0.120177 Apr 07 13:01:18.613446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 347/691] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:01:18 2022] DELETE /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:01:18.621801 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-57e363b8-9920-440c-98d7-3b88c96285dd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:18.622506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-57e363b8-9920-440c-98d7-3b88c96285dd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:18.629040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57e363b8-9920-440c-98d7-3b88c96285dd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:18.629592 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57e363b8-9920-440c-98d7-3b88c96285dd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:18.630428 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57e363b8-9920-440c-98d7-3b88c96285dd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:18.630934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57e363b8-9920-440c-98d7-3b88c96285dd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:18.766220 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-57e363b8-9920-440c-98d7-3b88c96285dd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:18.774008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-57e363b8-9920-440c-98d7-3b88c96285dd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1579 microversion: 2.1 time: 0.155914 Apr 07 13:01:18.774501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 345/692] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:18 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:19.078560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a1afcbd8-db67-4fcc-8bd3-ab0881a5006a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:19.079780 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a1afcbd8-db67-4fcc-8bd3-ab0881a5006a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:19.086075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a1afcbd8-db67-4fcc-8bd3-ab0881a5006a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:19.086531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a1afcbd8-db67-4fcc-8bd3-ab0881a5006a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:19.087300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a1afcbd8-db67-4fcc-8bd3-ab0881a5006a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:19.087892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a1afcbd8-db67-4fcc-8bd3-ab0881a5006a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:19.117395 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a1afcbd8-db67-4fcc-8bd3-ab0881a5006a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044378 Apr 07 13:01:19.118580 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 348/693] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:19 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:19.311078 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-55e93541-e652-4c92-87aa-774623ae05a5 req-8ec78952-dd1a-4b38-8347-9b5207348714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34baf697-0c75-496f-a1fe-fef1314f1a9a", "name": "network-vif-deleted", "tag": "4c467477-c161-40fe-bb4a-d23378671576"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:19.320017 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-55e93541-e652-4c92-87aa-774623ae05a5 req-8ec78952-dd1a-4b38-8347-9b5207348714 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:19.320516 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-55e93541-e652-4c92-87aa-774623ae05a5 req-8ec78952-dd1a-4b38-8347-9b5207348714 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:19.332744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-55e93541-e652-4c92-87aa-774623ae05a5 req-8ec78952-dd1a-4b38-8347-9b5207348714 service nova] Creating event network-vif-deleted:4c467477-c161-40fe-bb4a-d23378671576 for instance 34baf697-0c75-496f-a1fe-fef1314f1a9a on hv-cinder-83694 Apr 07 13:01:19.337956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-55e93541-e652-4c92-87aa-774623ae05a5 req-8ec78952-dd1a-4b38-8347-9b5207348714 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087368 Apr 07 13:01:19.338838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 346/694] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:01:19.549961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b505cbac-aab5-46a6-88b5-a55bc56f9459 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:19.550579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b505cbac-aab5-46a6-88b5-a55bc56f9459 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:19.556699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b505cbac-aab5-46a6-88b5-a55bc56f9459 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:19.557157 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b505cbac-aab5-46a6-88b5-a55bc56f9459 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:19.557938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b505cbac-aab5-46a6-88b5-a55bc56f9459 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:19.558434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b505cbac-aab5-46a6-88b5-a55bc56f9459 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:19.628259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b505cbac-aab5-46a6-88b5-a55bc56f9459 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:19.636176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b505cbac-aab5-46a6-88b5-a55bc56f9459 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1607 microversion: 2.1 time: 0.090059 Apr 07 13:01:19.636927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 349/695] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:19 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1607 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:19.792351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5280c5d8-2554-43ef-9a79-973049a55377 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:19.793057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5280c5d8-2554-43ef-9a79-973049a55377 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:19.800448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5280c5d8-2554-43ef-9a79-973049a55377 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:19.801519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5280c5d8-2554-43ef-9a79-973049a55377 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:19.802309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5280c5d8-2554-43ef-9a79-973049a55377 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:19.802752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5280c5d8-2554-43ef-9a79-973049a55377 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:19.959431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5280c5d8-2554-43ef-9a79-973049a55377 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:19.969290 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5280c5d8-2554-43ef-9a79-973049a55377 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1579 microversion: 2.1 time: 0.180916 Apr 07 13:01:19.970264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 347/696] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:19 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1579 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:20.129869 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-812086e0-4ce9-48e3-8166-bd658f78720f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:20.131600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-812086e0-4ce9-48e3-8166-bd658f78720f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:20.138154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-812086e0-4ce9-48e3-8166-bd658f78720f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:20.138653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-812086e0-4ce9-48e3-8166-bd658f78720f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:20.139960 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-812086e0-4ce9-48e3-8166-bd658f78720f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:20.140413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-812086e0-4ce9-48e3-8166-bd658f78720f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:20.178188 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-812086e0-4ce9-48e3-8166-bd658f78720f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052198 Apr 07 13:01:20.179439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 350/697] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:20 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:20.623163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-13f6f4c9-297c-41ff-a0ca-d5936c9d8c05 req-1f7b53d1-7499-48e9-8fff-6353a751b0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb36ce2a-6233-4601-85c0-35c550476cea", "name": "network-vif-unplugged", "status": "completed", "tag": "1d264377-61da-43aa-ba85-52dd323d34d8"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:20.633790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-13f6f4c9-297c-41ff-a0ca-d5936c9d8c05 req-1f7b53d1-7499-48e9-8fff-6353a751b0e4 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:20.634451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-13f6f4c9-297c-41ff-a0ca-d5936c9d8c05 req-1f7b53d1-7499-48e9-8fff-6353a751b0e4 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:20.649432 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-13f6f4c9-297c-41ff-a0ca-d5936c9d8c05 req-1f7b53d1-7499-48e9-8fff-6353a751b0e4 service nova] Creating event network-vif-unplugged:1d264377-61da-43aa-ba85-52dd323d34d8 for instance cb36ce2a-6233-4601-85c0-35c550476cea on hv-cinder-83694 Apr 07 13:01:20.653583 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ccea1a23-40ee-472e-9b17-dfb551520420 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:20.655007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ccea1a23-40ee-472e-9b17-dfb551520420 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:20.656728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-13f6f4c9-297c-41ff-a0ca-d5936c9d8c05 req-1f7b53d1-7499-48e9-8fff-6353a751b0e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037289 Apr 07 13:01:20.658287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 348/698] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:01:20.669811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ccea1a23-40ee-472e-9b17-dfb551520420 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:20.670565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ccea1a23-40ee-472e-9b17-dfb551520420 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:20.671428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ccea1a23-40ee-472e-9b17-dfb551520420 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:20.671864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ccea1a23-40ee-472e-9b17-dfb551520420 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:20.727221 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ccea1a23-40ee-472e-9b17-dfb551520420 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:20.727965 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ccea1a23-40ee-472e-9b17-dfb551520420 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:20.728515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-ccea1a23-40ee-472e-9b17-dfb551520420 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lazy-loading 'fault' on Instance uuid 34baf697-0c75-496f-a1fe-fef1314f1a9a {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:01:20.777464 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ccea1a23-40ee-472e-9b17-dfb551520420 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:20.785337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ccea1a23-40ee-472e-9b17-dfb551520420 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 200 len: 1328 microversion: 2.1 time: 0.135388 Apr 07 13:01:20.786253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 351/699] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:20 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 1328 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:20.988216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7cfe3347-df11-4308-876f-bd7d76982614 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:20.989509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7cfe3347-df11-4308-876f-bd7d76982614 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:20.995440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7cfe3347-df11-4308-876f-bd7d76982614 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:20.995889 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7cfe3347-df11-4308-876f-bd7d76982614 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:20.996681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7cfe3347-df11-4308-876f-bd7d76982614 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:20.997128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7cfe3347-df11-4308-876f-bd7d76982614 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:21.143011 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7cfe3347-df11-4308-876f-bd7d76982614 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:21.152503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7cfe3347-df11-4308-876f-bd7d76982614 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1579 microversion: 2.1 time: 0.168934 Apr 07 13:01:21.153099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 349/700] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:20 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:21.190625 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1ba7a043-2809-4dca-afc1-bfd2a04e11df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:21.192320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1ba7a043-2809-4dca-afc1-bfd2a04e11df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:21.198470 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ba7a043-2809-4dca-afc1-bfd2a04e11df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:21.199159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ba7a043-2809-4dca-afc1-bfd2a04e11df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:21.199960 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ba7a043-2809-4dca-afc1-bfd2a04e11df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:21.200418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ba7a043-2809-4dca-afc1-bfd2a04e11df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:21.232066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1ba7a043-2809-4dca-afc1-bfd2a04e11df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046370 Apr 07 13:01:21.233493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 352/701] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:21 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:21.546453 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-abdcd757-1549-4344-863e-9087aa6e56d0 req-0d035579-ac40-43a7-8a14-baf544d86a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb36ce2a-6233-4601-85c0-35c550476cea", "name": "network-vif-deleted", "tag": "1d264377-61da-43aa-ba85-52dd323d34d8"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:21.555454 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-abdcd757-1549-4344-863e-9087aa6e56d0 req-0d035579-ac40-43a7-8a14-baf544d86a00 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:21.556002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-abdcd757-1549-4344-863e-9087aa6e56d0 req-0d035579-ac40-43a7-8a14-baf544d86a00 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:21.568825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-abdcd757-1549-4344-863e-9087aa6e56d0 req-0d035579-ac40-43a7-8a14-baf544d86a00 service nova] Creating event network-vif-deleted:1d264377-61da-43aa-ba85-52dd323d34d8 for instance cb36ce2a-6233-4601-85c0-35c550476cea on hv-cinder-83694 Apr 07 13:01:21.573723 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-abdcd757-1549-4344-863e-9087aa6e56d0 req-0d035579-ac40-43a7-8a14-baf544d86a00 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032035 Apr 07 13:01:21.574384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 350/702] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:01:21.802645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c2695448-8bc5-49e9-a3bc-2eb9eb2f036f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:21.803279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c2695448-8bc5-49e9-a3bc-2eb9eb2f036f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:21.810029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2695448-8bc5-49e9-a3bc-2eb9eb2f036f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:21.810491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2695448-8bc5-49e9-a3bc-2eb9eb2f036f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:21.811458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2695448-8bc5-49e9-a3bc-2eb9eb2f036f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:21.811898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2695448-8bc5-49e9-a3bc-2eb9eb2f036f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:21.831780 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-c2695448-8bc5-49e9-a3bc-2eb9eb2f036f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] HTTP exception thrown: Instance 34baf697-0c75-496f-a1fe-fef1314f1a9a could not be found. Apr 07 13:01:21.832407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c2695448-8bc5-49e9-a3bc-2eb9eb2f036f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Returning 404 to user: Instance 34baf697-0c75-496f-a1fe-fef1314f1a9a could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:01:21.833836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c2695448-8bc5-49e9-a3bc-2eb9eb2f036f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 404 len: 111 microversion: 2.1 time: 0.034862 Apr 07 13:01:21.834676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 353/703] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:21 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:01:21.844060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-11cea64e-35db-480d-b0ac-e47e709463e6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '.version_select at 0x7fde5839de50>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:21.867224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-11cea64e-35db-480d-b0ac-e47e709463e6 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082620730" status: 202 len: 0 microversion: 2.1 time: 0.027702 Apr 07 13:01:21.867807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 351/704] 10.222.0.15 () {58 vars in 1220 bytes} [Thu Apr 7 13:01:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082620730 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:01:22.169899 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ceb37349-1361-4cb9-8aa6-0d239e83feed tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:22.171168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ceb37349-1361-4cb9-8aa6-0d239e83feed tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:22.177588 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ceb37349-1361-4cb9-8aa6-0d239e83feed tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:22.178393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ceb37349-1361-4cb9-8aa6-0d239e83feed tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:22.179431 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ceb37349-1361-4cb9-8aa6-0d239e83feed tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:22.179950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ceb37349-1361-4cb9-8aa6-0d239e83feed tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:22.244678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d1999588-44b6-4ee2-bc9a-ae42602c5c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:22.246486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d1999588-44b6-4ee2-bc9a-ae42602c5c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:22.255478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d1999588-44b6-4ee2-bc9a-ae42602c5c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:22.256021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d1999588-44b6-4ee2-bc9a-ae42602c5c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:22.257317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d1999588-44b6-4ee2-bc9a-ae42602c5c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:22.257921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d1999588-44b6-4ee2-bc9a-ae42602c5c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:22.284698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ceb37349-1361-4cb9-8aa6-0d239e83feed tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:22.297122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d1999588-44b6-4ee2-bc9a-ae42602c5c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056458 Apr 07 13:01:22.301513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 352/705] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:22.302167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ceb37349-1361-4cb9-8aa6-0d239e83feed tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.136126 Apr 07 13:01:22.302759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 354/706] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:22 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:22.869324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4c0be3bf-3348-4031-8d54-a282e2f6d960 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Action: 'create', calling method: .version_select at 0x7fde5cd88310>, body: {"keypair": {"name": "tempest-keypair-1184296923"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:22.882919 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-4c0be3bf-3348-4031-8d54-a282e2f6d960 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Getting quotas for project ad6bab4269a84eae81e793309488d7dd. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:01:22.886606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-4c0be3bf-3348-4031-8d54-a282e2f6d960 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Getting quotas for user 7a36496b3c774c2097534b5fcad47db8 and project ad6bab4269a84eae81e793309488d7dd. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:01:23.104743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-4c0be3bf-3348-4031-8d54-a282e2f6d960 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Getting quotas for project ad6bab4269a84eae81e793309488d7dd. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:01:23.109296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-4c0be3bf-3348-4031-8d54-a282e2f6d960 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Getting quotas for user 7a36496b3c774c2097534b5fcad47db8 and project ad6bab4269a84eae81e793309488d7dd. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:01:23.122304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4c0be3bf-3348-4031-8d54-a282e2f6d960 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.257990 Apr 07 13:01:23.122823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 353/707] 10.222.0.15 () {60 vars in 1157 bytes} [Thu Apr 7 13:01:22 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:23.308982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0a422bb4-a6ef-461b-90fa-d7031f12bcdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:23.309909 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0a422bb4-a6ef-461b-90fa-d7031f12bcdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:23.316782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0a422bb4-a6ef-461b-90fa-d7031f12bcdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:23.317498 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0a422bb4-a6ef-461b-90fa-d7031f12bcdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:23.318376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0a422bb4-a6ef-461b-90fa-d7031f12bcdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:23.318487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-448c1726-45f7-4916-9725-19e0b60afb84 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:23.319009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0a422bb4-a6ef-461b-90fa-d7031f12bcdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:23.319114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-448c1726-45f7-4916-9725-19e0b60afb84 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:23.326369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-448c1726-45f7-4916-9725-19e0b60afb84 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:23.327060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-448c1726-45f7-4916-9725-19e0b60afb84 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:23.327736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-448c1726-45f7-4916-9725-19e0b60afb84 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:23.328407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-448c1726-45f7-4916-9725-19e0b60afb84 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:23.351104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0a422bb4-a6ef-461b-90fa-d7031f12bcdd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045968 Apr 07 13:01:23.351679 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 355/708] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:23 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:23.396272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-448c1726-45f7-4916-9725-19e0b60afb84 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:23.403463 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-448c1726-45f7-4916-9725-19e0b60afb84 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.088693 Apr 07 13:01:23.404028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 354/709] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:23 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:24.353123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1951670853", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c9d7c67-151c-4c9a-8243-50160558d5a2"}], "security_groups": [{"name": "tempest-securitygroup--1165155413"}], "key_name": "tempest-keypair-1184296923", "user_data": "}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:24.362586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0aae77f6-b9f5-48e4-8ba0-b3a620f27ad9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:24.363535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0aae77f6-b9f5-48e4-8ba0-b3a620f27ad9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:24.369732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0aae77f6-b9f5-48e4-8ba0-b3a620f27ad9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:24.370183 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0aae77f6-b9f5-48e4-8ba0-b3a620f27ad9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:24.371007 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0aae77f6-b9f5-48e4-8ba0-b3a620f27ad9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:24.371442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0aae77f6-b9f5-48e4-8ba0-b3a620f27ad9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:24.405205 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0aae77f6-b9f5-48e4-8ba0-b3a620f27ad9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046394 Apr 07 13:01:24.405845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 355/710] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:24 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:24.422113 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-16d73db5-81ef-46fb-8584-c6b3fc93fe7a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:24.422727 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-16d73db5-81ef-46fb-8584-c6b3fc93fe7a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:24.429111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-16d73db5-81ef-46fb-8584-c6b3fc93fe7a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:24.429566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-16d73db5-81ef-46fb-8584-c6b3fc93fe7a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:24.430343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-16d73db5-81ef-46fb-8584-c6b3fc93fe7a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:24.430787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-16d73db5-81ef-46fb-8584-c6b3fc93fe7a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:24.455744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.network.neutron [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] validate_networks() for [('4c9d7c67-151c-4c9a-8243-50160558d5a2', None, None, None, None, None)] {{(pid=116893) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 13:01:24.489582 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-16d73db5-81ef-46fb-8584-c6b3fc93fe7a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:24.496792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-16d73db5-81ef-46fb-8584-c6b3fc93fe7a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.079035 Apr 07 13:01:24.497362 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 356/711] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:24 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:24.858224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Flavor limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 13:01:24.858656 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Image limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 13:01:24.859130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Flavor pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 13:01:24.859567 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Image pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 13:01:24.859979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 13:01:24.868579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:24.869025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:24.869814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:24.870242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:24.886870 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Getting quotas for project ad6bab4269a84eae81e793309488d7dd. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:01:24.891561 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Getting quotas for user 7a36496b3c774c2097534b5fcad47db8 and project ad6bab4269a84eae81e793309488d7dd. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:01:24.902054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Going to run 1 instances... {{(pid=116893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 13:01:24.905119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 13:01:24.950851 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ef7cfaaf-b932-41da-809d-f783aa75c363 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.601768 Apr 07 13:01:24.951559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 356/712] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 13:01:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 13:01:24.961850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fbc69908-bdb8-4ee3-a2cd-a829038a72fa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:24.962562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fbc69908-bdb8-4ee3-a2cd-a829038a72fa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:25.020629 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fbc69908-bdb8-4ee3-a2cd-a829038a72fa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:25.026952 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fbc69908-bdb8-4ee3-a2cd-a829038a72fa tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1238 microversion: 2.1 time: 0.069014 Apr 07 13:01:25.027662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 357/713] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:24 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:25.417914 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1ac991d6-ee5d-46ac-95e2-01b4e678cb08 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:25.418901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1ac991d6-ee5d-46ac-95e2-01b4e678cb08 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:25.427313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ac991d6-ee5d-46ac-95e2-01b4e678cb08 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:25.427779 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ac991d6-ee5d-46ac-95e2-01b4e678cb08 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:25.428553 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ac991d6-ee5d-46ac-95e2-01b4e678cb08 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:25.429214 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ac991d6-ee5d-46ac-95e2-01b4e678cb08 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:25.468435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1ac991d6-ee5d-46ac-95e2-01b4e678cb08 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054788 Apr 07 13:01:25.469021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 357/714] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:25 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:25.515145 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7e809952-a9a3-41e6-bc20-9e2f9ab041b4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:25.515911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7e809952-a9a3-41e6-bc20-9e2f9ab041b4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:25.522683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7e809952-a9a3-41e6-bc20-9e2f9ab041b4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:25.523060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7e809952-a9a3-41e6-bc20-9e2f9ab041b4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:25.523836 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7e809952-a9a3-41e6-bc20-9e2f9ab041b4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:25.524376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7e809952-a9a3-41e6-bc20-9e2f9ab041b4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:25.585288 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7e809952-a9a3-41e6-bc20-9e2f9ab041b4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:25.593956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7e809952-a9a3-41e6-bc20-9e2f9ab041b4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.082588 Apr 07 13:01:25.594536 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 358/715] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:25 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:26.044797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0c23fc86-b2a8-46af-ade9-8516c6746608 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:26.045772 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0c23fc86-b2a8-46af-ade9-8516c6746608 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:26.052525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c23fc86-b2a8-46af-ade9-8516c6746608 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:26.053244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c23fc86-b2a8-46af-ade9-8516c6746608 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:26.054204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c23fc86-b2a8-46af-ade9-8516c6746608 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:26.054805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c23fc86-b2a8-46af-ade9-8516c6746608 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:26.125935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0c23fc86-b2a8-46af-ade9-8516c6746608 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:26.133258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0c23fc86-b2a8-46af-ade9-8516c6746608 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1298 microversion: 2.1 time: 0.092403 Apr 07 13:01:26.133990 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 358/716] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:26 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:26.481972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f5b0447a-e950-4b14-bcbe-84cca3ad1317 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:26.483255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f5b0447a-e950-4b14-bcbe-84cca3ad1317 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:26.489269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5b0447a-e950-4b14-bcbe-84cca3ad1317 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:26.489728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5b0447a-e950-4b14-bcbe-84cca3ad1317 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:26.490729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5b0447a-e950-4b14-bcbe-84cca3ad1317 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:26.491216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5b0447a-e950-4b14-bcbe-84cca3ad1317 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:26.522146 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f5b0447a-e950-4b14-bcbe-84cca3ad1317 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045720 Apr 07 13:01:26.522797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 359/717] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:26 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:26.610575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e14de0ee-f9ed-4271-9845-511d5259b5b7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:26.611178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e14de0ee-f9ed-4271-9845-511d5259b5b7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:26.617518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e14de0ee-f9ed-4271-9845-511d5259b5b7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:26.617965 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e14de0ee-f9ed-4271-9845-511d5259b5b7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:26.618718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e14de0ee-f9ed-4271-9845-511d5259b5b7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:26.619280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e14de0ee-f9ed-4271-9845-511d5259b5b7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:26.691772 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e14de0ee-f9ed-4271-9845-511d5259b5b7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:26.698964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e14de0ee-f9ed-4271-9845-511d5259b5b7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.092310 Apr 07 13:01:26.699525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 359/718] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:26 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:27.152405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ae58b9d0-ba51-44e6-b02f-e800936f3fb7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:27.153020 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ae58b9d0-ba51-44e6-b02f-e800936f3fb7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:27.159345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae58b9d0-ba51-44e6-b02f-e800936f3fb7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:27.160327 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae58b9d0-ba51-44e6-b02f-e800936f3fb7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:27.161105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae58b9d0-ba51-44e6-b02f-e800936f3fb7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:27.161687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae58b9d0-ba51-44e6-b02f-e800936f3fb7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:27.303263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ae58b9d0-ba51-44e6-b02f-e800936f3fb7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:27.311533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ae58b9d0-ba51-44e6-b02f-e800936f3fb7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1364 microversion: 2.1 time: 0.162958 Apr 07 13:01:27.312101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 360/719] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:27 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:27.534920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ed36ffc2-291e-45f9-8889-bab7f1659666 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:27.535980 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ed36ffc2-291e-45f9-8889-bab7f1659666 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:27.541874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ed36ffc2-291e-45f9-8889-bab7f1659666 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:27.542391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ed36ffc2-291e-45f9-8889-bab7f1659666 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:27.543265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ed36ffc2-291e-45f9-8889-bab7f1659666 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:27.543693 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ed36ffc2-291e-45f9-8889-bab7f1659666 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:27.573161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-6de909e1-8f76-4709-bf80-06bf97b71cbc req-b9af7e6b-6163-453e-b5e8-a4216d313e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3439aee-0673-4237-9ac0-67d6959acdad", "tag": "6ce58860-f078-406c-9346-1cd0933c1cf4"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:27.573745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ed36ffc2-291e-45f9-8889-bab7f1659666 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042407 Apr 07 13:01:27.574304 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 360/720] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:27 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:27.607316 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-6de909e1-8f76-4709-bf80-06bf97b71cbc req-b9af7e6b-6163-453e-b5e8-a4216d313e39 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:27.609797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-6de909e1-8f76-4709-bf80-06bf97b71cbc req-b9af7e6b-6163-453e-b5e8-a4216d313e39 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:27.621777 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-6de909e1-8f76-4709-bf80-06bf97b71cbc req-b9af7e6b-6163-453e-b5e8-a4216d313e39 service nova] Creating event network-changed:6ce58860-f078-406c-9346-1cd0933c1cf4 for instance b3439aee-0673-4237-9ac0-67d6959acdad on hv-cinder-83694 Apr 07 13:01:27.627442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-6de909e1-8f76-4709-bf80-06bf97b71cbc req-b9af7e6b-6163-453e-b5e8-a4216d313e39 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062143 Apr 07 13:01:27.628052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 361/721] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:01:27.715757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8369c715-acfc-4030-a29f-0a57f523706a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:27.717274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8369c715-acfc-4030-a29f-0a57f523706a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:27.724103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8369c715-acfc-4030-a29f-0a57f523706a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:27.724726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8369c715-acfc-4030-a29f-0a57f523706a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:27.725613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8369c715-acfc-4030-a29f-0a57f523706a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:27.726105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8369c715-acfc-4030-a29f-0a57f523706a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:27.792350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8369c715-acfc-4030-a29f-0a57f523706a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:27.800988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8369c715-acfc-4030-a29f-0a57f523706a tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.089025 Apr 07 13:01:27.801555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 361/722] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:27 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:28.329301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e5ad83ae-79aa-4eae-8d44-0b21e7ea5b4c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:28.330001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e5ad83ae-79aa-4eae-8d44-0b21e7ea5b4c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:28.336455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e5ad83ae-79aa-4eae-8d44-0b21e7ea5b4c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:28.336910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e5ad83ae-79aa-4eae-8d44-0b21e7ea5b4c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:28.337675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e5ad83ae-79aa-4eae-8d44-0b21e7ea5b4c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:28.338122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e5ad83ae-79aa-4eae-8d44-0b21e7ea5b4c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:28.469175 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e5ad83ae-79aa-4eae-8d44-0b21e7ea5b4c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:28.476332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e5ad83ae-79aa-4eae-8d44-0b21e7ea5b4c tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1364 microversion: 2.1 time: 0.151302 Apr 07 13:01:28.476888 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 362/723] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:28 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:28.586845 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-58a50c00-3997-40fd-b597-93a0d87c2a12 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:28.587767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-58a50c00-3997-40fd-b597-93a0d87c2a12 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:28.594465 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-58a50c00-3997-40fd-b597-93a0d87c2a12 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:28.594918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-58a50c00-3997-40fd-b597-93a0d87c2a12 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:28.595684 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-58a50c00-3997-40fd-b597-93a0d87c2a12 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:28.596118 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-58a50c00-3997-40fd-b597-93a0d87c2a12 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:28.623738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-58a50c00-3997-40fd-b597-93a0d87c2a12 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040809 Apr 07 13:01:28.624322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 362/724] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:28 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:28.817002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8b9ea279-a851-405f-9cf2-6d23a7e42be8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:28.817626 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8b9ea279-a851-405f-9cf2-6d23a7e42be8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:28.823890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8b9ea279-a851-405f-9cf2-6d23a7e42be8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:28.824375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8b9ea279-a851-405f-9cf2-6d23a7e42be8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:28.825143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8b9ea279-a851-405f-9cf2-6d23a7e42be8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:28.825583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8b9ea279-a851-405f-9cf2-6d23a7e42be8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:28.884300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8b9ea279-a851-405f-9cf2-6d23a7e42be8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:28.891532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8b9ea279-a851-405f-9cf2-6d23a7e42be8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078334 Apr 07 13:01:28.892090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 363/725] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:28 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:29.493107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-50ee33dc-b7b8-4eef-9365-24fc444edeb1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:29.493776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-50ee33dc-b7b8-4eef-9365-24fc444edeb1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:29.501317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50ee33dc-b7b8-4eef-9365-24fc444edeb1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:29.501765 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50ee33dc-b7b8-4eef-9365-24fc444edeb1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:29.502516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50ee33dc-b7b8-4eef-9365-24fc444edeb1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:29.502981 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50ee33dc-b7b8-4eef-9365-24fc444edeb1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:29.633566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-50ee33dc-b7b8-4eef-9365-24fc444edeb1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:29.635103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-920ac372-eab9-476a-90f3-97d4cdc65c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:29.636030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-920ac372-eab9-476a-90f3-97d4cdc65c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:29.641036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-50ee33dc-b7b8-4eef-9365-24fc444edeb1 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1364 microversion: 2.1 time: 0.151663 Apr 07 13:01:29.641606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 363/726] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:29 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:29.641814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-920ac372-eab9-476a-90f3-97d4cdc65c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:29.642240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-920ac372-eab9-476a-90f3-97d4cdc65c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:29.643003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-920ac372-eab9-476a-90f3-97d4cdc65c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:29.643435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-920ac372-eab9-476a-90f3-97d4cdc65c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:29.671656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-920ac372-eab9-476a-90f3-97d4cdc65c9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040407 Apr 07 13:01:29.672214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 364/727] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:29 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:29.908417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4549aab7-0727-4baa-a163-f5b855335f91 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:29.909055 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4549aab7-0727-4baa-a163-f5b855335f91 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:29.915074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4549aab7-0727-4baa-a163-f5b855335f91 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:29.915528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4549aab7-0727-4baa-a163-f5b855335f91 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:29.916340 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4549aab7-0727-4baa-a163-f5b855335f91 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:29.916776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4549aab7-0727-4baa-a163-f5b855335f91 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:29.974639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4549aab7-0727-4baa-a163-f5b855335f91 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:29.981812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4549aab7-0727-4baa-a163-f5b855335f91 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.077794 Apr 07 13:01:29.983026 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 364/728] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:29 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:30.658124 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8036fb63-1297-46ff-8ef7-125bc0111594 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:30.659266 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8036fb63-1297-46ff-8ef7-125bc0111594 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:30.665664 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8036fb63-1297-46ff-8ef7-125bc0111594 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:30.666111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8036fb63-1297-46ff-8ef7-125bc0111594 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:30.666869 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8036fb63-1297-46ff-8ef7-125bc0111594 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:30.667304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8036fb63-1297-46ff-8ef7-125bc0111594 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:30.682812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fb97a137-9b62-4f21-b4d7-0b861f24090c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:30.683767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fb97a137-9b62-4f21-b4d7-0b861f24090c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:30.690078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb97a137-9b62-4f21-b4d7-0b861f24090c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:30.690529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb97a137-9b62-4f21-b4d7-0b861f24090c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:30.691285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb97a137-9b62-4f21-b4d7-0b861f24090c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:30.691719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb97a137-9b62-4f21-b4d7-0b861f24090c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:30.720862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fb97a137-9b62-4f21-b4d7-0b861f24090c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041901 Apr 07 13:01:30.721420 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 365/729] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:30 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:30.797710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8036fb63-1297-46ff-8ef7-125bc0111594 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:30.804879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8036fb63-1297-46ff-8ef7-125bc0111594 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1364 microversion: 2.1 time: 0.151162 Apr 07 13:01:30.805444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 365/730] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:30 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:30.998594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ffd42720-dd3d-4c56-ac99-e4c11322a0eb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:30.999198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ffd42720-dd3d-4c56-ac99-e4c11322a0eb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:31.005283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffd42720-dd3d-4c56-ac99-e4c11322a0eb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:31.005734 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffd42720-dd3d-4c56-ac99-e4c11322a0eb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:31.006501 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffd42720-dd3d-4c56-ac99-e4c11322a0eb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:31.006937 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffd42720-dd3d-4c56-ac99-e4c11322a0eb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:31.067976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ffd42720-dd3d-4c56-ac99-e4c11322a0eb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:31.075266 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ffd42720-dd3d-4c56-ac99-e4c11322a0eb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.080462 Apr 07 13:01:31.076371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 366/731] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:30 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:31.732891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0941ada7-319e-41ba-96f5-463918e570ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:31.733834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0941ada7-319e-41ba-96f5-463918e570ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:31.740312 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0941ada7-319e-41ba-96f5-463918e570ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:31.740770 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0941ada7-319e-41ba-96f5-463918e570ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:31.741525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0941ada7-319e-41ba-96f5-463918e570ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:31.741955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0941ada7-319e-41ba-96f5-463918e570ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:31.769914 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0941ada7-319e-41ba-96f5-463918e570ee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041404 Apr 07 13:01:31.770449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 366/732] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:31 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:31.821143 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1144deb8-e480-4104-a0e8-137e1a425ff0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:31.821761 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1144deb8-e480-4104-a0e8-137e1a425ff0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:31.828656 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1144deb8-e480-4104-a0e8-137e1a425ff0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:31.829112 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1144deb8-e480-4104-a0e8-137e1a425ff0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:31.829879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1144deb8-e480-4104-a0e8-137e1a425ff0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:31.830323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1144deb8-e480-4104-a0e8-137e1a425ff0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:31.960758 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1144deb8-e480-4104-a0e8-137e1a425ff0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:31.967883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1144deb8-e480-4104-a0e8-137e1a425ff0 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1364 microversion: 2.1 time: 0.150530 Apr 07 13:01:31.968485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 367/733] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:31 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:32.092254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-11a4a38b-0859-4ada-9806-f9f1476301b5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:32.092868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-11a4a38b-0859-4ada-9806-f9f1476301b5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:32.098735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11a4a38b-0859-4ada-9806-f9f1476301b5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:32.099192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11a4a38b-0859-4ada-9806-f9f1476301b5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:32.099962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11a4a38b-0859-4ada-9806-f9f1476301b5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:32.100430 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11a4a38b-0859-4ada-9806-f9f1476301b5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:32.158513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-11a4a38b-0859-4ada-9806-f9f1476301b5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:32.165857 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-11a4a38b-0859-4ada-9806-f9f1476301b5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.077554 Apr 07 13:01:32.166361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 367/734] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:32 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:32.748760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-990a1815-c0e2-4b15-9d55-858cd0ef8a34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1712445778"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:32.749291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-990a1815-c0e2-4b15-9d55-858cd0ef8a34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:32.755162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-990a1815-c0e2-4b15-9d55-858cd0ef8a34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:32.755611 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-990a1815-c0e2-4b15-9d55-858cd0ef8a34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:32.756401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-990a1815-c0e2-4b15-9d55-858cd0ef8a34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:32.756835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-990a1815-c0e2-4b15-9d55-858cd0ef8a34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:32.781543 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-70be0e13-bf9a-498e-83e9-41420781bf89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:32.782395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-70be0e13-bf9a-498e-83e9-41420781bf89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:32.788895 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-70be0e13-bf9a-498e-83e9-41420781bf89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:32.789342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-70be0e13-bf9a-498e-83e9-41420781bf89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:32.790108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-70be0e13-bf9a-498e-83e9-41420781bf89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:32.790539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-70be0e13-bf9a-498e-83e9-41420781bf89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:32.820616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-70be0e13-bf9a-498e-83e9-41420781bf89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043584 Apr 07 13:01:32.821176 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 368/735] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:32 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:32.884912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.network.security_group_api [None req-990a1815-c0e2-4b15-9d55-858cd0ef8a34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Removing security group 472cc598-edcf-402a-9dd7-b505f5390bd2 from port 3f362b45-57dc-4ae2-9d2e-6280d7bf36e2 Apr 07 13:01:32.984569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f26d38cf-e519-4f4d-86d5-e991c0e87c91 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:32.985193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f26d38cf-e519-4f4d-86d5-e991c0e87c91 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:32.991472 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f26d38cf-e519-4f4d-86d5-e991c0e87c91 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:32.991933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f26d38cf-e519-4f4d-86d5-e991c0e87c91 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:32.993118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f26d38cf-e519-4f4d-86d5-e991c0e87c91 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:32.993238 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f26d38cf-e519-4f4d-86d5-e991c0e87c91 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:33.136697 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f26d38cf-e519-4f4d-86d5-e991c0e87c91 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:33.144642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f26d38cf-e519-4f4d-86d5-e991c0e87c91 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1364 microversion: 2.1 time: 0.164466 Apr 07 13:01:33.145211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 369/736] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:32 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:33.182397 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-51b15d2a-c9f3-40b3-aba8-bcdf3aedf9d0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:33.183157 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-51b15d2a-c9f3-40b3-aba8-bcdf3aedf9d0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:33.190461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-51b15d2a-c9f3-40b3-aba8-bcdf3aedf9d0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:33.191086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-51b15d2a-c9f3-40b3-aba8-bcdf3aedf9d0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:33.191787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-51b15d2a-c9f3-40b3-aba8-bcdf3aedf9d0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:33.192338 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-51b15d2a-c9f3-40b3-aba8-bcdf3aedf9d0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:33.240757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-990a1815-c0e2-4b15-9d55-858cd0ef8a34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "POST /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/action" status: 202 len: 0 microversion: 2.1 time: 0.495383 Apr 07 13:01:33.241629 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 368/737] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 13:01:32 2022] POST /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:01:33.251889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-40f81e30-6f72-4745-b8e1-e2df44aa0861 req-e984ebbc-f136-4e19-9a07-83dded0dff31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926785df-7955-4e58-a0ae-dc896b2b3f2c", "tag": "3f362b45-57dc-4ae2-9d2e-6280d7bf36e2"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:33.255391 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-51b15d2a-c9f3-40b3-aba8-bcdf3aedf9d0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:33.262522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-40f81e30-6f72-4745-b8e1-e2df44aa0861 req-e984ebbc-f136-4e19-9a07-83dded0dff31 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:33.263396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-40f81e30-6f72-4745-b8e1-e2df44aa0861 req-e984ebbc-f136-4e19-9a07-83dded0dff31 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:33.267160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-51b15d2a-c9f3-40b3-aba8-bcdf3aedf9d0 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.087980 Apr 07 13:01:33.269002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 370/738] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:33 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:33.279286 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-40f81e30-6f72-4745-b8e1-e2df44aa0861 req-e984ebbc-f136-4e19-9a07-83dded0dff31 service nova] Creating event network-changed:3f362b45-57dc-4ae2-9d2e-6280d7bf36e2 for instance 926785df-7955-4e58-a0ae-dc896b2b3f2c on hv-cinder-83694 Apr 07 13:01:33.285484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-40f81e30-6f72-4745-b8e1-e2df44aa0861 req-e984ebbc-f136-4e19-9a07-83dded0dff31 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039230 Apr 07 13:01:33.286322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 369/739] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:01:33.837526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-17f9c782-face-466f-b409-d34a69ff618a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:33.839816 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-17f9c782-face-466f-b409-d34a69ff618a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:33.849562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-17f9c782-face-466f-b409-d34a69ff618a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:33.852436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-17f9c782-face-466f-b409-d34a69ff618a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:33.854538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-17f9c782-face-466f-b409-d34a69ff618a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:33.856885 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-17f9c782-face-466f-b409-d34a69ff618a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:33.896903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-17f9c782-face-466f-b409-d34a69ff618a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067622 Apr 07 13:01:33.897734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 371/740] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:33 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:34.162265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-39c829d8-aa30-4d66-9b75-43fbb7e37e2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:34.162873 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-39c829d8-aa30-4d66-9b75-43fbb7e37e2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:34.169108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39c829d8-aa30-4d66-9b75-43fbb7e37e2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:34.169571 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39c829d8-aa30-4d66-9b75-43fbb7e37e2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:34.170438 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39c829d8-aa30-4d66-9b75-43fbb7e37e2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:34.170883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39c829d8-aa30-4d66-9b75-43fbb7e37e2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:34.283963 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7227602c-3abc-47d6-91cf-8253a9f8c190 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:34.284612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7227602c-3abc-47d6-91cf-8253a9f8c190 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:34.291232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7227602c-3abc-47d6-91cf-8253a9f8c190 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:34.291678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7227602c-3abc-47d6-91cf-8253a9f8c190 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:34.292472 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7227602c-3abc-47d6-91cf-8253a9f8c190 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:34.292908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7227602c-3abc-47d6-91cf-8253a9f8c190 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:34.305031 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-39c829d8-aa30-4d66-9b75-43fbb7e37e2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:34.314517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-39c829d8-aa30-4d66-9b75-43fbb7e37e2f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1364 microversion: 2.1 time: 0.156163 Apr 07 13:01:34.322952 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 370/741] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:34 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:34.359425 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7227602c-3abc-47d6-91cf-8253a9f8c190 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:34.366606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7227602c-3abc-47d6-91cf-8253a9f8c190 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.086378 Apr 07 13:01:34.367161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 372/742] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:34 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:34.659715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-99d49607-35dd-4fff-859c-64d6d1a67dae req-442f3141-f9b6-4186-84ec-0ffd8d237099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3439aee-0673-4237-9ac0-67d6959acdad", "name": "network-vif-plugged", "status": "completed", "tag": "6ce58860-f078-406c-9346-1cd0933c1cf4"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:34.667936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-99d49607-35dd-4fff-859c-64d6d1a67dae req-442f3141-f9b6-4186-84ec-0ffd8d237099 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:34.668427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-99d49607-35dd-4fff-859c-64d6d1a67dae req-442f3141-f9b6-4186-84ec-0ffd8d237099 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:34.679636 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-99d49607-35dd-4fff-859c-64d6d1a67dae req-442f3141-f9b6-4186-84ec-0ffd8d237099 service nova] Creating event network-vif-plugged:6ce58860-f078-406c-9346-1cd0933c1cf4 for instance b3439aee-0673-4237-9ac0-67d6959acdad on hv-cinder-83694 Apr 07 13:01:34.684247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-99d49607-35dd-4fff-859c-64d6d1a67dae req-442f3141-f9b6-4186-84ec-0ffd8d237099 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094275 Apr 07 13:01:34.684992 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 371/743] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:01:34.820207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-06ed853d-bfa6-4dc7-8049-e8e71dbb2c68 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:34.820832 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-06ed853d-bfa6-4dc7-8049-e8e71dbb2c68 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:34.827977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06ed853d-bfa6-4dc7-8049-e8e71dbb2c68 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:34.828573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06ed853d-bfa6-4dc7-8049-e8e71dbb2c68 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:34.829709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06ed853d-bfa6-4dc7-8049-e8e71dbb2c68 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:34.830393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06ed853d-bfa6-4dc7-8049-e8e71dbb2c68 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:34.893376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-224a7428-2273-4a60-8fc5-7188dfddbd22 req-f151a29a-51d7-4335-850e-f3b60a16060e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926785df-7955-4e58-a0ae-dc896b2b3f2c", "tag": "3f362b45-57dc-4ae2-9d2e-6280d7bf36e2"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:34.902151 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-224a7428-2273-4a60-8fc5-7188dfddbd22 req-f151a29a-51d7-4335-850e-f3b60a16060e service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:34.902596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-224a7428-2273-4a60-8fc5-7188dfddbd22 req-f151a29a-51d7-4335-850e-f3b60a16060e service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:34.914429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-224a7428-2273-4a60-8fc5-7188dfddbd22 req-f151a29a-51d7-4335-850e-f3b60a16060e service nova] Creating event network-changed:3f362b45-57dc-4ae2-9d2e-6280d7bf36e2 for instance 926785df-7955-4e58-a0ae-dc896b2b3f2c on hv-cinder-83694 Apr 07 13:01:34.919390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-224a7428-2273-4a60-8fc5-7188dfddbd22 req-f151a29a-51d7-4335-850e-f3b60a16060e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101071 Apr 07 13:01:34.920919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 372/744] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:01:34.929054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-698569e4-60d6-40d5-bab7-5c04d37dd0be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:34.930139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-698569e4-60d6-40d5-bab7-5c04d37dd0be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:34.937069 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-698569e4-60d6-40d5-bab7-5c04d37dd0be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:34.937514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-698569e4-60d6-40d5-bab7-5c04d37dd0be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:34.938313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-698569e4-60d6-40d5-bab7-5c04d37dd0be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:34.938740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-698569e4-60d6-40d5-bab7-5c04d37dd0be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:34.968201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-698569e4-60d6-40d5-bab7-5c04d37dd0be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043561 Apr 07 13:01:34.968758 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 373/745] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:34 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:35.331616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-19d92a96-2b8a-4f56-85be-ec132729e737 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:35.332280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-19d92a96-2b8a-4f56-85be-ec132729e737 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:35.338358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19d92a96-2b8a-4f56-85be-ec132729e737 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:35.338803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19d92a96-2b8a-4f56-85be-ec132729e737 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:35.339556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19d92a96-2b8a-4f56-85be-ec132729e737 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:35.339987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19d92a96-2b8a-4f56-85be-ec132729e737 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:35.472213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-19d92a96-2b8a-4f56-85be-ec132729e737 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:35.479527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-19d92a96-2b8a-4f56-85be-ec132729e737 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1364 microversion: 2.1 time: 0.151686 Apr 07 13:01:35.480088 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 374/746] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:35 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:35.484515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6a58ff23-5246-4086-8b8a-458d0861ae6f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:35.485122 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6a58ff23-5246-4086-8b8a-458d0861ae6f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:35.490947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a58ff23-5246-4086-8b8a-458d0861ae6f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:35.491398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a58ff23-5246-4086-8b8a-458d0861ae6f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:35.492248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a58ff23-5246-4086-8b8a-458d0861ae6f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:35.492623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a58ff23-5246-4086-8b8a-458d0861ae6f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:35.556601 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6a58ff23-5246-4086-8b8a-458d0861ae6f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:35.564702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6a58ff23-5246-4086-8b8a-458d0861ae6f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.083605 Apr 07 13:01:35.565589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 375/747] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:35 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:35.979530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8608e53a-612f-4dab-8792-fa1b6c7a83ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:35.980574 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8608e53a-612f-4dab-8792-fa1b6c7a83ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:35.986721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8608e53a-612f-4dab-8792-fa1b6c7a83ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:35.987176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8608e53a-612f-4dab-8792-fa1b6c7a83ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:35.987950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8608e53a-612f-4dab-8792-fa1b6c7a83ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:35.988414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8608e53a-612f-4dab-8792-fa1b6c7a83ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:36.017858 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8608e53a-612f-4dab-8792-fa1b6c7a83ad tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042122 Apr 07 13:01:36.018336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 376/748] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:35 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:36.502586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-533412a5-bf13-49b1-98d6-7937aaff0fa7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:36.503276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-533412a5-bf13-49b1-98d6-7937aaff0fa7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:36.509199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-533412a5-bf13-49b1-98d6-7937aaff0fa7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:36.509646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-533412a5-bf13-49b1-98d6-7937aaff0fa7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:36.510402 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-533412a5-bf13-49b1-98d6-7937aaff0fa7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:36.510843 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-533412a5-bf13-49b1-98d6-7937aaff0fa7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:36.649391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-533412a5-bf13-49b1-98d6-7937aaff0fa7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:36.657052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-533412a5-bf13-49b1-98d6-7937aaff0fa7 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1364 microversion: 2.1 time: 0.159840 Apr 07 13:01:36.657614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 377/749] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:36 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:36.662025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ffe2cfd8-bf45-4d85-9337-65d4ba3c866e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:36.662658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ffe2cfd8-bf45-4d85-9337-65d4ba3c866e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:36.668054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffe2cfd8-bf45-4d85-9337-65d4ba3c866e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:36.668537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffe2cfd8-bf45-4d85-9337-65d4ba3c866e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:36.669293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffe2cfd8-bf45-4d85-9337-65d4ba3c866e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:36.669732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffe2cfd8-bf45-4d85-9337-65d4ba3c866e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:36.726224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ffe2cfd8-bf45-4d85-9337-65d4ba3c866e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:36.733668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ffe2cfd8-bf45-4d85-9337-65d4ba3c866e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.075114 Apr 07 13:01:36.734233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 378/750] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:36 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:37.029783 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ebbc6ad8-f326-4e75-94ab-7063c695d720 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:37.030700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ebbc6ad8-f326-4e75-94ab-7063c695d720 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:37.036561 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ebbc6ad8-f326-4e75-94ab-7063c695d720 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:37.037009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ebbc6ad8-f326-4e75-94ab-7063c695d720 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:37.037849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ebbc6ad8-f326-4e75-94ab-7063c695d720 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:37.038311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ebbc6ad8-f326-4e75-94ab-7063c695d720 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:37.066658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ebbc6ad8-f326-4e75-94ab-7063c695d720 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041115 Apr 07 13:01:37.067201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 379/751] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:37 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:37.674051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2073c23a-9565-44e0-93ef-57dc42d16a9f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:37.674686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2073c23a-9565-44e0-93ef-57dc42d16a9f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:37.680812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2073c23a-9565-44e0-93ef-57dc42d16a9f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:37.681261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2073c23a-9565-44e0-93ef-57dc42d16a9f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:37.682011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2073c23a-9565-44e0-93ef-57dc42d16a9f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:37.682441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2073c23a-9565-44e0-93ef-57dc42d16a9f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:37.816341 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2073c23a-9565-44e0-93ef-57dc42d16a9f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:37.823675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2073c23a-9565-44e0-93ef-57dc42d16a9f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1550 microversion: 2.1 time: 0.153854 Apr 07 13:01:37.824251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 380/752] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:37 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:37.830044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-622b1d39-2458-4fde-abfe-ecf29cdc4705 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:37.830044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-622b1d39-2458-4fde-abfe-ecf29cdc4705 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:37.835612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-622b1d39-2458-4fde-abfe-ecf29cdc4705 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:37.836015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-622b1d39-2458-4fde-abfe-ecf29cdc4705 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:37.836813 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-622b1d39-2458-4fde-abfe-ecf29cdc4705 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:37.837239 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-622b1d39-2458-4fde-abfe-ecf29cdc4705 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:37.899255 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-622b1d39-2458-4fde-abfe-ecf29cdc4705 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:37.907291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-622b1d39-2458-4fde-abfe-ecf29cdc4705 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.082113 Apr 07 13:01:37.907857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 381/753] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:37 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:01:37.912253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9e351cd4-3c75-4aef-8327-50978791822f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:37.912745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9e351cd4-3c75-4aef-8327-50978791822f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:37.918128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e351cd4-3c75-4aef-8327-50978791822f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:37.918582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e351cd4-3c75-4aef-8327-50978791822f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:37.919373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e351cd4-3c75-4aef-8327-50978791822f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:37.919897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e351cd4-3c75-4aef-8327-50978791822f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:37.998890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9e351cd4-3c75-4aef-8327-50978791822f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089946 Apr 07 13:01:37.999480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 382/754] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Apr 7 13:01:37 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:01:38.079376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-70c89d74-63bf-49c5-bb95-d03bc7b57595 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:38.080327 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-70c89d74-63bf-49c5-bb95-d03bc7b57595 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:38.086372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-70c89d74-63bf-49c5-bb95-d03bc7b57595 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:38.086752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-70c89d74-63bf-49c5-bb95-d03bc7b57595 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:38.087516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-70c89d74-63bf-49c5-bb95-d03bc7b57595 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:38.087946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-70c89d74-63bf-49c5-bb95-d03bc7b57595 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:38.116687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-70c89d74-63bf-49c5-bb95-d03bc7b57595 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041981 Apr 07 13:01:38.117448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 383/755] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:38 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:38.924329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-943c86c1-3ff1-4c25-92b1-5be667868ea7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:38.925286 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-943c86c1-3ff1-4c25-92b1-5be667868ea7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:38.931249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-943c86c1-3ff1-4c25-92b1-5be667868ea7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:38.931695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-943c86c1-3ff1-4c25-92b1-5be667868ea7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:38.932520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-943c86c1-3ff1-4c25-92b1-5be667868ea7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:38.932953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-943c86c1-3ff1-4c25-92b1-5be667868ea7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:39.008536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-943c86c1-3ff1-4c25-92b1-5be667868ea7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:39.016074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-943c86c1-3ff1-4c25-92b1-5be667868ea7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.095608 Apr 07 13:01:39.016680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 384/756] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:38 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:39.128971 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f603bdc6-3f95-4f96-9fce-1f4eb1c5d321 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:39.129898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f603bdc6-3f95-4f96-9fce-1f4eb1c5d321 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:39.135839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f603bdc6-3f95-4f96-9fce-1f4eb1c5d321 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:39.136253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f603bdc6-3f95-4f96-9fce-1f4eb1c5d321 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:39.137027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f603bdc6-3f95-4f96-9fce-1f4eb1c5d321 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:39.137469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f603bdc6-3f95-4f96-9fce-1f4eb1c5d321 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:39.167000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f603bdc6-3f95-4f96-9fce-1f4eb1c5d321 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041970 Apr 07 13:01:39.167565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 385/757] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:39 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:39.227663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-1896096d-56e4-446e-9757-d2095546624c req-f0201d4b-3d3d-453f-858e-b9eeae61ad1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3439aee-0673-4237-9ac0-67d6959acdad", "tag": "6ce58860-f078-406c-9346-1cd0933c1cf4"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:01:39.236003 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-1896096d-56e4-446e-9757-d2095546624c req-f0201d4b-3d3d-453f-858e-b9eeae61ad1c service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:39.236554 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-1896096d-56e4-446e-9757-d2095546624c req-f0201d4b-3d3d-453f-858e-b9eeae61ad1c service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:39.247318 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-1896096d-56e4-446e-9757-d2095546624c req-f0201d4b-3d3d-453f-858e-b9eeae61ad1c service nova] Creating event network-changed:6ce58860-f078-406c-9346-1cd0933c1cf4 for instance b3439aee-0673-4237-9ac0-67d6959acdad on hv-cinder-83694 Apr 07 13:01:39.252733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-1896096d-56e4-446e-9757-d2095546624c req-f0201d4b-3d3d-453f-858e-b9eeae61ad1c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028776 Apr 07 13:01:39.253316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 386/758] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:01:40.034017 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-69fc6cc9-48d7-42af-8ea0-908549de9e76 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:40.034711 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-69fc6cc9-48d7-42af-8ea0-908549de9e76 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:40.041278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-69fc6cc9-48d7-42af-8ea0-908549de9e76 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:40.041735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-69fc6cc9-48d7-42af-8ea0-908549de9e76 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:40.042505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-69fc6cc9-48d7-42af-8ea0-908549de9e76 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:40.042939 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-69fc6cc9-48d7-42af-8ea0-908549de9e76 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:40.103528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-69fc6cc9-48d7-42af-8ea0-908549de9e76 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:40.111213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-69fc6cc9-48d7-42af-8ea0-908549de9e76 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.082201 Apr 07 13:01:40.111778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 387/759] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:40 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:40.178897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-58317873-679e-4dfe-b5fd-9f67a1a9f61f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:40.179828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-58317873-679e-4dfe-b5fd-9f67a1a9f61f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:40.186554 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-58317873-679e-4dfe-b5fd-9f67a1a9f61f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:40.187011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-58317873-679e-4dfe-b5fd-9f67a1a9f61f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:40.187798 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-58317873-679e-4dfe-b5fd-9f67a1a9f61f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:40.188279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-58317873-679e-4dfe-b5fd-9f67a1a9f61f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:40.217819 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-58317873-679e-4dfe-b5fd-9f67a1a9f61f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042792 Apr 07 13:01:40.218555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 388/760] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:40 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:41.128372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f72073e2-49b9-493f-a890-19209805fdac tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:41.129055 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f72073e2-49b9-493f-a890-19209805fdac tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:41.135862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f72073e2-49b9-493f-a890-19209805fdac tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:41.136358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f72073e2-49b9-493f-a890-19209805fdac tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:41.137143 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f72073e2-49b9-493f-a890-19209805fdac tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:41.137582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f72073e2-49b9-493f-a890-19209805fdac tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:41.208239 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f72073e2-49b9-493f-a890-19209805fdac tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:41.215599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f72073e2-49b9-493f-a890-19209805fdac tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.091120 Apr 07 13:01:41.216176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 389/761] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:41 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:41.228838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0a37a043-97a8-44d4-9a09-7bd4bfeb7f7c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:41.229798 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0a37a043-97a8-44d4-9a09-7bd4bfeb7f7c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:41.235751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0a37a043-97a8-44d4-9a09-7bd4bfeb7f7c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:41.236238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0a37a043-97a8-44d4-9a09-7bd4bfeb7f7c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:41.237042 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0a37a043-97a8-44d4-9a09-7bd4bfeb7f7c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:41.237479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0a37a043-97a8-44d4-9a09-7bd4bfeb7f7c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:41.266350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0a37a043-97a8-44d4-9a09-7bd4bfeb7f7c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041141 Apr 07 13:01:41.266898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 390/762] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:41 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:01:42.232929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9c4d5d41-9b46-4f49-9d1f-aad970db7ef3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:42.233574 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9c4d5d41-9b46-4f49-9d1f-aad970db7ef3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:42.240040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c4d5d41-9b46-4f49-9d1f-aad970db7ef3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:42.240540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c4d5d41-9b46-4f49-9d1f-aad970db7ef3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:42.241307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c4d5d41-9b46-4f49-9d1f-aad970db7ef3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:42.241747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c4d5d41-9b46-4f49-9d1f-aad970db7ef3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:42.300725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9c4d5d41-9b46-4f49-9d1f-aad970db7ef3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:42.308265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9c4d5d41-9b46-4f49-9d1f-aad970db7ef3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.079191 Apr 07 13:01:42.308815 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 391/763] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:42 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:42.313994 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f5af486f-e2e7-49be-a29e-a9db3cd20721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:42.314883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f5af486f-e2e7-49be-a29e-a9db3cd20721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:42.320482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f5af486f-e2e7-49be-a29e-a9db3cd20721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:42.320930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f5af486f-e2e7-49be-a29e-a9db3cd20721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:42.321676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f5af486f-e2e7-49be-a29e-a9db3cd20721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:42.322107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f5af486f-e2e7-49be-a29e-a9db3cd20721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:42.350849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f5af486f-e2e7-49be-a29e-a9db3cd20721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041072 Apr 07 13:01:42.351378 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 392/764] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:42 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:43.324672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-da76b8c2-a75b-48e1-b3da-dea4c65d07a1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:43.325415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-da76b8c2-a75b-48e1-b3da-dea4c65d07a1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:43.331661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da76b8c2-a75b-48e1-b3da-dea4c65d07a1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:43.332106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da76b8c2-a75b-48e1-b3da-dea4c65d07a1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:43.332889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da76b8c2-a75b-48e1-b3da-dea4c65d07a1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:43.333323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da76b8c2-a75b-48e1-b3da-dea4c65d07a1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:43.391065 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-da76b8c2-a75b-48e1-b3da-dea4c65d07a1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:43.398253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-da76b8c2-a75b-48e1-b3da-dea4c65d07a1 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.077374 Apr 07 13:01:43.398804 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 393/765] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:43 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:43.403171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e81df9fb-cae3-4a7d-8a0f-e604663c6425 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:43.404928 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e81df9fb-cae3-4a7d-8a0f-e604663c6425 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:43.410255 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e81df9fb-cae3-4a7d-8a0f-e604663c6425 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:43.410700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e81df9fb-cae3-4a7d-8a0f-e604663c6425 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:43.411447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e81df9fb-cae3-4a7d-8a0f-e604663c6425 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:43.411875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e81df9fb-cae3-4a7d-8a0f-e604663c6425 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:43.440074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e81df9fb-cae3-4a7d-8a0f-e604663c6425 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040300 Apr 07 13:01:43.440701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 394/766] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:43 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:44.414777 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-46141284-261a-4970-a934-2fd1c179bd30 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:44.415401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-46141284-261a-4970-a934-2fd1c179bd30 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:44.422053 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46141284-261a-4970-a934-2fd1c179bd30 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:44.422498 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46141284-261a-4970-a934-2fd1c179bd30 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:44.423249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46141284-261a-4970-a934-2fd1c179bd30 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:44.423679 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46141284-261a-4970-a934-2fd1c179bd30 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:44.481295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-46141284-261a-4970-a934-2fd1c179bd30 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:44.489099 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-46141284-261a-4970-a934-2fd1c179bd30 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078177 Apr 07 13:01:44.489649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 395/767] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:44 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:44.494072 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b49ea98a-14e1-494c-9bdb-98180448b911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:44.494963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b49ea98a-14e1-494c-9bdb-98180448b911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:44.500834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b49ea98a-14e1-494c-9bdb-98180448b911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:44.501276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b49ea98a-14e1-494c-9bdb-98180448b911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:44.502029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b49ea98a-14e1-494c-9bdb-98180448b911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:44.502458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b49ea98a-14e1-494c-9bdb-98180448b911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:44.530698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b49ea98a-14e1-494c-9bdb-98180448b911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039983 Apr 07 13:01:44.531141 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 396/768] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:44 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:45.506633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-28ead62d-a840-4952-aadd-afafee21da19 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:45.507274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-28ead62d-a840-4952-aadd-afafee21da19 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:45.514977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-28ead62d-a840-4952-aadd-afafee21da19 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:45.515457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-28ead62d-a840-4952-aadd-afafee21da19 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:45.516249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-28ead62d-a840-4952-aadd-afafee21da19 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:45.516682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-28ead62d-a840-4952-aadd-afafee21da19 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:45.578438 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-28ead62d-a840-4952-aadd-afafee21da19 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:45.585767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-28ead62d-a840-4952-aadd-afafee21da19 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.083025 Apr 07 13:01:45.586329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 397/769] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:45 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:45.590852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-81172b2d-952d-4eb0-9359-a3cbf3fc427d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:45.591995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-81172b2d-952d-4eb0-9359-a3cbf3fc427d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:45.598144 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-81172b2d-952d-4eb0-9359-a3cbf3fc427d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:45.598597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-81172b2d-952d-4eb0-9359-a3cbf3fc427d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:45.599369 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-81172b2d-952d-4eb0-9359-a3cbf3fc427d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:45.599808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-81172b2d-952d-4eb0-9359-a3cbf3fc427d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:45.627925 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-81172b2d-952d-4eb0-9359-a3cbf3fc427d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040603 Apr 07 13:01:45.628534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 398/770] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:45 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:46.602193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2834820b-254e-4143-82ce-fb4fb272b99f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:46.602811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2834820b-254e-4143-82ce-fb4fb272b99f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:46.609130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2834820b-254e-4143-82ce-fb4fb272b99f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:46.609577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2834820b-254e-4143-82ce-fb4fb272b99f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:46.610331 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2834820b-254e-4143-82ce-fb4fb272b99f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:46.610764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2834820b-254e-4143-82ce-fb4fb272b99f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:46.668660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2834820b-254e-4143-82ce-fb4fb272b99f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:46.675942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2834820b-254e-4143-82ce-fb4fb272b99f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.077525 Apr 07 13:01:46.676531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 399/771] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:46 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:46.680956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-388e9d21-1716-40d8-a626-58bc9c3d7f77 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:46.681861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-388e9d21-1716-40d8-a626-58bc9c3d7f77 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:46.687355 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-388e9d21-1716-40d8-a626-58bc9c3d7f77 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:46.687802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-388e9d21-1716-40d8-a626-58bc9c3d7f77 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:46.688588 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-388e9d21-1716-40d8-a626-58bc9c3d7f77 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:46.689023 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-388e9d21-1716-40d8-a626-58bc9c3d7f77 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:46.716530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-388e9d21-1716-40d8-a626-58bc9c3d7f77 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039006 Apr 07 13:01:46.717071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 400/772] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:46 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:47.692294 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7941e968-39e2-424f-976b-ffca4fbd399f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:47.692939 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7941e968-39e2-424f-976b-ffca4fbd399f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:47.699563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7941e968-39e2-424f-976b-ffca4fbd399f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:47.700073 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7941e968-39e2-424f-976b-ffca4fbd399f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:47.701573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7941e968-39e2-424f-976b-ffca4fbd399f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:47.702011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7941e968-39e2-424f-976b-ffca4fbd399f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:47.763709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7941e968-39e2-424f-976b-ffca4fbd399f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:47.771130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7941e968-39e2-424f-976b-ffca4fbd399f tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.082615 Apr 07 13:01:47.771680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 401/773] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:47 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:47.776095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-15ac29d9-0445-414b-b2c4-a3b53dea3c23 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:47.777008 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-15ac29d9-0445-414b-b2c4-a3b53dea3c23 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:47.783389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15ac29d9-0445-414b-b2c4-a3b53dea3c23 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:47.783841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15ac29d9-0445-414b-b2c4-a3b53dea3c23 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:47.784628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15ac29d9-0445-414b-b2c4-a3b53dea3c23 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:47.785062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15ac29d9-0445-414b-b2c4-a3b53dea3c23 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:47.812818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-15ac29d9-0445-414b-b2c4-a3b53dea3c23 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040135 Apr 07 13:01:47.813355 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 402/774] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:47 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:48.788126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3ee8bf41-4cbd-496d-9c83-cca4f263dcb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:48.788812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3ee8bf41-4cbd-496d-9c83-cca4f263dcb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:48.795668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3ee8bf41-4cbd-496d-9c83-cca4f263dcb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:48.796121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3ee8bf41-4cbd-496d-9c83-cca4f263dcb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:48.796915 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3ee8bf41-4cbd-496d-9c83-cca4f263dcb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:48.797353 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3ee8bf41-4cbd-496d-9c83-cca4f263dcb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:48.854981 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3ee8bf41-4cbd-496d-9c83-cca4f263dcb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:48.862811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3ee8bf41-4cbd-496d-9c83-cca4f263dcb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078463 Apr 07 13:01:48.863371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 403/775] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:48 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:48.867850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-33bbb582-bace-4fba-b83e-3f0d0d41effe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:48.868773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-33bbb582-bace-4fba-b83e-3f0d0d41effe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:48.874878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33bbb582-bace-4fba-b83e-3f0d0d41effe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:48.875326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33bbb582-bace-4fba-b83e-3f0d0d41effe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:48.876084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33bbb582-bace-4fba-b83e-3f0d0d41effe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:48.876547 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33bbb582-bace-4fba-b83e-3f0d0d41effe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:48.905952 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-33bbb582-bace-4fba-b83e-3f0d0d41effe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041591 Apr 07 13:01:48.906492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 404/776] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:48 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:49.878690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-069143c2-32ef-453e-b781-56c739b924fb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:49.879298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-069143c2-32ef-453e-b781-56c739b924fb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:49.885641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-069143c2-32ef-453e-b781-56c739b924fb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:49.886092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-069143c2-32ef-453e-b781-56c739b924fb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:49.886854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-069143c2-32ef-453e-b781-56c739b924fb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:49.887295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-069143c2-32ef-453e-b781-56c739b924fb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:49.946684 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-069143c2-32ef-453e-b781-56c739b924fb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:49.954785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-069143c2-32ef-453e-b781-56c739b924fb tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.079897 Apr 07 13:01:49.955344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 405/777] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:49 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:49.959785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0dc2cd55-0f3d-448e-9e30-9e0913ef1356 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:49.960723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0dc2cd55-0f3d-448e-9e30-9e0913ef1356 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:49.966280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0dc2cd55-0f3d-448e-9e30-9e0913ef1356 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:49.966733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0dc2cd55-0f3d-448e-9e30-9e0913ef1356 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:49.967503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0dc2cd55-0f3d-448e-9e30-9e0913ef1356 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:49.967942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0dc2cd55-0f3d-448e-9e30-9e0913ef1356 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:49.994715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0dc2cd55-0f3d-448e-9e30-9e0913ef1356 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038403 Apr 07 13:01:49.995253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 406/778] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:49 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:50.971997 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cdcb8556-1bbc-45d3-9eda-9baf3c764ab5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:50.972658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cdcb8556-1bbc-45d3-9eda-9baf3c764ab5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:50.978831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cdcb8556-1bbc-45d3-9eda-9baf3c764ab5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:50.979274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cdcb8556-1bbc-45d3-9eda-9baf3c764ab5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:50.980022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cdcb8556-1bbc-45d3-9eda-9baf3c764ab5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:50.980482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cdcb8556-1bbc-45d3-9eda-9baf3c764ab5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:51.038800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cdcb8556-1bbc-45d3-9eda-9baf3c764ab5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:51.046668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cdcb8556-1bbc-45d3-9eda-9baf3c764ab5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078433 Apr 07 13:01:51.047222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 407/779] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:50 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:51.051690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e66a6567-16bc-4508-8327-f7a50a37be3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:51.052650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e66a6567-16bc-4508-8327-f7a50a37be3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:51.058044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e66a6567-16bc-4508-8327-f7a50a37be3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:51.058495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e66a6567-16bc-4508-8327-f7a50a37be3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:51.059241 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e66a6567-16bc-4508-8327-f7a50a37be3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:51.059798 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e66a6567-16bc-4508-8327-f7a50a37be3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:51.087168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e66a6567-16bc-4508-8327-f7a50a37be3b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038985 Apr 07 13:01:51.087699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 408/780] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:51 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:52.065107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8ed9e71a-1980-46e9-ba4a-cabc8b8289ff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:52.065703 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8ed9e71a-1980-46e9-ba4a-cabc8b8289ff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:52.071566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ed9e71a-1980-46e9-ba4a-cabc8b8289ff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:52.072015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ed9e71a-1980-46e9-ba4a-cabc8b8289ff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:52.072805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ed9e71a-1980-46e9-ba4a-cabc8b8289ff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:52.073238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ed9e71a-1980-46e9-ba4a-cabc8b8289ff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:52.131631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8ed9e71a-1980-46e9-ba4a-cabc8b8289ff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:52.138940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8ed9e71a-1980-46e9-ba4a-cabc8b8289ff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.077660 Apr 07 13:01:52.139500 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 409/781] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:52 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:52.143993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ea607195-c612-4dc0-9087-4dc944dba3f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:52.144924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ea607195-c612-4dc0-9087-4dc944dba3f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:52.150532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea607195-c612-4dc0-9087-4dc944dba3f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:52.150986 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea607195-c612-4dc0-9087-4dc944dba3f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:52.151810 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea607195-c612-4dc0-9087-4dc944dba3f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:52.152283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea607195-c612-4dc0-9087-4dc944dba3f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:52.180481 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ea607195-c612-4dc0-9087-4dc944dba3f1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039963 Apr 07 13:01:52.181027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 410/782] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:52 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:53.155024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-11238330-2765-4a69-8dc8-422f67c51fe7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:53.155678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-11238330-2765-4a69-8dc8-422f67c51fe7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:53.161929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11238330-2765-4a69-8dc8-422f67c51fe7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:53.162381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11238330-2765-4a69-8dc8-422f67c51fe7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:53.163142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11238330-2765-4a69-8dc8-422f67c51fe7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:53.163582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11238330-2765-4a69-8dc8-422f67c51fe7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:53.221353 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-11238330-2765-4a69-8dc8-422f67c51fe7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:53.229201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-11238330-2765-4a69-8dc8-422f67c51fe7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078234 Apr 07 13:01:53.229759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 411/783] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:53 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:53.234385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2f23cf4d-9c3f-41e1-ae05-d4eadf582d79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:53.235289 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2f23cf4d-9c3f-41e1-ae05-d4eadf582d79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:53.241084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f23cf4d-9c3f-41e1-ae05-d4eadf582d79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:53.241560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f23cf4d-9c3f-41e1-ae05-d4eadf582d79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:53.242320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f23cf4d-9c3f-41e1-ae05-d4eadf582d79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:53.242754 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f23cf4d-9c3f-41e1-ae05-d4eadf582d79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:53.271074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2f23cf4d-9c3f-41e1-ae05-d4eadf582d79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040346 Apr 07 13:01:53.271634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 412/784] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:53 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:54.245329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-da572d1e-3e0a-4ba1-adaa-614ffa6d3e53 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:54.246082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-da572d1e-3e0a-4ba1-adaa-614ffa6d3e53 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:54.252822 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da572d1e-3e0a-4ba1-adaa-614ffa6d3e53 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:54.253274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da572d1e-3e0a-4ba1-adaa-614ffa6d3e53 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:54.254053 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da572d1e-3e0a-4ba1-adaa-614ffa6d3e53 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:54.254495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da572d1e-3e0a-4ba1-adaa-614ffa6d3e53 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:54.315753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-da572d1e-3e0a-4ba1-adaa-614ffa6d3e53 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:54.322982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-da572d1e-3e0a-4ba1-adaa-614ffa6d3e53 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.081480 Apr 07 13:01:54.323533 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 413/785] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:54 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:54.328202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0776ca05-0b00-4053-a1c4-62067dc75077 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:54.329170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0776ca05-0b00-4053-a1c4-62067dc75077 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:54.334578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0776ca05-0b00-4053-a1c4-62067dc75077 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:54.335027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0776ca05-0b00-4053-a1c4-62067dc75077 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:54.335784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0776ca05-0b00-4053-a1c4-62067dc75077 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:54.336248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0776ca05-0b00-4053-a1c4-62067dc75077 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:54.364818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0776ca05-0b00-4053-a1c4-62067dc75077 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040308 Apr 07 13:01:54.365391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 414/786] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:54 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:55.338732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-672ef01d-4117-4186-b3be-f6793666ceb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:55.339409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-672ef01d-4117-4186-b3be-f6793666ceb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:55.345426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-672ef01d-4117-4186-b3be-f6793666ceb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:55.345877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-672ef01d-4117-4186-b3be-f6793666ceb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:55.346646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-672ef01d-4117-4186-b3be-f6793666ceb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:55.347080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-672ef01d-4117-4186-b3be-f6793666ceb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:55.407209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-672ef01d-4117-4186-b3be-f6793666ceb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:55.414445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-672ef01d-4117-4186-b3be-f6793666ceb4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.079523 Apr 07 13:01:55.415002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 415/787] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:55 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:55.419492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-63489326-534e-4402-9349-06acfacce252 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:55.421083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-63489326-534e-4402-9349-06acfacce252 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:55.426621 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63489326-534e-4402-9349-06acfacce252 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:55.427064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63489326-534e-4402-9349-06acfacce252 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:55.427828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63489326-534e-4402-9349-06acfacce252 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:55.428293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63489326-534e-4402-9349-06acfacce252 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:55.458862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-63489326-534e-4402-9349-06acfacce252 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042782 Apr 07 13:01:55.459429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 416/788] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:55 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:56.430937 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ccc9e41a-e21a-426b-8dff-551bb978269c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:56.431542 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ccc9e41a-e21a-426b-8dff-551bb978269c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:56.437905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ccc9e41a-e21a-426b-8dff-551bb978269c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:56.438350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ccc9e41a-e21a-426b-8dff-551bb978269c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:56.439106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ccc9e41a-e21a-426b-8dff-551bb978269c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:56.439540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ccc9e41a-e21a-426b-8dff-551bb978269c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:56.499701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ccc9e41a-e21a-426b-8dff-551bb978269c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:56.507316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ccc9e41a-e21a-426b-8dff-551bb978269c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.080093 Apr 07 13:01:56.507905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 417/789] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:56 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:56.512739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cdf01c86-5c67-4e28-b2f2-a0eaf7002469 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:56.514495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cdf01c86-5c67-4e28-b2f2-a0eaf7002469 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:56.523935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cdf01c86-5c67-4e28-b2f2-a0eaf7002469 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:56.524429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cdf01c86-5c67-4e28-b2f2-a0eaf7002469 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:56.525247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cdf01c86-5c67-4e28-b2f2-a0eaf7002469 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:56.525685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cdf01c86-5c67-4e28-b2f2-a0eaf7002469 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:56.558059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cdf01c86-5c67-4e28-b2f2-a0eaf7002469 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049021 Apr 07 13:01:56.558542 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 418/790] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:56 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:57.524428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-81f32de8-e85b-4758-ad81-00c8f50a9256 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:57.525101 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-81f32de8-e85b-4758-ad81-00c8f50a9256 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:57.532242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-81f32de8-e85b-4758-ad81-00c8f50a9256 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:57.532690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-81f32de8-e85b-4758-ad81-00c8f50a9256 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:57.533445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-81f32de8-e85b-4758-ad81-00c8f50a9256 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:57.533878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-81f32de8-e85b-4758-ad81-00c8f50a9256 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:57.591273 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-81f32de8-e85b-4758-ad81-00c8f50a9256 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:57.599233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-81f32de8-e85b-4758-ad81-00c8f50a9256 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078649 Apr 07 13:01:57.599794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 419/791] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:57 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:57.604272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e7565800-d1ad-4813-9c36-b3f0be14b5be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:57.605172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e7565800-d1ad-4813-9c36-b3f0be14b5be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:57.611693 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e7565800-d1ad-4813-9c36-b3f0be14b5be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:57.612178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e7565800-d1ad-4813-9c36-b3f0be14b5be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:57.612939 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e7565800-d1ad-4813-9c36-b3f0be14b5be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:57.613368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e7565800-d1ad-4813-9c36-b3f0be14b5be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:57.640218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e7565800-d1ad-4813-9c36-b3f0be14b5be tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039392 Apr 07 13:01:57.640730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 420/792] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:57 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:58.616422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ec339527-9a22-4e3b-aad3-021af11daffc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:58.617028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ec339527-9a22-4e3b-aad3-021af11daffc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:58.623364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ec339527-9a22-4e3b-aad3-021af11daffc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:58.624006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ec339527-9a22-4e3b-aad3-021af11daffc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:58.624805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ec339527-9a22-4e3b-aad3-021af11daffc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:58.625248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ec339527-9a22-4e3b-aad3-021af11daffc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:58.683487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ec339527-9a22-4e3b-aad3-021af11daffc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:58.690756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ec339527-9a22-4e3b-aad3-021af11daffc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078214 Apr 07 13:01:58.691313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 421/793] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:58 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:58.695749 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d0d38504-4f3a-4980-87b0-891a68087e76 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:58.696675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d0d38504-4f3a-4980-87b0-891a68087e76 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:58.702762 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0d38504-4f3a-4980-87b0-891a68087e76 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:58.703215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0d38504-4f3a-4980-87b0-891a68087e76 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:58.703978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0d38504-4f3a-4980-87b0-891a68087e76 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:58.704518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0d38504-4f3a-4980-87b0-891a68087e76 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:58.734239 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d0d38504-4f3a-4980-87b0-891a68087e76 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041914 Apr 07 13:01:58.734799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 422/794] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:58 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:01:59.707926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1ed259b1-3440-4c50-bc3c-7309d237c1b6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:59.708624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1ed259b1-3440-4c50-bc3c-7309d237c1b6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:59.714821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ed259b1-3440-4c50-bc3c-7309d237c1b6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:59.715271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ed259b1-3440-4c50-bc3c-7309d237c1b6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:59.716026 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ed259b1-3440-4c50-bc3c-7309d237c1b6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:59.716545 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ed259b1-3440-4c50-bc3c-7309d237c1b6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:59.778419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1ed259b1-3440-4c50-bc3c-7309d237c1b6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:01:59.785999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1ed259b1-3440-4c50-bc3c-7309d237c1b6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.081900 Apr 07 13:01:59.786565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 423/795] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:01:59 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:01:59.791069 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-47247165-6b1f-4a22-bb2b-aa9231f05fe2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:01:59.791979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-47247165-6b1f-4a22-bb2b-aa9231f05fe2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:01:59.797621 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-47247165-6b1f-4a22-bb2b-aa9231f05fe2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:59.798072 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-47247165-6b1f-4a22-bb2b-aa9231f05fe2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:59.798841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-47247165-6b1f-4a22-bb2b-aa9231f05fe2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:01:59.799274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-47247165-6b1f-4a22-bb2b-aa9231f05fe2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:01:59.827326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-47247165-6b1f-4a22-bb2b-aa9231f05fe2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039770 Apr 07 13:01:59.827883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 424/796] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:01:59 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:00.802763 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-15421f91-379c-4d1f-ae83-0facb679eb02 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:00.803437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-15421f91-379c-4d1f-ae83-0facb679eb02 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:00.809626 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15421f91-379c-4d1f-ae83-0facb679eb02 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:00.810077 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15421f91-379c-4d1f-ae83-0facb679eb02 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:00.811082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15421f91-379c-4d1f-ae83-0facb679eb02 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:00.817624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15421f91-379c-4d1f-ae83-0facb679eb02 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:00.883109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-15421f91-379c-4d1f-ae83-0facb679eb02 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:00.890948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-15421f91-379c-4d1f-ae83-0facb679eb02 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.092166 Apr 07 13:02:00.891528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 425/797] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:00 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:00.896168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-258fa664-23d1-4bf9-a33a-4a8dac3edc36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:00.897057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-258fa664-23d1-4bf9-a33a-4a8dac3edc36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:00.902444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-258fa664-23d1-4bf9-a33a-4a8dac3edc36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:00.902895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-258fa664-23d1-4bf9-a33a-4a8dac3edc36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:00.903648 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-258fa664-23d1-4bf9-a33a-4a8dac3edc36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:00.904973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-258fa664-23d1-4bf9-a33a-4a8dac3edc36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:00.931764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-258fa664-23d1-4bf9-a33a-4a8dac3edc36 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039190 Apr 07 13:02:00.932341 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 426/798] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:00 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:01.907536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5b429f77-a11f-419b-98e5-f6514370f7fd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:01.908170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5b429f77-a11f-419b-98e5-f6514370f7fd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:01.914429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b429f77-a11f-419b-98e5-f6514370f7fd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:01.914879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b429f77-a11f-419b-98e5-f6514370f7fd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:01.915666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b429f77-a11f-419b-98e5-f6514370f7fd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:01.916103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b429f77-a11f-419b-98e5-f6514370f7fd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:01.973692 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5b429f77-a11f-419b-98e5-f6514370f7fd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:01.980999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5b429f77-a11f-419b-98e5-f6514370f7fd tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078174 Apr 07 13:02:01.981560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 427/799] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:01 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:02:01.986789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-55190586-bcef-4eb5-ab92-c1c1c5ec6f9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:01.987690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-55190586-bcef-4eb5-ab92-c1c1c5ec6f9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:01.993113 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55190586-bcef-4eb5-ab92-c1c1c5ec6f9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:01.993556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55190586-bcef-4eb5-ab92-c1c1c5ec6f9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:01.994309 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55190586-bcef-4eb5-ab92-c1c1c5ec6f9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:01.994742 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55190586-bcef-4eb5-ab92-c1c1c5ec6f9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:02.021803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-55190586-bcef-4eb5-ab92-c1c1c5ec6f9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038664 Apr 07 13:02:02.022337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 428/800] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:01 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:02.998019 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6a1fc667-3a90-48a7-9c67-e87ef850c94b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:02.998924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6a1fc667-3a90-48a7-9c67-e87ef850c94b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:03.005518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a1fc667-3a90-48a7-9c67-e87ef850c94b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:03.005966 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a1fc667-3a90-48a7-9c67-e87ef850c94b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:03.006725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a1fc667-3a90-48a7-9c67-e87ef850c94b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:03.007153 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a1fc667-3a90-48a7-9c67-e87ef850c94b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:03.065117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6a1fc667-3a90-48a7-9c67-e87ef850c94b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:03.072333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6a1fc667-3a90-48a7-9c67-e87ef850c94b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078071 Apr 07 13:02:03.072886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 429/801] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:02 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:03.077967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e16939af-031f-444b-8069-11344f068920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:03.078857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e16939af-031f-444b-8069-11344f068920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:03.084523 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e16939af-031f-444b-8069-11344f068920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:03.084972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e16939af-031f-444b-8069-11344f068920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:03.085737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e16939af-031f-444b-8069-11344f068920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:03.086170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e16939af-031f-444b-8069-11344f068920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:03.115332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e16939af-031f-444b-8069-11344f068920 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041474 Apr 07 13:02:03.115870 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 430/802] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:03 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:04.089468 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-12f14cab-34d3-4f5e-b670-dfe865c595f8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:04.090118 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-12f14cab-34d3-4f5e-b670-dfe865c595f8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:04.096279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-12f14cab-34d3-4f5e-b670-dfe865c595f8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:04.096730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-12f14cab-34d3-4f5e-b670-dfe865c595f8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:04.097484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-12f14cab-34d3-4f5e-b670-dfe865c595f8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:04.097914 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-12f14cab-34d3-4f5e-b670-dfe865c595f8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:04.157631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-12f14cab-34d3-4f5e-b670-dfe865c595f8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:04.164836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-12f14cab-34d3-4f5e-b670-dfe865c595f8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.079304 Apr 07 13:02:04.165384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 431/803] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:04 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:04.170957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3e365955-ff04-435d-8c2f-4dba82313b53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:04.171856 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3e365955-ff04-435d-8c2f-4dba82313b53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:04.177285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3e365955-ff04-435d-8c2f-4dba82313b53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:04.177729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3e365955-ff04-435d-8c2f-4dba82313b53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:04.178482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3e365955-ff04-435d-8c2f-4dba82313b53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:04.178911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3e365955-ff04-435d-8c2f-4dba82313b53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:04.206610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3e365955-ff04-435d-8c2f-4dba82313b53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040262 Apr 07 13:02:04.207146 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 432/804] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:04 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:05.181892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bc370ffd-d769-4773-9c9c-a30d2f978bc5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:05.182562 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bc370ffd-d769-4773-9c9c-a30d2f978bc5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:05.188918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc370ffd-d769-4773-9c9c-a30d2f978bc5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:05.189369 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc370ffd-d769-4773-9c9c-a30d2f978bc5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:05.190133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc370ffd-d769-4773-9c9c-a30d2f978bc5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:05.190573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc370ffd-d769-4773-9c9c-a30d2f978bc5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:05.249100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bc370ffd-d769-4773-9c9c-a30d2f978bc5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:05.256314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bc370ffd-d769-4773-9c9c-a30d2f978bc5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078188 Apr 07 13:02:05.256863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 433/805] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:05 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:05.261260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a9c013b5-0a65-448d-8acb-2e98fece0323 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:05.262155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a9c013b5-0a65-448d-8acb-2e98fece0323 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:05.268480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9c013b5-0a65-448d-8acb-2e98fece0323 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:05.268935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9c013b5-0a65-448d-8acb-2e98fece0323 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:05.269695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9c013b5-0a65-448d-8acb-2e98fece0323 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:05.270128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9c013b5-0a65-448d-8acb-2e98fece0323 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:05.298264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a9c013b5-0a65-448d-8acb-2e98fece0323 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040417 Apr 07 13:02:05.298846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 434/806] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:05 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:06.273549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5e3b3a73-7eb5-4a13-ba00-975df3e07a63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:06.274238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5e3b3a73-7eb5-4a13-ba00-975df3e07a63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:06.281401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e3b3a73-7eb5-4a13-ba00-975df3e07a63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:06.281877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e3b3a73-7eb5-4a13-ba00-975df3e07a63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:06.282723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e3b3a73-7eb5-4a13-ba00-975df3e07a63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:06.283090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e3b3a73-7eb5-4a13-ba00-975df3e07a63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:06.344443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5e3b3a73-7eb5-4a13-ba00-975df3e07a63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:06.351822 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5e3b3a73-7eb5-4a13-ba00-975df3e07a63 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.082064 Apr 07 13:02:06.352412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 435/807] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:06 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:02:06.357039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9e01d4cb-841e-4ad4-880a-50168f70a564 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:06.357916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9e01d4cb-841e-4ad4-880a-50168f70a564 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:06.363385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e01d4cb-841e-4ad4-880a-50168f70a564 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:06.363842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e01d4cb-841e-4ad4-880a-50168f70a564 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:06.364640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e01d4cb-841e-4ad4-880a-50168f70a564 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:06.365078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e01d4cb-841e-4ad4-880a-50168f70a564 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:06.392791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9e01d4cb-841e-4ad4-880a-50168f70a564 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039399 Apr 07 13:02:06.393333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 436/808] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:06 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:07.368884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fdcbc4d7-41ec-476c-a078-40cc5515ff31 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:07.369576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fdcbc4d7-41ec-476c-a078-40cc5515ff31 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:07.376232 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fdcbc4d7-41ec-476c-a078-40cc5515ff31 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:07.376688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fdcbc4d7-41ec-476c-a078-40cc5515ff31 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:07.377447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fdcbc4d7-41ec-476c-a078-40cc5515ff31 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:07.377884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fdcbc4d7-41ec-476c-a078-40cc5515ff31 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:07.435526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fdcbc4d7-41ec-476c-a078-40cc5515ff31 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:07.442841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fdcbc4d7-41ec-476c-a078-40cc5515ff31 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.077770 Apr 07 13:02:07.443401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 437/809] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:07 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:07.447905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-dfb3356d-55f1-46cf-b99d-f0d38913b66d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:07.448830 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-dfb3356d-55f1-46cf-b99d-f0d38913b66d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:07.455065 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dfb3356d-55f1-46cf-b99d-f0d38913b66d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:07.455514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dfb3356d-55f1-46cf-b99d-f0d38913b66d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:07.456309 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dfb3356d-55f1-46cf-b99d-f0d38913b66d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:07.456744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dfb3356d-55f1-46cf-b99d-f0d38913b66d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:07.498004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-dfb3356d-55f1-46cf-b99d-f0d38913b66d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053073 Apr 07 13:02:07.498634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 438/810] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:07 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:08.460926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0938aa57-c521-41ff-b921-d7bc48f08f3c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:08.461615 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0938aa57-c521-41ff-b921-d7bc48f08f3c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:08.468411 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0938aa57-c521-41ff-b921-d7bc48f08f3c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:08.468865 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0938aa57-c521-41ff-b921-d7bc48f08f3c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:08.469617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0938aa57-c521-41ff-b921-d7bc48f08f3c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:08.470049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0938aa57-c521-41ff-b921-d7bc48f08f3c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:08.528025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0938aa57-c521-41ff-b921-d7bc48f08f3c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:08.535725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0938aa57-c521-41ff-b921-d7bc48f08f3c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078493 Apr 07 13:02:08.536245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 439/811] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:08 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:08.540649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5406c3c5-24d7-4890-ad83-a1732549d78f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:08.541537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5406c3c5-24d7-4890-ad83-a1732549d78f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:08.547322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5406c3c5-24d7-4890-ad83-a1732549d78f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:08.547767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5406c3c5-24d7-4890-ad83-a1732549d78f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:08.548557 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5406c3c5-24d7-4890-ad83-a1732549d78f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:08.548988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5406c3c5-24d7-4890-ad83-a1732549d78f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:08.576269 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5406c3c5-24d7-4890-ad83-a1732549d78f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039002 Apr 07 13:02:08.576816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 440/812] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:08 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:09.551786 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-79d61cc8-cb7a-4f31-b739-c67e4738c68d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:09.552510 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-79d61cc8-cb7a-4f31-b739-c67e4738c68d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:09.558617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79d61cc8-cb7a-4f31-b739-c67e4738c68d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:09.559063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79d61cc8-cb7a-4f31-b739-c67e4738c68d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:09.559812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79d61cc8-cb7a-4f31-b739-c67e4738c68d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:09.560958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79d61cc8-cb7a-4f31-b739-c67e4738c68d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:09.618863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-79d61cc8-cb7a-4f31-b739-c67e4738c68d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:09.629133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-79d61cc8-cb7a-4f31-b739-c67e4738c68d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.080820 Apr 07 13:02:09.629981 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 441/813] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:09 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:09.634784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-dc36dced-9708-4650-8fee-becbe5acc456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:09.635701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-dc36dced-9708-4650-8fee-becbe5acc456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:09.642450 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dc36dced-9708-4650-8fee-becbe5acc456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:09.642895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dc36dced-9708-4650-8fee-becbe5acc456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:09.643657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dc36dced-9708-4650-8fee-becbe5acc456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:09.644128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dc36dced-9708-4650-8fee-becbe5acc456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:09.671837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-dc36dced-9708-4650-8fee-becbe5acc456 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040619 Apr 07 13:02:09.672409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 442/814] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:09 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:10.646596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-504fe0c8-47b3-4664-a33d-6cd4d12b8211 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:10.647233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-504fe0c8-47b3-4664-a33d-6cd4d12b8211 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:10.653486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-504fe0c8-47b3-4664-a33d-6cd4d12b8211 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:10.654511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-504fe0c8-47b3-4664-a33d-6cd4d12b8211 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:10.655364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-504fe0c8-47b3-4664-a33d-6cd4d12b8211 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:10.655806 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-504fe0c8-47b3-4664-a33d-6cd4d12b8211 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:10.713388 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-504fe0c8-47b3-4664-a33d-6cd4d12b8211 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:10.721722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-504fe0c8-47b3-4664-a33d-6cd4d12b8211 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078927 Apr 07 13:02:10.722287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 443/815] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:10 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:10.726825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-62a99064-a359-4041-85aa-61702cdd6b99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:10.727786 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-62a99064-a359-4041-85aa-61702cdd6b99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:10.733817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62a99064-a359-4041-85aa-61702cdd6b99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:10.734267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62a99064-a359-4041-85aa-61702cdd6b99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:10.735024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62a99064-a359-4041-85aa-61702cdd6b99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:10.735458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62a99064-a359-4041-85aa-61702cdd6b99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:10.762421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-62a99064-a359-4041-85aa-61702cdd6b99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039154 Apr 07 13:02:10.763481 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 444/816] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:10 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:11.012351 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9dadc65a-657b-4a07-a6c7-f75435f659ce tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:11.012834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9dadc65a-657b-4a07-a6c7-f75435f659ce tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:11.019238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9dadc65a-657b-4a07-a6c7-f75435f659ce tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:11.019681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9dadc65a-657b-4a07-a6c7-f75435f659ce tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:11.020466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9dadc65a-657b-4a07-a6c7-f75435f659ce tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:11.020899 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9dadc65a-657b-4a07-a6c7-f75435f659ce tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:11.042442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9dadc65a-657b-4a07-a6c7-f75435f659ce tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad/ips" status: 200 len: 146 microversion: 2.1 time: 0.033873 Apr 07 13:02:11.042982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 445/817] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Apr 7 13:02:11 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad/ips => generated 146 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:02:11.738697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7e1062ba-a8ee-428c-b90b-6c589c55af13 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:11.739359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7e1062ba-a8ee-428c-b90b-6c589c55af13 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:11.745669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7e1062ba-a8ee-428c-b90b-6c589c55af13 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:11.746115 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7e1062ba-a8ee-428c-b90b-6c589c55af13 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:11.746877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7e1062ba-a8ee-428c-b90b-6c589c55af13 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:11.747317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7e1062ba-a8ee-428c-b90b-6c589c55af13 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:11.807511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7e1062ba-a8ee-428c-b90b-6c589c55af13 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:11.815378 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7e1062ba-a8ee-428c-b90b-6c589c55af13 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.080412 Apr 07 13:02:11.816177 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 446/818] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:11 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:11.820760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9c5a3b43-7725-4648-816e-8c08514107bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:11.821715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9c5a3b43-7725-4648-816e-8c08514107bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:11.827713 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c5a3b43-7725-4648-816e-8c08514107bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:11.828186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c5a3b43-7725-4648-816e-8c08514107bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:11.828991 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c5a3b43-7725-4648-816e-8c08514107bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:11.829460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c5a3b43-7725-4648-816e-8c08514107bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:11.868526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9c5a3b43-7725-4648-816e-8c08514107bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051285 Apr 07 13:02:11.869079 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 447/819] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:11 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:12.832389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9098419b-d67c-4876-b6dc-083b065055a8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:12.833081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9098419b-d67c-4876-b6dc-083b065055a8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:12.839185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9098419b-d67c-4876-b6dc-083b065055a8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:12.839631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9098419b-d67c-4876-b6dc-083b065055a8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:12.840414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9098419b-d67c-4876-b6dc-083b065055a8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:12.840849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9098419b-d67c-4876-b6dc-083b065055a8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:12.906281 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9098419b-d67c-4876-b6dc-083b065055a8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:12.913964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9098419b-d67c-4876-b6dc-083b065055a8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.085330 Apr 07 13:02:12.914519 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 448/820] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:12 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:12.918946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a603bc9a-3a8d-4312-b5a4-48b078fd0f09 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:12.919841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a603bc9a-3a8d-4312-b5a4-48b078fd0f09 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:12.926242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a603bc9a-3a8d-4312-b5a4-48b078fd0f09 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:12.926695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a603bc9a-3a8d-4312-b5a4-48b078fd0f09 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:12.927491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a603bc9a-3a8d-4312-b5a4-48b078fd0f09 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:12.927926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a603bc9a-3a8d-4312-b5a4-48b078fd0f09 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:12.956295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a603bc9a-3a8d-4312-b5a4-48b078fd0f09 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040765 Apr 07 13:02:12.956837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 449/821] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:12 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:13.930898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d5147f32-3e4e-4ba7-bbd2-2018f209f6f5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:13.931530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d5147f32-3e4e-4ba7-bbd2-2018f209f6f5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:13.938504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d5147f32-3e4e-4ba7-bbd2-2018f209f6f5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:13.938962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d5147f32-3e4e-4ba7-bbd2-2018f209f6f5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:13.939735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d5147f32-3e4e-4ba7-bbd2-2018f209f6f5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:13.940196 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d5147f32-3e4e-4ba7-bbd2-2018f209f6f5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:13.997404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d5147f32-3e4e-4ba7-bbd2-2018f209f6f5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:14.005209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d5147f32-3e4e-4ba7-bbd2-2018f209f6f5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078189 Apr 07 13:02:14.005774 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 450/822] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:13 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:14.010200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-be3d6d4c-19aa-4017-92e6-10209baadf9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:14.011103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-be3d6d4c-19aa-4017-92e6-10209baadf9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:14.017393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-be3d6d4c-19aa-4017-92e6-10209baadf9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:14.017855 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-be3d6d4c-19aa-4017-92e6-10209baadf9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:14.018637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-be3d6d4c-19aa-4017-92e6-10209baadf9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:14.019061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-be3d6d4c-19aa-4017-92e6-10209baadf9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:14.046297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-be3d6d4c-19aa-4017-92e6-10209baadf9f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039554 Apr 07 13:02:14.046837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 451/823] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:14 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:15.021764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-54ff2fc7-cd48-428a-abb6-880ed8571396 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:15.022406 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-54ff2fc7-cd48-428a-abb6-880ed8571396 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:15.028610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-54ff2fc7-cd48-428a-abb6-880ed8571396 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:15.029967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-54ff2fc7-cd48-428a-abb6-880ed8571396 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:15.030646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-54ff2fc7-cd48-428a-abb6-880ed8571396 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:15.031082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-54ff2fc7-cd48-428a-abb6-880ed8571396 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:15.089136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-54ff2fc7-cd48-428a-abb6-880ed8571396 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:15.096995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-54ff2fc7-cd48-428a-abb6-880ed8571396 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.079061 Apr 07 13:02:15.097549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 452/824] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:15 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:15.101938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9297e85f-a148-4e75-a80b-49f03553d05b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:15.102830 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9297e85f-a148-4e75-a80b-49f03553d05b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:15.108673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9297e85f-a148-4e75-a80b-49f03553d05b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:15.109124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9297e85f-a148-4e75-a80b-49f03553d05b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:15.109944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9297e85f-a148-4e75-a80b-49f03553d05b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:15.110379 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9297e85f-a148-4e75-a80b-49f03553d05b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:15.137428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9297e85f-a148-4e75-a80b-49f03553d05b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038924 Apr 07 13:02:15.137960 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 453/825] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:15 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:16.112934 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-490f0fec-d025-450f-acae-4d908216eeb3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:16.113610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-490f0fec-d025-450f-acae-4d908216eeb3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:16.119712 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-490f0fec-d025-450f-acae-4d908216eeb3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:16.120181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-490f0fec-d025-450f-acae-4d908216eeb3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:16.120936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-490f0fec-d025-450f-acae-4d908216eeb3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:16.121367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-490f0fec-d025-450f-acae-4d908216eeb3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:16.181830 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-490f0fec-d025-450f-acae-4d908216eeb3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:16.189957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-490f0fec-d025-450f-acae-4d908216eeb3 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.080839 Apr 07 13:02:16.190511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 454/826] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:16 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:16.194928 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3083df4f-852d-4775-9b9c-97c5c4c4d281 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:16.195818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3083df4f-852d-4775-9b9c-97c5c4c4d281 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:16.202808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3083df4f-852d-4775-9b9c-97c5c4c4d281 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:16.202808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3083df4f-852d-4775-9b9c-97c5c4c4d281 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:16.203389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3083df4f-852d-4775-9b9c-97c5c4c4d281 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:16.203817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3083df4f-852d-4775-9b9c-97c5c4c4d281 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:16.230387 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3083df4f-852d-4775-9b9c-97c5c4c4d281 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038885 Apr 07 13:02:16.230955 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 455/827] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:16 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:17.207306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-347ed686-db33-4d96-9da0-8b34919c6e24 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:17.207929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-347ed686-db33-4d96-9da0-8b34919c6e24 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:17.214258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-347ed686-db33-4d96-9da0-8b34919c6e24 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:17.214712 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-347ed686-db33-4d96-9da0-8b34919c6e24 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:17.215505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-347ed686-db33-4d96-9da0-8b34919c6e24 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:17.215944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-347ed686-db33-4d96-9da0-8b34919c6e24 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:17.274036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-347ed686-db33-4d96-9da0-8b34919c6e24 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:17.281628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-347ed686-db33-4d96-9da0-8b34919c6e24 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078128 Apr 07 13:02:17.282175 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 456/828] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:17 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:17.286630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d4499b83-47a0-40a3-9079-8a6c997778cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:17.287466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d4499b83-47a0-40a3-9079-8a6c997778cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:17.292825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4499b83-47a0-40a3-9079-8a6c997778cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:17.293259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4499b83-47a0-40a3-9079-8a6c997778cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:17.294008 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4499b83-47a0-40a3-9079-8a6c997778cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:17.294434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4499b83-47a0-40a3-9079-8a6c997778cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:17.322490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d4499b83-47a0-40a3-9079-8a6c997778cb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039339 Apr 07 13:02:17.323031 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 457/829] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:17 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:18.298042 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c7f9f11e-5f6c-4034-a194-9191320653f9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:18.298652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c7f9f11e-5f6c-4034-a194-9191320653f9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:18.304978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c7f9f11e-5f6c-4034-a194-9191320653f9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:18.305429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c7f9f11e-5f6c-4034-a194-9191320653f9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:18.306187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c7f9f11e-5f6c-4034-a194-9191320653f9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:18.306622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c7f9f11e-5f6c-4034-a194-9191320653f9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:18.364935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c7f9f11e-5f6c-4034-a194-9191320653f9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:18.372069 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c7f9f11e-5f6c-4034-a194-9191320653f9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.077870 Apr 07 13:02:18.372655 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 458/830] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:18 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:18.377859 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0be195ad-6812-42ad-814c-b42d7c93c08a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:18.378757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0be195ad-6812-42ad-814c-b42d7c93c08a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:18.384552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0be195ad-6812-42ad-814c-b42d7c93c08a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:18.385024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0be195ad-6812-42ad-814c-b42d7c93c08a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:18.385789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0be195ad-6812-42ad-814c-b42d7c93c08a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:18.386227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0be195ad-6812-42ad-814c-b42d7c93c08a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:18.414383 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0be195ad-6812-42ad-814c-b42d7c93c08a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040207 Apr 07 13:02:18.414935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 459/831] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:18 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:19.389507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8878229e-8638-40a5-82b2-aadcf51a03b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:19.390124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8878229e-8638-40a5-82b2-aadcf51a03b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:19.396418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8878229e-8638-40a5-82b2-aadcf51a03b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:19.396865 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8878229e-8638-40a5-82b2-aadcf51a03b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:19.397616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8878229e-8638-40a5-82b2-aadcf51a03b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:19.398043 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8878229e-8638-40a5-82b2-aadcf51a03b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:19.459773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8878229e-8638-40a5-82b2-aadcf51a03b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:19.467528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8878229e-8638-40a5-82b2-aadcf51a03b8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.082322 Apr 07 13:02:19.468080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 460/832] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:19 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:19.472618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c4868750-6e45-4fae-b2e7-bbc9b964227a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:19.473514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c4868750-6e45-4fae-b2e7-bbc9b964227a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:19.479178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c4868750-6e45-4fae-b2e7-bbc9b964227a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:19.479667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c4868750-6e45-4fae-b2e7-bbc9b964227a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:19.480493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c4868750-6e45-4fae-b2e7-bbc9b964227a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:19.480962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c4868750-6e45-4fae-b2e7-bbc9b964227a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:19.509117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c4868750-6e45-4fae-b2e7-bbc9b964227a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040033 Apr 07 13:02:19.509675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 461/833] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:19 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:20.484323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6f0845a0-fca2-49e6-91ed-4ea7b11532de tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:20.484930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6f0845a0-fca2-49e6-91ed-4ea7b11532de tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:20.491202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f0845a0-fca2-49e6-91ed-4ea7b11532de tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:20.491589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f0845a0-fca2-49e6-91ed-4ea7b11532de tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:20.492458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f0845a0-fca2-49e6-91ed-4ea7b11532de tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:20.492846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f0845a0-fca2-49e6-91ed-4ea7b11532de tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:20.552606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6f0845a0-fca2-49e6-91ed-4ea7b11532de tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:20.559814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6f0845a0-fca2-49e6-91ed-4ea7b11532de tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.079350 Apr 07 13:02:20.569507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 462/834] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:20 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:20.569507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-defedf3e-a45f-4980-ac7d-1a686ebae69b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:20.569507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-defedf3e-a45f-4980-ac7d-1a686ebae69b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:20.571093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-defedf3e-a45f-4980-ac7d-1a686ebae69b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:20.571554 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-defedf3e-a45f-4980-ac7d-1a686ebae69b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:20.572344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-defedf3e-a45f-4980-ac7d-1a686ebae69b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:20.572780 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-defedf3e-a45f-4980-ac7d-1a686ebae69b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:20.751793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-defedf3e-a45f-4980-ac7d-1a686ebae69b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.190302 Apr 07 13:02:20.752434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 463/835] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:20 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:21.575943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ce29e939-ff14-4104-b08d-b3d1e78f4bdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:21.576627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ce29e939-ff14-4104-b08d-b3d1e78f4bdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:21.582888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce29e939-ff14-4104-b08d-b3d1e78f4bdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:21.583344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce29e939-ff14-4104-b08d-b3d1e78f4bdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:21.584108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce29e939-ff14-4104-b08d-b3d1e78f4bdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:21.584573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce29e939-ff14-4104-b08d-b3d1e78f4bdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:21.643717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ce29e939-ff14-4104-b08d-b3d1e78f4bdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:21.651010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ce29e939-ff14-4104-b08d-b3d1e78f4bdc tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078873 Apr 07 13:02:21.651560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 464/836] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:21 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:21.763330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-426e9c5c-7666-42b6-81be-a0197acccdef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:21.765209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-426e9c5c-7666-42b6-81be-a0197acccdef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:21.771026 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-426e9c5c-7666-42b6-81be-a0197acccdef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:21.771472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-426e9c5c-7666-42b6-81be-a0197acccdef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:21.772245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-426e9c5c-7666-42b6-81be-a0197acccdef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:21.772675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-426e9c5c-7666-42b6-81be-a0197acccdef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:21.801488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-426e9c5c-7666-42b6-81be-a0197acccdef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041974 Apr 07 13:02:21.802041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 465/837] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:21 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:02:22.668649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0e6c95e6-b3cb-4cda-b992-a0a6ab1b3483 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:22.669258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0e6c95e6-b3cb-4cda-b992-a0a6ab1b3483 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:22.675654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0e6c95e6-b3cb-4cda-b992-a0a6ab1b3483 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:22.676109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0e6c95e6-b3cb-4cda-b992-a0a6ab1b3483 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:22.676902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0e6c95e6-b3cb-4cda-b992-a0a6ab1b3483 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:22.677347 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0e6c95e6-b3cb-4cda-b992-a0a6ab1b3483 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:22.739903 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0e6c95e6-b3cb-4cda-b992-a0a6ab1b3483 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:22.747164 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0e6c95e6-b3cb-4cda-b992-a0a6ab1b3483 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.082435 Apr 07 13:02:22.747719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 466/838] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:22 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:22.813354 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5f9202f4-5eb2-4dbb-9b11-a2053b9e20d2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:22.815028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5f9202f4-5eb2-4dbb-9b11-a2053b9e20d2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:22.821028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5f9202f4-5eb2-4dbb-9b11-a2053b9e20d2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:22.821507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5f9202f4-5eb2-4dbb-9b11-a2053b9e20d2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:22.822272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5f9202f4-5eb2-4dbb-9b11-a2053b9e20d2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:22.822706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5f9202f4-5eb2-4dbb-9b11-a2053b9e20d2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:22.850098 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5f9202f4-5eb2-4dbb-9b11-a2053b9e20d2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040571 Apr 07 13:02:22.850579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 467/839] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:02:23.766116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0804c7ae-ccdb-4245-8c27-a7d0c8523ee6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:23.766781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0804c7ae-ccdb-4245-8c27-a7d0c8523ee6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:23.772689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0804c7ae-ccdb-4245-8c27-a7d0c8523ee6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:23.773148 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0804c7ae-ccdb-4245-8c27-a7d0c8523ee6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:23.773916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0804c7ae-ccdb-4245-8c27-a7d0c8523ee6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:23.774361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0804c7ae-ccdb-4245-8c27-a7d0c8523ee6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:23.834064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0804c7ae-ccdb-4245-8c27-a7d0c8523ee6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:23.841300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0804c7ae-ccdb-4245-8c27-a7d0c8523ee6 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.080577 Apr 07 13:02:23.842390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 468/840] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:23 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:23.862265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-908444e1-0df5-4b87-aee6-3d4cf9a9f214 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:23.863178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-908444e1-0df5-4b87-aee6-3d4cf9a9f214 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:23.868953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-908444e1-0df5-4b87-aee6-3d4cf9a9f214 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:23.869396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-908444e1-0df5-4b87-aee6-3d4cf9a9f214 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:23.870153 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-908444e1-0df5-4b87-aee6-3d4cf9a9f214 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:23.870580 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-908444e1-0df5-4b87-aee6-3d4cf9a9f214 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:23.898017 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-908444e1-0df5-4b87-aee6-3d4cf9a9f214 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040247 Apr 07 13:02:23.898544 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 469/841] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:23 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 13:02:24.858790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-114e0c22-c97f-4128-9f70-6f88d6dc296e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:24.859627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-114e0c22-c97f-4128-9f70-6f88d6dc296e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:24.866035 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-114e0c22-c97f-4128-9f70-6f88d6dc296e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:24.866489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-114e0c22-c97f-4128-9f70-6f88d6dc296e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:24.867251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-114e0c22-c97f-4128-9f70-6f88d6dc296e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:24.867686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-114e0c22-c97f-4128-9f70-6f88d6dc296e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:24.926084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-114e0c22-c97f-4128-9f70-6f88d6dc296e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:24.933379 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-114e0c22-c97f-4128-9f70-6f88d6dc296e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.079145 Apr 07 13:02:24.933935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 470/842] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:24 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:24.939169 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6c2660aa-22a2-4a3f-828d-0b937ee00c6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:24.940076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6c2660aa-22a2-4a3f-828d-0b937ee00c6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:24.947214 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c2660aa-22a2-4a3f-828d-0b937ee00c6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:24.949277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c2660aa-22a2-4a3f-828d-0b937ee00c6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:24.949277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c2660aa-22a2-4a3f-828d-0b937ee00c6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:24.949850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c2660aa-22a2-4a3f-828d-0b937ee00c6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:24.978739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6c2660aa-22a2-4a3f-828d-0b937ee00c6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043797 Apr 07 13:02:24.979293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 471/843] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:24 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:25.949823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e244a688-ac6d-469c-b52f-8e1ea9715461 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:25.950494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e244a688-ac6d-469c-b52f-8e1ea9715461 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:25.957376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e244a688-ac6d-469c-b52f-8e1ea9715461 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:25.957827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e244a688-ac6d-469c-b52f-8e1ea9715461 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:25.958587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e244a688-ac6d-469c-b52f-8e1ea9715461 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:25.959022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e244a688-ac6d-469c-b52f-8e1ea9715461 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:26.020389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e244a688-ac6d-469c-b52f-8e1ea9715461 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:26.028088 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e244a688-ac6d-469c-b52f-8e1ea9715461 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.082158 Apr 07 13:02:26.028665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 472/844] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:25 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:26.033416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d34a2e5b-ffca-4dcf-a18b-8654790ab42c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:26.034320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d34a2e5b-ffca-4dcf-a18b-8654790ab42c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:26.039726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d34a2e5b-ffca-4dcf-a18b-8654790ab42c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:26.040482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d34a2e5b-ffca-4dcf-a18b-8654790ab42c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:26.041251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d34a2e5b-ffca-4dcf-a18b-8654790ab42c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:26.041692 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d34a2e5b-ffca-4dcf-a18b-8654790ab42c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:26.070174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d34a2e5b-ffca-4dcf-a18b-8654790ab42c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040211 Apr 07 13:02:26.070721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 473/845] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:26 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:27.045089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1b73f753-01e6-4a9a-8258-c869b456f76c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:27.045822 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1b73f753-01e6-4a9a-8258-c869b456f76c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:27.051888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b73f753-01e6-4a9a-8258-c869b456f76c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:27.052377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b73f753-01e6-4a9a-8258-c869b456f76c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:27.053142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b73f753-01e6-4a9a-8258-c869b456f76c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:27.053582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b73f753-01e6-4a9a-8258-c869b456f76c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:27.111121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1b73f753-01e6-4a9a-8258-c869b456f76c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:27.118288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1b73f753-01e6-4a9a-8258-c869b456f76c tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.077054 Apr 07 13:02:27.118854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 474/846] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:27 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:27.123251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6f579cfe-ba44-40cb-97dc-bd0bd7cfa13e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:27.124166 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6f579cfe-ba44-40cb-97dc-bd0bd7cfa13e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:27.129520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f579cfe-ba44-40cb-97dc-bd0bd7cfa13e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:27.129967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f579cfe-ba44-40cb-97dc-bd0bd7cfa13e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:27.130725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f579cfe-ba44-40cb-97dc-bd0bd7cfa13e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:27.131159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f579cfe-ba44-40cb-97dc-bd0bd7cfa13e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:27.159573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6f579cfe-ba44-40cb-97dc-bd0bd7cfa13e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039742 Apr 07 13:02:27.160109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 475/847] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:27 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:28.134990 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d8d184d0-43c5-42d8-b4e1-9633439f1f59 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:28.135663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d8d184d0-43c5-42d8-b4e1-9633439f1f59 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:28.141888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d8d184d0-43c5-42d8-b4e1-9633439f1f59 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:28.142346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d8d184d0-43c5-42d8-b4e1-9633439f1f59 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:28.143145 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d8d184d0-43c5-42d8-b4e1-9633439f1f59 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:28.143583 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d8d184d0-43c5-42d8-b4e1-9633439f1f59 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:28.202400 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d8d184d0-43c5-42d8-b4e1-9633439f1f59 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:28.209680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d8d184d0-43c5-42d8-b4e1-9633439f1f59 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078512 Apr 07 13:02:28.210239 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 476/848] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:28 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:28.214741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f894838f-396b-4baa-b26a-ad689c069721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:28.215644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f894838f-396b-4baa-b26a-ad689c069721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:28.221784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f894838f-396b-4baa-b26a-ad689c069721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:28.222235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f894838f-396b-4baa-b26a-ad689c069721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:28.223002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f894838f-396b-4baa-b26a-ad689c069721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:28.223437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f894838f-396b-4baa-b26a-ad689c069721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:28.251125 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f894838f-396b-4baa-b26a-ad689c069721 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039911 Apr 07 13:02:28.251664 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 477/849] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:28 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:29.226671 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7906c4b9-041e-4146-8f4e-6d744c720fff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:29.227357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7906c4b9-041e-4146-8f4e-6d744c720fff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:29.234383 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7906c4b9-041e-4146-8f4e-6d744c720fff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:29.234838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7906c4b9-041e-4146-8f4e-6d744c720fff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:29.235609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7906c4b9-041e-4146-8f4e-6d744c720fff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:29.236049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7906c4b9-041e-4146-8f4e-6d744c720fff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:29.294149 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7906c4b9-041e-4146-8f4e-6d744c720fff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:29.301584 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7906c4b9-041e-4146-8f4e-6d744c720fff tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078709 Apr 07 13:02:29.302142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 478/850] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:29 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:29.306639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ca73c22d-99ce-40c6-97b4-21d0fde12695 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:29.307534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ca73c22d-99ce-40c6-97b4-21d0fde12695 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:29.312983 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ca73c22d-99ce-40c6-97b4-21d0fde12695 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:29.313435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ca73c22d-99ce-40c6-97b4-21d0fde12695 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:29.314195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ca73c22d-99ce-40c6-97b4-21d0fde12695 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:29.314632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ca73c22d-99ce-40c6-97b4-21d0fde12695 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:29.343624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ca73c22d-99ce-40c6-97b4-21d0fde12695 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040494 Apr 07 13:02:29.344179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 479/851] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:29 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:30.317962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-00fa47c5-8e65-4d4a-91ae-b7804925b182 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:30.318568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-00fa47c5-8e65-4d4a-91ae-b7804925b182 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:30.324921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-00fa47c5-8e65-4d4a-91ae-b7804925b182 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:30.325370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-00fa47c5-8e65-4d4a-91ae-b7804925b182 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:30.326333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-00fa47c5-8e65-4d4a-91ae-b7804925b182 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:30.326775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-00fa47c5-8e65-4d4a-91ae-b7804925b182 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:30.384417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-00fa47c5-8e65-4d4a-91ae-b7804925b182 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:30.391741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-00fa47c5-8e65-4d4a-91ae-b7804925b182 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.077573 Apr 07 13:02:30.392330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 480/852] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:30 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:30.397158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-308b8cc0-866b-4245-96f1-cb7a973fd350 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:30.398068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-308b8cc0-866b-4245-96f1-cb7a973fd350 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:30.403658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-308b8cc0-866b-4245-96f1-cb7a973fd350 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:30.404994 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-308b8cc0-866b-4245-96f1-cb7a973fd350 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:30.405767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-308b8cc0-866b-4245-96f1-cb7a973fd350 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:30.406213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-308b8cc0-866b-4245-96f1-cb7a973fd350 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:30.433994 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-308b8cc0-866b-4245-96f1-cb7a973fd350 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040687 Apr 07 13:02:30.434529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 481/853] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:30 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:31.408414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fce5a8ff-0acc-44bd-8618-8f75558a1dfa tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:31.409089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fce5a8ff-0acc-44bd-8618-8f75558a1dfa tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:31.415508 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fce5a8ff-0acc-44bd-8618-8f75558a1dfa tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:31.415962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fce5a8ff-0acc-44bd-8618-8f75558a1dfa tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:31.416757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fce5a8ff-0acc-44bd-8618-8f75558a1dfa tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:31.417196 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fce5a8ff-0acc-44bd-8618-8f75558a1dfa tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:31.477982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fce5a8ff-0acc-44bd-8618-8f75558a1dfa tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:31.485929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fce5a8ff-0acc-44bd-8618-8f75558a1dfa tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.081354 Apr 07 13:02:31.486483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 482/854] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:31 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:31.490913 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d4237099-2361-4043-af36-28e1b564c185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:31.491807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d4237099-2361-4043-af36-28e1b564c185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:31.497135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4237099-2361-4043-af36-28e1b564c185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:31.497588 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4237099-2361-4043-af36-28e1b564c185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:31.498934 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4237099-2361-4043-af36-28e1b564c185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:31.499364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4237099-2361-4043-af36-28e1b564c185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:31.526461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d4237099-2361-4043-af36-28e1b564c185 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039015 Apr 07 13:02:31.527007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 483/855] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:31 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:32.502185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3faf24c1-cf17-4a7c-96e5-af5fa5090948 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:32.502811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3faf24c1-cf17-4a7c-96e5-af5fa5090948 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:32.509226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3faf24c1-cf17-4a7c-96e5-af5fa5090948 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:32.509683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3faf24c1-cf17-4a7c-96e5-af5fa5090948 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:32.510452 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3faf24c1-cf17-4a7c-96e5-af5fa5090948 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:32.510890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3faf24c1-cf17-4a7c-96e5-af5fa5090948 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:32.571662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3faf24c1-cf17-4a7c-96e5-af5fa5090948 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:32.579635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3faf24c1-cf17-4a7c-96e5-af5fa5090948 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.081252 Apr 07 13:02:32.580217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 484/856] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:32 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:32.584751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c2388b0f-4d4a-4ffe-88b2-7e20643a09a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:32.585657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c2388b0f-4d4a-4ffe-88b2-7e20643a09a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:32.592176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2388b0f-4d4a-4ffe-88b2-7e20643a09a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:32.592648 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2388b0f-4d4a-4ffe-88b2-7e20643a09a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:32.593428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2388b0f-4d4a-4ffe-88b2-7e20643a09a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:32.593871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2388b0f-4d4a-4ffe-88b2-7e20643a09a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:32.621464 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c2388b0f-4d4a-4ffe-88b2-7e20643a09a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040265 Apr 07 13:02:32.622017 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 485/857] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:32 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:33.596777 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-124fdc2c-62ef-4f94-82ba-edc03ba20853 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:33.597371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-124fdc2c-62ef-4f94-82ba-edc03ba20853 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:33.603597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-124fdc2c-62ef-4f94-82ba-edc03ba20853 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:33.604046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-124fdc2c-62ef-4f94-82ba-edc03ba20853 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:33.604834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-124fdc2c-62ef-4f94-82ba-edc03ba20853 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:33.605266 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-124fdc2c-62ef-4f94-82ba-edc03ba20853 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:33.663052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-124fdc2c-62ef-4f94-82ba-edc03ba20853 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:33.671096 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-124fdc2c-62ef-4f94-82ba-edc03ba20853 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078112 Apr 07 13:02:33.671655 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 486/858] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:33 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:02:33.676194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-32c2d91a-ed3c-4970-9be7-4482f52946e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:33.677106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-32c2d91a-ed3c-4970-9be7-4482f52946e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:33.682784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32c2d91a-ed3c-4970-9be7-4482f52946e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:33.683243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32c2d91a-ed3c-4970-9be7-4482f52946e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:33.684013 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32c2d91a-ed3c-4970-9be7-4482f52946e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:33.684502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32c2d91a-ed3c-4970-9be7-4482f52946e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:33.713696 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-32c2d91a-ed3c-4970-9be7-4482f52946e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041034 Apr 07 13:02:33.714242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 487/859] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:33 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:34.687360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5a31c4fe-2b58-4580-806f-2115e71cd1d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:34.687952 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5a31c4fe-2b58-4580-806f-2115e71cd1d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:34.694253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a31c4fe-2b58-4580-806f-2115e71cd1d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:34.694696 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a31c4fe-2b58-4580-806f-2115e71cd1d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:34.695451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a31c4fe-2b58-4580-806f-2115e71cd1d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:34.695883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5a31c4fe-2b58-4580-806f-2115e71cd1d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:34.753766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5a31c4fe-2b58-4580-806f-2115e71cd1d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:02:34.760879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5a31c4fe-2b58-4580-806f-2115e71cd1d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.078163 Apr 07 13:02:34.761427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 488/860] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:02:34 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:02:34.766075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-dee13cd3-367c-4479-9664-20fc3e3a0ae5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:34.766972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-dee13cd3-367c-4479-9664-20fc3e3a0ae5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:34.772716 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dee13cd3-367c-4479-9664-20fc3e3a0ae5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:34.773171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dee13cd3-367c-4479-9664-20fc3e3a0ae5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:34.773997 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dee13cd3-367c-4479-9664-20fc3e3a0ae5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:34.774443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dee13cd3-367c-4479-9664-20fc3e3a0ae5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:34.802434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-dee13cd3-367c-4479-9664-20fc3e3a0ae5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040031 Apr 07 13:02:34.802982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 489/861] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:02:34 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:02:34.880208 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e0f08292-1347-4ccb-ac5c-df144e1dc8a1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:02:34.880704 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e0f08292-1347-4ccb-ac5c-df144e1dc8a1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:02:34.886490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0f08292-1347-4ccb-ac5c-df144e1dc8a1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:34.886946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0f08292-1347-4ccb-ac5c-df144e1dc8a1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:34.887707 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0f08292-1347-4ccb-ac5c-df144e1dc8a1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:02:34.888165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0f08292-1347-4ccb-ac5c-df144e1dc8a1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:02:35.172791 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-06ed853d-bfa6-4dc7-8049-e8e71dbb2c68 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lazy-loading 'services' on Instance uuid 926785df-7955-4e58-a0ae-dc896b2b3f2c {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:02:35.463440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-e0f08292-1347-4ccb-ac5c-df144e1dc8a1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lazy-loading 'services' on Instance uuid 926785df-7955-4e58-a0ae-dc896b2b3f2c {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:03:21.770439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-06ed853d-bfa6-4dc7-8049-e8e71dbb2c68 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c" status: 202 len: 0 microversion: 2.1 time: 106.954353 Apr 07 13:03:21.771345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 373/862] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:01:34 2022] DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c => generated 0 bytes in 106956 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:03:21.777338 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-90925f44-f7ea-4e6d-b821-4735bcd414a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:03:21.777925 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-90925f44-f7ea-4e6d-b821-4735bcd414a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:03:21.784431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90925f44-f7ea-4e6d-b821-4735bcd414a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:03:21.784911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90925f44-f7ea-4e6d-b821-4735bcd414a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:03:21.785691 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90925f44-f7ea-4e6d-b821-4735bcd414a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:03:21.786127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90925f44-f7ea-4e6d-b821-4735bcd414a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:03:21.836613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-e0f08292-1347-4ccb-ac5c-df144e1dc8a1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9ab5962f-edc5-4cc7-94ff-66f3d1f71e71) Apr 07 13:03:21.838061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e0f08292-1347-4ccb-ac5c-df144e1dc8a1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9ab5962f-edc5-4cc7-94ff-66f3d1f71e71) {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:03:21.843699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e0f08292-1347-4ccb-ac5c-df144e1dc8a1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c" status: 400 len: 269 microversion: 2.1 time: 46.967247 Apr 07 13:03:21.844721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 490/863] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:02:34 2022] DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c => generated 269 bytes in 46969 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 07 13:03:21.953924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6ccaf939-0780-4389-a55d-82c48af659e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:03:21.954565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6ccaf939-0780-4389-a55d-82c48af659e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:03:21.961874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6ccaf939-0780-4389-a55d-82c48af659e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:03:21.962330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6ccaf939-0780-4389-a55d-82c48af659e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:03:21.963099 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6ccaf939-0780-4389-a55d-82c48af659e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:03:21.963543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6ccaf939-0780-4389-a55d-82c48af659e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:03:22.021284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6ccaf939-0780-4389-a55d-82c48af659e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:03:22.028390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6ccaf939-0780-4389-a55d-82c48af659e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.182504 Apr 07 13:03:22.029247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 491/864] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:03:21 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:03:22.034372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6f20590e-4330-4f5e-a3a2-08de6c9b5cd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:03:22.035332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6f20590e-4330-4f5e-a3a2-08de6c9b5cd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:03:22.040884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f20590e-4330-4f5e-a3a2-08de6c9b5cd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:03:22.041337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f20590e-4330-4f5e-a3a2-08de6c9b5cd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:03:22.042113 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f20590e-4330-4f5e-a3a2-08de6c9b5cd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:03:22.042550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f20590e-4330-4f5e-a3a2-08de6c9b5cd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:03:22.076085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6f20590e-4330-4f5e-a3a2-08de6c9b5cd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045083 Apr 07 13:03:22.077853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 492/865] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:03:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:03:22.082935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-49a2b5f1-fc3d-4705-bf57-994987713ce6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:03:22.083641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-49a2b5f1-fc3d-4705-bf57-994987713ce6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:03:22.089860 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-49a2b5f1-fc3d-4705-bf57-994987713ce6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:03:22.090375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-49a2b5f1-fc3d-4705-bf57-994987713ce6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:03:22.091404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-49a2b5f1-fc3d-4705-bf57-994987713ce6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:03:22.092112 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-49a2b5f1-fc3d-4705-bf57-994987713ce6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:04:14.292621 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:04:14.293378 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:04:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c (ip 10.222.0.15) !!! Apr 07 13:04:32.567537 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:04:32.568085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:04:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 (ip 10.222.0.15) !!! Apr 07 13:04:33.796032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:04:33.796575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c (ip 10.222.0.15) !!! Apr 07 13:04:34.064082 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:04:34.064659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:04:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 (ip 10.222.0.15) !!! Apr 07 13:04:35.531993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-90925f44-f7ea-4e6d-b821-4735bcd414a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'services' on Instance uuid 1c2c5542-86c5-4fe4-9287-ed9dc322b189 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:04:35.576193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-49a2b5f1-fc3d-4705-bf57-994987713ce6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lazy-loading 'services' on Instance uuid 926785df-7955-4e58-a0ae-dc896b2b3f2c {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:04:36.471356 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:04:36.471542 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:04:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c (ip 10.222.0.15) !!! Apr 07 13:05:22.068944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-90925f44-f7ea-4e6d-b821-4735bcd414a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93" status: 202 len: 0 microversion: 2.1 time: 120.296259 Apr 07 13:05:22.069840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 374/866] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:03:21 2022] DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 => generated 0 bytes in 120298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:05:22.075612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f718f25b-49be-408a-bda9-6291c47bc368 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:05:22.076498 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f718f25b-49be-408a-bda9-6291c47bc368 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:05:22.082730 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f718f25b-49be-408a-bda9-6291c47bc368 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:05:22.083190 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f718f25b-49be-408a-bda9-6291c47bc368 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:05:22.084001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f718f25b-49be-408a-bda9-6291c47bc368 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:05:22.084468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f718f25b-49be-408a-bda9-6291c47bc368 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:05:22.092166 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-49a2b5f1-fc3d-4705-bf57-994987713ce6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33a1f836-9707-4753-aa92-09706ba2b471) Apr 07 13:05:22.092942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-49a2b5f1-fc3d-4705-bf57-994987713ce6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33a1f836-9707-4753-aa92-09706ba2b471) {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:05:22.094647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-49a2b5f1-fc3d-4705-bf57-994987713ce6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c" status: 400 len: 269 microversion: 2.1 time: 120.015431 Apr 07 13:05:22.096261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 493/867] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:03:22 2022] DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c => generated 269 bytes in 120018 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:05:22.103728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d2afb4a7-4dcf-4bc6-bd26-7b0af60b752d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:05:22.105102 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d2afb4a7-4dcf-4bc6-bd26-7b0af60b752d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:05:22.114216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2afb4a7-4dcf-4bc6-bd26-7b0af60b752d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:05:22.114850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2afb4a7-4dcf-4bc6-bd26-7b0af60b752d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:05:22.115829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2afb4a7-4dcf-4bc6-bd26-7b0af60b752d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:05:22.116392 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2afb4a7-4dcf-4bc6-bd26-7b0af60b752d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:05:22.146846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d2afb4a7-4dcf-4bc6-bd26-7b0af60b752d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048712 Apr 07 13:05:22.147626 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 494/868] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:05:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:05:22.153133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a01d8b44-90a8-4837-ab2a-a311594a6b03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:05:22.153712 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a01d8b44-90a8-4837-ab2a-a311594a6b03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:05:22.164872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a01d8b44-90a8-4837-ab2a-a311594a6b03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:05:22.165405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a01d8b44-90a8-4837-ab2a-a311594a6b03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:05:22.166254 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a01d8b44-90a8-4837-ab2a-a311594a6b03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:05:22.166737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f718f25b-49be-408a-bda9-6291c47bc368 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:05:22.166861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a01d8b44-90a8-4837-ab2a-a311594a6b03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:05:22.176690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f718f25b-49be-408a-bda9-6291c47bc368 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.105650 Apr 07 13:05:22.177312 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 375/869] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:05:22 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:05:22.185214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c847c76e-de07-42a5-ad02-af0a3f534c23 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:05:22.185732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c847c76e-de07-42a5-ad02-af0a3f534c23 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:05:22.192558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c847c76e-de07-42a5-ad02-af0a3f534c23 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:05:22.193065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c847c76e-de07-42a5-ad02-af0a3f534c23 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:05:22.193947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c847c76e-de07-42a5-ad02-af0a3f534c23 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:05:22.194400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c847c76e-de07-42a5-ad02-af0a3f534c23 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:06:35.885672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-a01d8b44-90a8-4837-ab2a-a311594a6b03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'services' on Instance uuid 1c2c5542-86c5-4fe4-9287-ed9dc322b189 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:06:35.969561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-c847c76e-de07-42a5-ad02-af0a3f534c23 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lazy-loading 'services' on Instance uuid 926785df-7955-4e58-a0ae-dc896b2b3f2c {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:07:22.259986 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-a01d8b44-90a8-4837-ab2a-a311594a6b03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc464d0b-d73d-42fa-8374-d44d852daf0c) Apr 07 13:07:22.261277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a01d8b44-90a8-4837-ab2a-a311594a6b03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc464d0b-d73d-42fa-8374-d44d852daf0c) {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:07:22.262120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a01d8b44-90a8-4837-ab2a-a311594a6b03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93" status: 400 len: 269 microversion: 2.1 time: 120.113691 Apr 07 13:07:22.262668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 495/870] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:05:22 2022] DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 => generated 269 bytes in 120115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:07:22.268367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-72d0e0e4-ab09-4a60-82a9-815d23b4f4e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:07:22.268973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-72d0e0e4-ab09-4a60-82a9-815d23b4f4e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:07:22.274628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72d0e0e4-ab09-4a60-82a9-815d23b4f4e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:07:22.275087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72d0e0e4-ab09-4a60-82a9-815d23b4f4e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:07:22.275870 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72d0e0e4-ab09-4a60-82a9-815d23b4f4e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:07:22.276332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72d0e0e4-ab09-4a60-82a9-815d23b4f4e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:07:22.294847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-c847c76e-de07-42a5-ad02-af0a3f534c23 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e1c7c2ce-dc0b-4a63-9f46-2a70ff846bc5) Apr 07 13:07:22.295459 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c847c76e-de07-42a5-ad02-af0a3f534c23 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e1c7c2ce-dc0b-4a63-9f46-2a70ff846bc5) {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:07:22.296555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c847c76e-de07-42a5-ad02-af0a3f534c23 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c" status: 400 len: 269 microversion: 2.1 time: 120.115291 Apr 07 13:07:22.297265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 376/871] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:05:22 2022] DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c => generated 269 bytes in 120116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:07:22.303187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fcc1137c-0ca6-42f0-ab18-516300db2c66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:07:22.304224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fcc1137c-0ca6-42f0-ab18-516300db2c66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:07:22.310711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fcc1137c-0ca6-42f0-ab18-516300db2c66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:07:22.311169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fcc1137c-0ca6-42f0-ab18-516300db2c66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:07:22.311980 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fcc1137c-0ca6-42f0-ab18-516300db2c66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:07:22.312461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fcc1137c-0ca6-42f0-ab18-516300db2c66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:07:22.336313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-72d0e0e4-ab09-4a60-82a9-815d23b4f4e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:07:22.342026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fcc1137c-0ca6-42f0-ab18-516300db2c66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043753 Apr 07 13:07:22.342605 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 377/872] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:07:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:07:22.343826 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-72d0e0e4-ab09-4a60-82a9-815d23b4f4e5 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.080212 Apr 07 13:07:22.344414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 496/873] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:07:22 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:07:22.347832 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ae9c3700-92dd-472e-bb02-c0a41ee37ee9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:07:22.348376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ae9c3700-92dd-472e-bb02-c0a41ee37ee9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:07:22.349647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1c49ffd3-9457-4f0e-a817-2bf780b01e2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:07:22.350370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1c49ffd3-9457-4f0e-a817-2bf780b01e2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:07:22.354221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae9c3700-92dd-472e-bb02-c0a41ee37ee9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:07:22.354682 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae9c3700-92dd-472e-bb02-c0a41ee37ee9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:07:22.355649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae9c3700-92dd-472e-bb02-c0a41ee37ee9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:07:22.356106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae9c3700-92dd-472e-bb02-c0a41ee37ee9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:07:22.356268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1c49ffd3-9457-4f0e-a817-2bf780b01e2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:07:22.356615 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1c49ffd3-9457-4f0e-a817-2bf780b01e2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:07:22.357372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1c49ffd3-9457-4f0e-a817-2bf780b01e2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:07:22.357802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1c49ffd3-9457-4f0e-a817-2bf780b01e2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:07:34.301633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:07:34.302376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:07:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c (ip 10.222.0.15) !!! Apr 07 13:07:52.575767 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:07:52.576263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:07:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 (ip 10.222.0.15) !!! Apr 07 13:07:53.804585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:07:53.805057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:07:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c (ip 10.222.0.15) !!! Apr 07 13:07:54.072185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:07:54.072745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:07:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 (ip 10.222.0.15) !!! Apr 07 13:07:56.479488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:07:56.479885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:07:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c (ip 10.222.0.15) !!! Apr 07 13:08:03.382348 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:08:03.382953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:08:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 (ip 10.222.0.15) !!! Apr 07 13:08:36.355775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-ae9c3700-92dd-472e-bb02-c0a41ee37ee9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'services' on Instance uuid 1c2c5542-86c5-4fe4-9287-ed9dc322b189 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:08:36.464676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-1c49ffd3-9457-4f0e-a817-2bf780b01e2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lazy-loading 'services' on Instance uuid 926785df-7955-4e58-a0ae-dc896b2b3f2c {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:09:22.406360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-ae9c3700-92dd-472e-bb02-c0a41ee37ee9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aeef4bf5-3de6-4e4f-9630-4c0402b2bbcf) Apr 07 13:09:22.406983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ae9c3700-92dd-472e-bb02-c0a41ee37ee9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aeef4bf5-3de6-4e4f-9630-4c0402b2bbcf) {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:09:22.408103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ae9c3700-92dd-472e-bb02-c0a41ee37ee9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93" status: 400 len: 269 microversion: 2.1 time: 120.064594 Apr 07 13:09:22.408684 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 378/874] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:07:22 2022] DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 => generated 269 bytes in 120066 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:09:22.441418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-1c49ffd3-9457-4f0e-a817-2bf780b01e2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e41cc4de-e709-4bc6-8e5f-a502734e54db) Apr 07 13:09:22.442029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1c49ffd3-9457-4f0e-a817-2bf780b01e2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e41cc4de-e709-4bc6-8e5f-a502734e54db) {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:09:22.443436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1c49ffd3-9457-4f0e-a817-2bf780b01e2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c" status: 400 len: 269 microversion: 2.1 time: 120.097377 Apr 07 13:09:22.443991 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 497/875] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:07:22 2022] DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c => generated 269 bytes in 120099 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:09:22.449782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8a87de88-10d1-4b9e-b70e-45d2455d678c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:09:22.450786 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8a87de88-10d1-4b9e-b70e-45d2455d678c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:09:22.456669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a87de88-10d1-4b9e-b70e-45d2455d678c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:09:22.457110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a87de88-10d1-4b9e-b70e-45d2455d678c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:09:22.457874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a87de88-10d1-4b9e-b70e-45d2455d678c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:09:22.458864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a87de88-10d1-4b9e-b70e-45d2455d678c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:09:22.489091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8a87de88-10d1-4b9e-b70e-45d2455d678c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042594 Apr 07 13:09:22.489091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 498/876] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:09:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:09:22.493317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-af945116-082d-4a62-b3ce-814103740265 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:09:22.493805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-af945116-082d-4a62-b3ce-814103740265 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:09:22.500833 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-af945116-082d-4a62-b3ce-814103740265 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:09:22.501255 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-af945116-082d-4a62-b3ce-814103740265 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:09:22.502205 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-af945116-082d-4a62-b3ce-814103740265 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:09:22.502649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-af945116-082d-4a62-b3ce-814103740265 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:09:22.521535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fa55351f-cb76-4920-bbea-41cda2313ff9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:09:22.522161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fa55351f-cb76-4920-bbea-41cda2313ff9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:09:22.527954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fa55351f-cb76-4920-bbea-41cda2313ff9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:09:22.528432 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fa55351f-cb76-4920-bbea-41cda2313ff9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:09:22.529412 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fa55351f-cb76-4920-bbea-41cda2313ff9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:09:22.529856 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fa55351f-cb76-4920-bbea-41cda2313ff9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:09:22.591292 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fa55351f-cb76-4920-bbea-41cda2313ff9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:09:22.598798 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fa55351f-cb76-4920-bbea-41cda2313ff9 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.189093 Apr 07 13:09:22.599873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 379/877] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:09:22 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:09:22.604359 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7f44ece7-1593-4f4c-9e24-3e8d6dbfa03e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:09:22.604845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7f44ece7-1593-4f4c-9e24-3e8d6dbfa03e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:09:22.610116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7f44ece7-1593-4f4c-9e24-3e8d6dbfa03e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:09:22.610559 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7f44ece7-1593-4f4c-9e24-3e8d6dbfa03e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:09:22.611312 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7f44ece7-1593-4f4c-9e24-3e8d6dbfa03e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:09:22.611744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7f44ece7-1593-4f4c-9e24-3e8d6dbfa03e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:36.601385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-af945116-082d-4a62-b3ce-814103740265 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'services' on Instance uuid 1c2c5542-86c5-4fe4-9287-ed9dc322b189 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:10:36.642970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-7f44ece7-1593-4f4c-9e24-3e8d6dbfa03e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lazy-loading 'services' on Instance uuid 926785df-7955-4e58-a0ae-dc896b2b3f2c {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:10:36.670675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-af945116-082d-4a62-b3ce-814103740265 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-897ff273-b789-448b-9ce0-a62aa9d974fe) Apr 07 13:10:36.671292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-af945116-082d-4a62-b3ce-814103740265 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-897ff273-b789-448b-9ce0-a62aa9d974fe) {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:10:36.672196 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-af945116-082d-4a62-b3ce-814103740265 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93" status: 400 len: 269 microversion: 2.1 time: 74.182859 Apr 07 13:10:36.672725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:10:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 (ip 10.222.0.15) !!! Apr 07 13:10:36.672725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:10:36 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 (10.222.0.15) Apr 07 13:10:36.673540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: CRITICAL nova [None req-af945116-082d-4a62-b3ce-814103740265 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Unhandled error: OSError: write error Apr 07 13:10:36.673540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: ERROR nova OSError: write error Apr 07 13:10:36.673540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: ERROR nova Apr 07 13:10:36.673836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 499/878] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:09:22 2022] DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 => generated 0 bytes in 74185 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Apr 07 13:10:36.679267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1a71d24b-cf98-4316-9b8f-e211a450534e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:10:36.679885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1a71d24b-cf98-4316-9b8f-e211a450534e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:10:36.685631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a71d24b-cf98-4316-9b8f-e211a450534e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:36.686080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a71d24b-cf98-4316-9b8f-e211a450534e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:36.686847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a71d24b-cf98-4316-9b8f-e211a450534e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:36.687283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a71d24b-cf98-4316-9b8f-e211a450534e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:36.704002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-7f44ece7-1593-4f4c-9e24-3e8d6dbfa03e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6e03a2ba-26ea-4adc-9450-f9caeeb36127) Apr 07 13:10:36.704679 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7f44ece7-1593-4f4c-9e24-3e8d6dbfa03e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6e03a2ba-26ea-4adc-9450-f9caeeb36127) {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:10:36.705590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7f44ece7-1593-4f4c-9e24-3e8d6dbfa03e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c" status: 400 len: 269 microversion: 2.1 time: 74.104779 Apr 07 13:10:36.706161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 380/879] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:09:22 2022] DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c => generated 269 bytes in 74106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:10:36.712228 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dd26024f-e04f-40c4-8159-e0836a03970d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:10:36.713207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dd26024f-e04f-40c4-8159-e0836a03970d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:10:36.719055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd26024f-e04f-40c4-8159-e0836a03970d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:36.719507 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd26024f-e04f-40c4-8159-e0836a03970d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:36.720296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd26024f-e04f-40c4-8159-e0836a03970d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:36.720732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd26024f-e04f-40c4-8159-e0836a03970d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:36.747408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1a71d24b-cf98-4316-9b8f-e211a450534e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:10:36.750191 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dd26024f-e04f-40c4-8159-e0836a03970d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043011 Apr 07 13:10:36.750745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 381/880] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:10:36 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:10:36.755184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-101c56e3-4960-4725-9aa5-3f001a284fa5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:10:36.755323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1a71d24b-cf98-4316-9b8f-e211a450534e tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.080703 Apr 07 13:10:36.756312 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-101c56e3-4960-4725-9aa5-3f001a284fa5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:10:36.756841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 500/881] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:10:36 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:10:36.761762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-101c56e3-4960-4725-9aa5-3f001a284fa5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:36.762208 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-101c56e3-4960-4725-9aa5-3f001a284fa5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:36.762968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-101c56e3-4960-4725-9aa5-3f001a284fa5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:36.763709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-101c56e3-4960-4725-9aa5-3f001a284fa5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:36.826284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-44e77043-cbe1-4ec0-993e-0707a8b7afd1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:10:36.826890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-44e77043-cbe1-4ec0-993e-0707a8b7afd1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:10:36.832940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-44e77043-cbe1-4ec0-993e-0707a8b7afd1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:36.833470 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-44e77043-cbe1-4ec0-993e-0707a8b7afd1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:36.834821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-44e77043-cbe1-4ec0-993e-0707a8b7afd1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:36.835345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-44e77043-cbe1-4ec0-993e-0707a8b7afd1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:36.845567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-101c56e3-4960-4725-9aa5-3f001a284fa5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'services' on Instance uuid 1c2c5542-86c5-4fe4-9287-ed9dc322b189 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:10:36.902215 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-101c56e3-4960-4725-9aa5-3f001a284fa5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2414adcd-2b2e-4d6a-addf-b6dfca82d82e) Apr 07 13:10:36.902834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-101c56e3-4960-4725-9aa5-3f001a284fa5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2414adcd-2b2e-4d6a-addf-b6dfca82d82e) {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:10:36.903686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-101c56e3-4960-4725-9aa5-3f001a284fa5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93" status: 400 len: 269 microversion: 2.1 time: 0.152042 Apr 07 13:10:36.904262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 382/882] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:10:36 2022] DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 => generated 269 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:10:36.909250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1b34a470-a835-47dc-b04c-2bf51e0df63b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:10:36.909762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1b34a470-a835-47dc-b04c-2bf51e0df63b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:10:36.915809 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b34a470-a835-47dc-b04c-2bf51e0df63b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:36.916311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b34a470-a835-47dc-b04c-2bf51e0df63b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:36.917096 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b34a470-a835-47dc-b04c-2bf51e0df63b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:36.917542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b34a470-a835-47dc-b04c-2bf51e0df63b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:36.948727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-44e77043-cbe1-4ec0-993e-0707a8b7afd1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lazy-loading 'services' on Instance uuid 59fbdca4-9e5a-484d-a17d-bfe7f41b4860 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:10:36.997168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-1b34a470-a835-47dc-b04c-2bf51e0df63b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lazy-loading 'services' on Instance uuid 926785df-7955-4e58-a0ae-dc896b2b3f2c {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:10:37.047248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-44e77043-cbe1-4ec0-993e-0707a8b7afd1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments/b6ee47b1-8e86-4db8-a8b0-06dbfac3a118" status: 202 len: 0 microversion: 2.1 time: 0.289135 Apr 07 13:10:37.048005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 501/883] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:10:36 2022] DELETE /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments/b6ee47b1-8e86-4db8-a8b0-06dbfac3a118 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:10:37.053634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8930d9e5-303d-45cd-8c8c-72f60f748bf7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:10:37.054691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8930d9e5-303d-45cd-8c8c-72f60f748bf7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:10:37.060631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8930d9e5-303d-45cd-8c8c-72f60f748bf7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:37.061076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8930d9e5-303d-45cd-8c8c-72f60f748bf7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:37.061832 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8930d9e5-303d-45cd-8c8c-72f60f748bf7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:37.062246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8930d9e5-303d-45cd-8c8c-72f60f748bf7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:37.072857 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-1b34a470-a835-47dc-b04c-2bf51e0df63b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-047996d8-b5e3-4027-8773-ff1a1f0dd491) Apr 07 13:10:37.073549 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1b34a470-a835-47dc-b04c-2bf51e0df63b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-047996d8-b5e3-4027-8773-ff1a1f0dd491) {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:10:37.074493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1b34a470-a835-47dc-b04c-2bf51e0df63b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c" status: 400 len: 269 microversion: 2.1 time: 0.169269 Apr 07 13:10:37.075131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 383/884] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:10:36 2022] DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c => generated 269 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:10:37.079782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-98866808-5f24-43be-a384-15ffa16696d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:10:37.080492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-98866808-5f24-43be-a384-15ffa16696d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:10:37.087283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-98866808-5f24-43be-a384-15ffa16696d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:37.087815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-98866808-5f24-43be-a384-15ffa16696d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:37.088701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-98866808-5f24-43be-a384-15ffa16696d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:37.089222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-98866808-5f24-43be-a384-15ffa16696d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:37.094169 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8930d9e5-303d-45cd-8c8c-72f60f748bf7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045116 Apr 07 13:10:37.095009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 502/885] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:10:37 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:10:37.100990 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ce68b0ba-6d9b-445b-b84c-d977554d7b8d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:10:37.101488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ce68b0ba-6d9b-445b-b84c-d977554d7b8d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:10:37.107747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce68b0ba-6d9b-445b-b84c-d977554d7b8d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:37.108748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce68b0ba-6d9b-445b-b84c-d977554d7b8d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:37.109654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce68b0ba-6d9b-445b-b84c-d977554d7b8d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:37.110121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce68b0ba-6d9b-445b-b84c-d977554d7b8d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:37.159509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-98866808-5f24-43be-a384-15ffa16696d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:10:37.166971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-98866808-5f24-43be-a384-15ffa16696d8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1225 microversion: 2.1 time: 0.090778 Apr 07 13:10:37.167532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 384/886] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:10:37 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:10:37.172076 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f998175e-b123-466d-b752-97443d8161a6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:10:37.172591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f998175e-b123-466d-b752-97443d8161a6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:10:37.178170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f998175e-b123-466d-b752-97443d8161a6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:37.178618 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f998175e-b123-466d-b752-97443d8161a6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:37.179375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f998175e-b123-466d-b752-97443d8161a6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:10:37.179806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f998175e-b123-466d-b752-97443d8161a6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:10:54.310034 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:10:54.310628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:10:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 (ip 10.222.0.15) !!! Apr 07 13:11:12.585214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:11:12.585698 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:11:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments/b6ee47b1-8e86-4db8-a8b0-06dbfac3a118 (ip 10.222.0.15) !!! Apr 07 13:11:13.812624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:11:13.813148 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:11:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 (ip 10.222.0.15) !!! Apr 07 13:11:14.080817 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:11:14.081368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:11:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments/b6ee47b1-8e86-4db8-a8b0-06dbfac3a118 (ip 10.222.0.15) !!! Apr 07 13:11:22.607524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-ce68b0ba-6d9b-445b-b84c-d977554d7b8d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'services' on Instance uuid 1c2c5542-86c5-4fe4-9287-ed9dc322b189 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:22.658982 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-f998175e-b123-466d-b752-97443d8161a6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lazy-loading 'services' on Instance uuid 59fbdca4-9e5a-484d-a17d-bfe7f41b4860 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:22.725560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-ce68b0ba-6d9b-445b-b84c-d977554d7b8d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74e08bf9-1a4f-4861-b8c8-62948af0ffbc) Apr 07 13:11:22.726278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ce68b0ba-6d9b-445b-b84c-d977554d7b8d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74e08bf9-1a4f-4861-b8c8-62948af0ffbc) {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:22.727323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ce68b0ba-6d9b-445b-b84c-d977554d7b8d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93" status: 400 len: 269 microversion: 2.1 time: 45.631291 Apr 07 13:11:22.727967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 503/887] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:10:37 2022] DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 => generated 269 bytes in 45632 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:22.733029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c00e16cd-b662-4be5-8f9e-be334994329b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:22.733521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c00e16cd-b662-4be5-8f9e-be334994329b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:22.739364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c00e16cd-b662-4be5-8f9e-be334994329b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:22.739818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c00e16cd-b662-4be5-8f9e-be334994329b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:22.740657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c00e16cd-b662-4be5-8f9e-be334994329b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:22.741257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c00e16cd-b662-4be5-8f9e-be334994329b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:22.759351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-f998175e-b123-466d-b752-97443d8161a6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1b0f6767-4da6-4284-b84d-7b7806f70ac0) Apr 07 13:11:22.759957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f998175e-b123-466d-b752-97443d8161a6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1b0f6767-4da6-4284-b84d-7b7806f70ac0) {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:22.760832 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f998175e-b123-466d-b752-97443d8161a6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments/b6ee47b1-8e86-4db8-a8b0-06dbfac3a118" status: 400 len: 269 microversion: 2.1 time: 45.592408 Apr 07 13:11:22.761385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 385/888] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:10:37 2022] DELETE /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments/b6ee47b1-8e86-4db8-a8b0-06dbfac3a118 => generated 269 bytes in 45593 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:22.765984 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cb97c7e7-b48a-41f6-826e-be620999306d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:22.766951 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cb97c7e7-b48a-41f6-826e-be620999306d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:22.772882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb97c7e7-b48a-41f6-826e-be620999306d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:22.773334 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb97c7e7-b48a-41f6-826e-be620999306d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:22.774107 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb97c7e7-b48a-41f6-826e-be620999306d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:22.774541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb97c7e7-b48a-41f6-826e-be620999306d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:22.824740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-c00e16cd-b662-4be5-8f9e-be334994329b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lazy-loading 'services' on Instance uuid 926785df-7955-4e58-a0ae-dc896b2b3f2c {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:22.887931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-c00e16cd-b662-4be5-8f9e-be334994329b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6424276-8b5c-4564-b3fe-eced576f05bc) Apr 07 13:11:22.888729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c00e16cd-b662-4be5-8f9e-be334994329b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6424276-8b5c-4564-b3fe-eced576f05bc) {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:22.889813 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c00e16cd-b662-4be5-8f9e-be334994329b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c" status: 400 len: 269 microversion: 2.1 time: 0.160516 Apr 07 13:11:22.890478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 504/889] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:11:22 2022] DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c => generated 269 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:22.895642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5e8cab13-8800-47fe-a875-ff33ac9500c7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:22.896421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5e8cab13-8800-47fe-a875-ff33ac9500c7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:22.906485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e8cab13-8800-47fe-a875-ff33ac9500c7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:22.907128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e8cab13-8800-47fe-a875-ff33ac9500c7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:22.908231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e8cab13-8800-47fe-a875-ff33ac9500c7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:22.908939 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e8cab13-8800-47fe-a875-ff33ac9500c7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:22.949815 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e8cab13-8800-47fe-a875-ff33ac9500c7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:22.950871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e8cab13-8800-47fe-a875-ff33ac9500c7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:22.951572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-5e8cab13-8800-47fe-a875-ff33ac9500c7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lazy-loading 'fault' on Instance uuid cb36ce2a-6233-4601-85c0-35c550476cea {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:22.967187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cb97c7e7-b48a-41f6-826e-be620999306d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.204756 Apr 07 13:11:22.967935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 386/890] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:11:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:11:22.972738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c5192aaa-037f-4c35-9a4c-eeb33ba5d5a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:22.973231 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c5192aaa-037f-4c35-9a4c-eeb33ba5d5a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:22.980193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c5192aaa-037f-4c35-9a4c-eeb33ba5d5a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:22.980653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c5192aaa-037f-4c35-9a4c-eeb33ba5d5a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:22.981432 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c5192aaa-037f-4c35-9a4c-eeb33ba5d5a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:22.981873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c5192aaa-037f-4c35-9a4c-eeb33ba5d5a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:22.999681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5e8cab13-8800-47fe-a875-ff33ac9500c7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14b11cb4c649e6881818075733a5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63deb3be5f546a696dabf7b1a6f3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:11:23.008613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5e8cab13-8800-47fe-a875-ff33ac9500c7 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 200 len: 1230 microversion: 2.1 time: 0.116768 Apr 07 13:11:23.009194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 505/891] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:11:22 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:11:23.014611 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3bd14958-3e72-4efb-8755-9db9b6065f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.015119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3bd14958-3e72-4efb-8755-9db9b6065f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.023784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bd14958-3e72-4efb-8755-9db9b6065f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.024337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bd14958-3e72-4efb-8755-9db9b6065f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.026689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bd14958-3e72-4efb-8755-9db9b6065f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.027861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bd14958-3e72-4efb-8755-9db9b6065f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.068086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-c5192aaa-037f-4c35-9a4c-eeb33ba5d5a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'services' on Instance uuid 1c2c5542-86c5-4fe4-9287-ed9dc322b189 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:23.114317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-3bd14958-3e72-4efb-8755-9db9b6065f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lazy-loading 'services' on Instance uuid 59fbdca4-9e5a-484d-a17d-bfe7f41b4860 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:23.142003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-c5192aaa-037f-4c35-9a4c-eeb33ba5d5a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-07afd387-ab39-4121-acf2-c50c257a4232) Apr 07 13:11:23.142610 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c5192aaa-037f-4c35-9a4c-eeb33ba5d5a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-07afd387-ab39-4121-acf2-c50c257a4232) {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:23.143442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c5192aaa-037f-4c35-9a4c-eeb33ba5d5a4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93" status: 400 len: 269 microversion: 2.1 time: 0.174398 Apr 07 13:11:23.143978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 387/892] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:11:22 2022] DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 => generated 269 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:23.148938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-87216d26-c7dc-4536-b933-732c13d285f6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.149425 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-87216d26-c7dc-4536-b933-732c13d285f6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.155174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-87216d26-c7dc-4536-b933-732c13d285f6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.155621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-87216d26-c7dc-4536-b933-732c13d285f6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.156411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-87216d26-c7dc-4536-b933-732c13d285f6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.156844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-87216d26-c7dc-4536-b933-732c13d285f6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.175217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-3bd14958-3e72-4efb-8755-9db9b6065f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d58a7c89-8f58-41a6-9946-3fa1eb0f3e0c) Apr 07 13:11:23.175853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3bd14958-3e72-4efb-8755-9db9b6065f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d58a7c89-8f58-41a6-9946-3fa1eb0f3e0c) {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:23.176729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3bd14958-3e72-4efb-8755-9db9b6065f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments/b6ee47b1-8e86-4db8-a8b0-06dbfac3a118" status: 400 len: 269 microversion: 2.1 time: 0.166308 Apr 07 13:11:23.177279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 506/893] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:11:23 2022] DELETE /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments/b6ee47b1-8e86-4db8-a8b0-06dbfac3a118 => generated 269 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:23.182060 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c4bb5e76-1292-4aac-b648-eb4dfc3d68c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.182549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c4bb5e76-1292-4aac-b648-eb4dfc3d68c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.188390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c4bb5e76-1292-4aac-b648-eb4dfc3d68c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.188833 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c4bb5e76-1292-4aac-b648-eb4dfc3d68c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.189656 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c4bb5e76-1292-4aac-b648-eb4dfc3d68c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.190089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c4bb5e76-1292-4aac-b648-eb4dfc3d68c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.216815 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c4bb5e76-1292-4aac-b648-eb4dfc3d68c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:11:23.238688 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-87216d26-c7dc-4536-b933-732c13d285f6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lazy-loading 'services' on Instance uuid 926785df-7955-4e58-a0ae-dc896b2b3f2c {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:23.300051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-87216d26-c7dc-4536-b933-732c13d285f6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a1b236b-3d7e-41e6-bf07-de5669cc7f18) Apr 07 13:11:23.300407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c4bb5e76-1292-4aac-b648-eb4dfc3d68c8 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 204 len: 0 microversion: 2.1 time: 0.121881 Apr 07 13:11:23.300727 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-87216d26-c7dc-4536-b933-732c13d285f6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a1b236b-3d7e-41e6-bf07-de5669cc7f18) {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:23.300962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 507/894] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:11:23 2022] DELETE /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:11:23.301562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-87216d26-c7dc-4536-b933-732c13d285f6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c" status: 400 len: 269 microversion: 2.1 time: 0.156672 Apr 07 13:11:23.302253 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 388/895] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:11:23 2022] DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c => generated 269 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:23.306594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ad16277b-bb4b-400f-b692-f32c208fc646 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.306761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-228e5f96-950b-4a23-a2cb-8d31e03f582d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.307393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-228e5f96-950b-4a23-a2cb-8d31e03f582d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.307787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ad16277b-bb4b-400f-b692-f32c208fc646 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.313954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-228e5f96-950b-4a23-a2cb-8d31e03f582d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.314293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ad16277b-bb4b-400f-b692-f32c208fc646 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.314431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-228e5f96-950b-4a23-a2cb-8d31e03f582d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.314753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ad16277b-bb4b-400f-b692-f32c208fc646 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.315099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-228e5f96-950b-4a23-a2cb-8d31e03f582d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.315542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-228e5f96-950b-4a23-a2cb-8d31e03f582d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.315661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ad16277b-bb4b-400f-b692-f32c208fc646 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.316128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ad16277b-bb4b-400f-b692-f32c208fc646 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.329894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-228e5f96-950b-4a23-a2cb-8d31e03f582d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] HTTP exception thrown: Instance cb36ce2a-6233-4601-85c0-35c550476cea could not be found. Apr 07 13:11:23.330493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-228e5f96-950b-4a23-a2cb-8d31e03f582d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Returning 404 to user: Instance cb36ce2a-6233-4601-85c0-35c550476cea could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:23.331506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-228e5f96-950b-4a23-a2cb-8d31e03f582d tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 404 len: 111 microversion: 2.1 time: 0.028507 Apr 07 13:11:23.332051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 389/896] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:11:23 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:11:23.337250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4308b33f-ed9f-4461-887c-b5dc355cb325 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.337749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4308b33f-ed9f-4461-887c-b5dc355cb325 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.343309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4308b33f-ed9f-4461-887c-b5dc355cb325 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.343766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4308b33f-ed9f-4461-887c-b5dc355cb325 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.344573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4308b33f-ed9f-4461-887c-b5dc355cb325 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.345020 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4308b33f-ed9f-4461-887c-b5dc355cb325 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.348124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ad16277b-bb4b-400f-b692-f32c208fc646 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045885 Apr 07 13:11:23.348700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 508/897] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:11:23 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:11:23.353162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-06475cfc-0fe1-4fdb-a88a-a7d00837da04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.353646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-06475cfc-0fe1-4fdb-a88a-a7d00837da04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.358984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-06475cfc-0fe1-4fdb-a88a-a7d00837da04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.359431 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-06475cfc-0fe1-4fdb-a88a-a7d00837da04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.360198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-06475cfc-0fe1-4fdb-a88a-a7d00837da04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.360633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-06475cfc-0fe1-4fdb-a88a-a7d00837da04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.390943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:11:23.391119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:11:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 (ip 10.222.0.15) !!! Apr 07 13:11:23.423163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-4308b33f-ed9f-4461-887c-b5dc355cb325 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'services' on Instance uuid 1c2c5542-86c5-4fe4-9287-ed9dc322b189 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:23.465208 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-06475cfc-0fe1-4fdb-a88a-a7d00837da04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lazy-loading 'services' on Instance uuid 59fbdca4-9e5a-484d-a17d-bfe7f41b4860 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:23.492073 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-4308b33f-ed9f-4461-887c-b5dc355cb325 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f337e305-a463-4193-ab31-0f496986c52f) Apr 07 13:11:23.492776 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4308b33f-ed9f-4461-887c-b5dc355cb325 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f337e305-a463-4193-ab31-0f496986c52f) {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:23.493718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4308b33f-ed9f-4461-887c-b5dc355cb325 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93" status: 400 len: 269 microversion: 2.1 time: 0.160659 Apr 07 13:11:23.494267 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 390/898] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:11:23 2022] DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 => generated 269 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:23.498910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6a05d48c-bfc9-4a74-82f3-c2e324aef254 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.499406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6a05d48c-bfc9-4a74-82f3-c2e324aef254 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.505224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6a05d48c-bfc9-4a74-82f3-c2e324aef254 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.505679 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6a05d48c-bfc9-4a74-82f3-c2e324aef254 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.507170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6a05d48c-bfc9-4a74-82f3-c2e324aef254 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.507609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6a05d48c-bfc9-4a74-82f3-c2e324aef254 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.528446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-06475cfc-0fe1-4fdb-a88a-a7d00837da04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-247ce5c8-f54e-4ac0-b09c-5ffba6b086b4) Apr 07 13:11:23.529081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-06475cfc-0fe1-4fdb-a88a-a7d00837da04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-247ce5c8-f54e-4ac0-b09c-5ffba6b086b4) {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:23.529938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-06475cfc-0fe1-4fdb-a88a-a7d00837da04 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments/b6ee47b1-8e86-4db8-a8b0-06dbfac3a118" status: 400 len: 269 microversion: 2.1 time: 0.180311 Apr 07 13:11:23.530755 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 509/899] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:11:23 2022] DELETE /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments/b6ee47b1-8e86-4db8-a8b0-06dbfac3a118 => generated 269 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:23.535312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f71988c6-9fea-4aaa-b5a9-1425891c0edd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.535803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f71988c6-9fea-4aaa-b5a9-1425891c0edd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.542353 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f71988c6-9fea-4aaa-b5a9-1425891c0edd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.542797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f71988c6-9fea-4aaa-b5a9-1425891c0edd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.543708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f71988c6-9fea-4aaa-b5a9-1425891c0edd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.544164 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f71988c6-9fea-4aaa-b5a9-1425891c0edd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.569311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f71988c6-9fea-4aaa-b5a9-1425891c0edd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:11:23.588772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-6a05d48c-bfc9-4a74-82f3-c2e324aef254 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lazy-loading 'services' on Instance uuid 926785df-7955-4e58-a0ae-dc896b2b3f2c {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:23.617216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.compute.api [None req-f71988c6-9fea-4aaa-b5a9-1425891c0edd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Instance is already in deleting state, ignoring this request Apr 07 13:11:23.618046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f71988c6-9fea-4aaa-b5a9-1425891c0edd tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 204 len: 0 microversion: 2.1 time: 0.086625 Apr 07 13:11:23.618603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 510/900] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:11:23 2022] DELETE /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:11:23.623516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-585feb17-852e-413e-8fdd-086f516f3746 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.624455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-585feb17-852e-413e-8fdd-086f516f3746 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.630211 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-585feb17-852e-413e-8fdd-086f516f3746 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.630635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-585feb17-852e-413e-8fdd-086f516f3746 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.631563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-585feb17-852e-413e-8fdd-086f516f3746 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.632005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-585feb17-852e-413e-8fdd-086f516f3746 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.646482 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-6a05d48c-bfc9-4a74-82f3-c2e324aef254 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0680cc4f-060e-4666-abe3-c69fff9e815e) Apr 07 13:11:23.647666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6a05d48c-bfc9-4a74-82f3-c2e324aef254 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0680cc4f-060e-4666-abe3-c69fff9e815e) {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:23.648567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6a05d48c-bfc9-4a74-82f3-c2e324aef254 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c" status: 400 len: 269 microversion: 2.1 time: 0.153326 Apr 07 13:11:23.649110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 391/901] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:11:23 2022] DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c => generated 269 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:23.653708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e3182b3d-1890-4702-9bf2-6eeccd65c7a4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.654329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e3182b3d-1890-4702-9bf2-6eeccd65c7a4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.660385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e3182b3d-1890-4702-9bf2-6eeccd65c7a4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.660968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-585feb17-852e-413e-8fdd-086f516f3746 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041119 Apr 07 13:11:23.661081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e3182b3d-1890-4702-9bf2-6eeccd65c7a4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.661609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e3182b3d-1890-4702-9bf2-6eeccd65c7a4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.661724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 511/902] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:11:23 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:11:23.662051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e3182b3d-1890-4702-9bf2-6eeccd65c7a4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.666908 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b22234ef-8cc3-49ee-83d0-1773025873cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.667399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b22234ef-8cc3-49ee-83d0-1773025873cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.672837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b22234ef-8cc3-49ee-83d0-1773025873cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.673295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b22234ef-8cc3-49ee-83d0-1773025873cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.674058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b22234ef-8cc3-49ee-83d0-1773025873cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.674498 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b22234ef-8cc3-49ee-83d0-1773025873cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.675780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-e3182b3d-1890-4702-9bf2-6eeccd65c7a4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] HTTP exception thrown: Instance cb36ce2a-6233-4601-85c0-35c550476cea could not be found. Apr 07 13:11:23.676401 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e3182b3d-1890-4702-9bf2-6eeccd65c7a4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Returning 404 to user: Instance cb36ce2a-6233-4601-85c0-35c550476cea could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:23.677226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e3182b3d-1890-4702-9bf2-6eeccd65c7a4 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 404 len: 111 microversion: 2.1 time: 0.027222 Apr 07 13:11:23.677773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 392/903] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:11:23 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:11:23.682628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e79205bc-9260-4abb-969f-6cc5a8cba65b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.683127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e79205bc-9260-4abb-969f-6cc5a8cba65b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.688652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e79205bc-9260-4abb-969f-6cc5a8cba65b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.689111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e79205bc-9260-4abb-969f-6cc5a8cba65b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.689882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e79205bc-9260-4abb-969f-6cc5a8cba65b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.690324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e79205bc-9260-4abb-969f-6cc5a8cba65b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.754923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-b22234ef-8cc3-49ee-83d0-1773025873cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'services' on Instance uuid 1c2c5542-86c5-4fe4-9287-ed9dc322b189 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:23.798811 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-e79205bc-9260-4abb-969f-6cc5a8cba65b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lazy-loading 'services' on Instance uuid 59fbdca4-9e5a-484d-a17d-bfe7f41b4860 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:23.828093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-b22234ef-8cc3-49ee-83d0-1773025873cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5d852b9-0086-4ed6-8935-14758176362f) Apr 07 13:11:23.828817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b22234ef-8cc3-49ee-83d0-1773025873cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5d852b9-0086-4ed6-8935-14758176362f) {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:23.829776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b22234ef-8cc3-49ee-83d0-1773025873cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93" status: 400 len: 269 microversion: 2.1 time: 0.167173 Apr 07 13:11:23.830407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 512/904] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:11:23 2022] DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments/1c376a3d-f46d-4e82-aff9-f7ee5ea10b93 => generated 269 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:23.839734 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3904d00d-6a5a-4cdf-ada7-02c2e16fcf6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.840395 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3904d00d-6a5a-4cdf-ada7-02c2e16fcf6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.846493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3904d00d-6a5a-4cdf-ada7-02c2e16fcf6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.847032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3904d00d-6a5a-4cdf-ada7-02c2e16fcf6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.847890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3904d00d-6a5a-4cdf-ada7-02c2e16fcf6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.848441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3904d00d-6a5a-4cdf-ada7-02c2e16fcf6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.865639 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-e79205bc-9260-4abb-969f-6cc5a8cba65b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6d2dbdd7-1e8c-4a6f-b28c-9f7dc707b425) Apr 07 13:11:23.866392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e79205bc-9260-4abb-969f-6cc5a8cba65b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6d2dbdd7-1e8c-4a6f-b28c-9f7dc707b425) {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:23.867415 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e79205bc-9260-4abb-969f-6cc5a8cba65b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments/b6ee47b1-8e86-4db8-a8b0-06dbfac3a118" status: 400 len: 269 microversion: 2.1 time: 0.188433 Apr 07 13:11:23.867988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 393/905] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:11:23 2022] DELETE /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860/os-volume_attachments/b6ee47b1-8e86-4db8-a8b0-06dbfac3a118 => generated 269 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:23.873223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b5d632f5-4b3b-4874-a997-4e4e2921c629 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.874072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b5d632f5-4b3b-4874-a997-4e4e2921c629 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.883820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5d632f5-4b3b-4874-a997-4e4e2921c629 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.884313 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5d632f5-4b3b-4874-a997-4e4e2921c629 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.885100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5d632f5-4b3b-4874-a997-4e4e2921c629 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.885728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5d632f5-4b3b-4874-a997-4e4e2921c629 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.913632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b5d632f5-4b3b-4874-a997-4e4e2921c629 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Going to try to terminate instance {{(pid=116892) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:11:23.970656 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-3904d00d-6a5a-4cdf-ada7-02c2e16fcf6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lazy-loading 'services' on Instance uuid 926785df-7955-4e58-a0ae-dc896b2b3f2c {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:23.974152 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.compute.api [None req-b5d632f5-4b3b-4874-a997-4e4e2921c629 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Instance is already in deleting state, ignoring this request Apr 07 13:11:23.975719 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b5d632f5-4b3b-4874-a997-4e4e2921c629 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 204 len: 0 microversion: 2.1 time: 0.106632 Apr 07 13:11:23.976473 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 394/906] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:11:23 2022] DELETE /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:11:23.981729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-836f0372-a36b-44de-ae9e-05e563fe7c93 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:23.982338 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-836f0372-a36b-44de-ae9e-05e563fe7c93 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:23.988735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-836f0372-a36b-44de-ae9e-05e563fe7c93 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.989187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-836f0372-a36b-44de-ae9e-05e563fe7c93 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:23.989967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-836f0372-a36b-44de-ae9e-05e563fe7c93 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:23.990469 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-836f0372-a36b-44de-ae9e-05e563fe7c93 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:24.004181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-836f0372-a36b-44de-ae9e-05e563fe7c93 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] HTTP exception thrown: Instance cb36ce2a-6233-4601-85c0-35c550476cea could not be found. Apr 07 13:11:24.004766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-836f0372-a36b-44de-ae9e-05e563fe7c93 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Returning 404 to user: Instance cb36ce2a-6233-4601-85c0-35c550476cea could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:24.005602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-836f0372-a36b-44de-ae9e-05e563fe7c93 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 404 len: 111 microversion: 2.1 time: 0.027685 Apr 07 13:11:24.006921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 395/907] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:11:23 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:11:24.011350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0d780b93-1621-490a-a382-615b1ba0435b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:24.012374 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0d780b93-1621-490a-a382-615b1ba0435b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:24.022990 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d780b93-1621-490a-a382-615b1ba0435b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:24.023681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d780b93-1621-490a-a382-615b1ba0435b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:24.024670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d780b93-1621-490a-a382-615b1ba0435b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:24.025271 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d780b93-1621-490a-a382-615b1ba0435b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:24.041988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-3904d00d-6a5a-4cdf-ada7-02c2e16fcf6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b062e871-173d-432c-9775-289125811024) Apr 07 13:11:24.042616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3904d00d-6a5a-4cdf-ada7-02c2e16fcf6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b062e871-173d-432c-9775-289125811024) {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:24.043645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3904d00d-6a5a-4cdf-ada7-02c2e16fcf6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c" status: 400 len: 269 microversion: 2.1 time: 0.211926 Apr 07 13:11:24.044229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 513/908] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:11:23 2022] DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c/os-volume_attachments/5f65d3f1-3aeb-4048-8926-1531e4cebe2c => generated 269 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:24.049130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c34d9c6b-2f5b-4745-a53b-9b8e4830f1b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:24.050535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c34d9c6b-2f5b-4745-a53b-9b8e4830f1b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:24.057544 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c34d9c6b-2f5b-4745-a53b-9b8e4830f1b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:24.058227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c34d9c6b-2f5b-4745-a53b-9b8e4830f1b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:24.059192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c34d9c6b-2f5b-4745-a53b-9b8e4830f1b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:24.059984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c34d9c6b-2f5b-4745-a53b-9b8e4830f1b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:24.062265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0d780b93-1621-490a-a382-615b1ba0435b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054546 Apr 07 13:11:24.062824 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 396/909] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:11:24 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:11:24.067744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-770282f5-d96d-40bf-8ea6-d48ecadb8435 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:24.068878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-770282f5-d96d-40bf-8ea6-d48ecadb8435 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:24.075383 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-770282f5-d96d-40bf-8ea6-d48ecadb8435 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:24.076039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-770282f5-d96d-40bf-8ea6-d48ecadb8435 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:24.077254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-770282f5-d96d-40bf-8ea6-d48ecadb8435 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:24.078019 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-770282f5-d96d-40bf-8ea6-d48ecadb8435 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:24.102526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c34d9c6b-2f5b-4745-a53b-9b8e4830f1b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057061 Apr 07 13:11:24.106965 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 514/910] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:24 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:24.113488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1587974822", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1816777936", "security_groups": [{"name": "tempest-secgroup-smoke-1306186040"}], "block_device_mapping_v2": [{"uuid": "429c3140-a50f-4367-ab87-8b0ca3ac6271", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ece19f0d-be5f-4b8f-aed1-374da7c54815"}]}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:11:24.233304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-770282f5-d96d-40bf-8ea6-d48ecadb8435 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:11:24.241860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-770282f5-d96d-40bf-8ea6-d48ecadb8435 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1675 microversion: 2.1 time: 0.176644 Apr 07 13:11:24.243251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 397/911] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:11:24 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:11:24.317879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.network.neutron [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] validate_networks() for [('ece19f0d-be5f-4b8f-aed1-374da7c54815', None, None, None, None, None)] {{(pid=116893) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 13:11:25.079419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Flavor limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 13:11:25.080063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Image limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 13:11:25.080342 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Flavor pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 13:11:25.080758 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Image pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 13:11:25.081174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 13:11:25.095861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:25.096353 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:25.097164 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:25.098759 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-87ea5d90-2480-459a-b70b-22e7a7f559f7 req-803c241c-7850-42d8-bb77-939bf8f40986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3439aee-0673-4237-9ac0-67d6959acdad", "name": "network-vif-deleted", "tag": "6ce58860-f078-406c-9346-1cd0933c1cf4"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:11:25.100661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:25.108464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-87ea5d90-2480-459a-b70b-22e7a7f559f7 req-803c241c-7850-42d8-bb77-939bf8f40986 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:25.109227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-87ea5d90-2480-459a-b70b-22e7a7f559f7 req-803c241c-7850-42d8-bb77-939bf8f40986 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:25.121419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Getting quotas for project a63deb3be5f546a696dabf7b1a6f3416. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:11:25.124027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-87ea5d90-2480-459a-b70b-22e7a7f559f7 req-803c241c-7850-42d8-bb77-939bf8f40986 service nova] Creating event network-vif-deleted:6ce58860-f078-406c-9346-1cd0933c1cf4 for instance b3439aee-0673-4237-9ac0-67d6959acdad on hv-cinder-83694 Apr 07 13:11:25.125751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Getting quotas for user af14b11cb4c649e6881818075733a5b7 and project a63deb3be5f546a696dabf7b1a6f3416. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:11:25.130361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-87ea5d90-2480-459a-b70b-22e7a7f559f7 req-803c241c-7850-42d8-bb77-939bf8f40986 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244714 Apr 07 13:11:25.131446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 398/912] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:11:25.137296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f1674cec-d14e-4835-b70a-2804e4fbc2ac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:11:25.138301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f1674cec-d14e-4835-b70a-2804e4fbc2ac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:25.144560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1674cec-d14e-4835-b70a-2804e4fbc2ac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:25.145014 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1674cec-d14e-4835-b70a-2804e4fbc2ac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:25.146167 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1674cec-d14e-4835-b70a-2804e4fbc2ac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:25.147313 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1674cec-d14e-4835-b70a-2804e4fbc2ac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:25.192900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Going to run 1 instances... {{(pid=116893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 13:11:25.196212 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: 7e006846-03d9-4206-928b-920ea49d27b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='429c3140-a50f-4367-ab87-8b0ca3ac6271',volume_size=None,volume_type=None)] {{(pid=116893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 13:11:25.298246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 429c3140-a50f-4367-ab87-8b0ca3ac6271 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-5db6b2a5-df55-4d1d-9a2b-f9523a9350b2) Apr 07 13:11:25.298866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 429c3140-a50f-4367-ab87-8b0ca3ac6271 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-5db6b2a5-df55-4d1d-9a2b-f9523a9350b2) {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:25.299708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b3ea77e5-6bf9-43f9-9ae0-15efdc926d70 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 1.191628 Apr 07 13:11:25.300302 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 515/913] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 13:11:24 2022] POST /compute/v2.1/servers => generated 295 bytes in 1193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:11:25.305854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c0dcddfd-cd27-43f5-99c1-0143a1b2fbd8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:25.309085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c0dcddfd-cd27-43f5-99c1-0143a1b2fbd8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:25.316039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c0dcddfd-cd27-43f5-99c1-0143a1b2fbd8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:25.316527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c0dcddfd-cd27-43f5-99c1-0143a1b2fbd8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:25.317308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c0dcddfd-cd27-43f5-99c1-0143a1b2fbd8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:25.317784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c0dcddfd-cd27-43f5-99c1-0143a1b2fbd8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:25.326440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f1674cec-d14e-4835-b70a-2804e4fbc2ac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "POST /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/action" status: 200 len: 38497 microversion: 2.20 time: 0.193591 Apr 07 13:11:25.343882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 399/914] 10.222.0.15 () {62 vars in 1318 bytes} [Thu Apr 7 13:11:25 2022] POST /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae/action => generated 38497 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:11:25.353916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c0dcddfd-cd27-43f5-99c1-0143a1b2fbd8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052066 Apr 07 13:11:25.354965 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 516/915] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:25 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:25.361456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-457903e6-057c-4c5c-8ed2-b28983790c88 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:25.362721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-457903e6-057c-4c5c-8ed2-b28983790c88 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:25.373248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-457903e6-057c-4c5c-8ed2-b28983790c88 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:25.378197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-457903e6-057c-4c5c-8ed2-b28983790c88 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:25.379301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-457903e6-057c-4c5c-8ed2-b28983790c88 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:25.379909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-457903e6-057c-4c5c-8ed2-b28983790c88 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:25.424571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-457903e6-057c-4c5c-8ed2-b28983790c88 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:25.425316 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-457903e6-057c-4c5c-8ed2-b28983790c88 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:25.425887 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-457903e6-057c-4c5c-8ed2-b28983790c88 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lazy-loading 'fault' on Instance uuid b3439aee-0673-4237-9ac0-67d6959acdad {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:11:25.475466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-457903e6-057c-4c5c-8ed2-b28983790c88 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a36496b3c774c2097534b5fcad47db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6bab4269a84eae81e793309488d7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:11:25.484666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-457903e6-057c-4c5c-8ed2-b28983790c88 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 200 len: 1328 microversion: 2.1 time: 0.138884 Apr 07 13:11:25.494331 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 400/916] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:11:25 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 1328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:11:26.082278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-054fde2a-cb56-4b9d-a95d-3b66918822ae tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:26.082785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-054fde2a-cb56-4b9d-a95d-3b66918822ae tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:26.089711 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-054fde2a-cb56-4b9d-a95d-3b66918822ae tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:26.090107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-054fde2a-cb56-4b9d-a95d-3b66918822ae tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:26.090879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-054fde2a-cb56-4b9d-a95d-3b66918822ae tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:26.091323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-054fde2a-cb56-4b9d-a95d-3b66918822ae tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:26.104904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-054fde2a-cb56-4b9d-a95d-3b66918822ae tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] HTTP exception thrown: Instance cb36ce2a-6233-4601-85c0-35c550476cea could not be found. Apr 07 13:11:26.105491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-054fde2a-cb56-4b9d-a95d-3b66918822ae tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Returning 404 to user: Instance cb36ce2a-6233-4601-85c0-35c550476cea could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:26.106313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-054fde2a-cb56-4b9d-a95d-3b66918822ae tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 404 len: 111 microversion: 2.1 time: 0.027916 Apr 07 13:11:26.106838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 517/917] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:11:26 2022] DELETE /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:11:26.114783 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-68e9b196-1efa-4912-83db-373739e4bd2b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:26.115416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-68e9b196-1efa-4912-83db-373739e4bd2b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] [instance: cb36ce2a-6233-4601-85c0-35c550476cea] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:26.121702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68e9b196-1efa-4912-83db-373739e4bd2b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:26.122151 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68e9b196-1efa-4912-83db-373739e4bd2b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:26.122914 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68e9b196-1efa-4912-83db-373739e4bd2b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:26.123355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68e9b196-1efa-4912-83db-373739e4bd2b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:26.136729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-68e9b196-1efa-4912-83db-373739e4bd2b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] HTTP exception thrown: Instance cb36ce2a-6233-4601-85c0-35c550476cea could not be found. Apr 07 13:11:26.137303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-68e9b196-1efa-4912-83db-373739e4bd2b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Returning 404 to user: Instance cb36ce2a-6233-4601-85c0-35c550476cea could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:26.138105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-68e9b196-1efa-4912-83db-373739e4bd2b tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea" status: 404 len: 111 microversion: 2.1 time: 0.027126 Apr 07 13:11:26.138602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 401/918] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:11:26 2022] GET /compute/v2.1/servers/cb36ce2a-6233-4601-85c0-35c550476cea => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:11:26.366328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-43112d86-2da2-4eae-a24a-fc83a79f9e75 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:26.367496 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-43112d86-2da2-4eae-a24a-fc83a79f9e75 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:26.373323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-43112d86-2da2-4eae-a24a-fc83a79f9e75 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:26.373773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-43112d86-2da2-4eae-a24a-fc83a79f9e75 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:26.374525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-43112d86-2da2-4eae-a24a-fc83a79f9e75 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:26.374954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-43112d86-2da2-4eae-a24a-fc83a79f9e75 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:26.402864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-43112d86-2da2-4eae-a24a-fc83a79f9e75 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041461 Apr 07 13:11:26.403395 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 518/919] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:26 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:26.501878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-19cf3580-2777-4a15-94de-cd557d5a0f25 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:26.502500 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-19cf3580-2777-4a15-94de-cd557d5a0f25 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:26.508932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-19cf3580-2777-4a15-94de-cd557d5a0f25 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:26.509387 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-19cf3580-2777-4a15-94de-cd557d5a0f25 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:26.510157 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-19cf3580-2777-4a15-94de-cd557d5a0f25 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:26.510596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-19cf3580-2777-4a15-94de-cd557d5a0f25 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:26.524278 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-19cf3580-2777-4a15-94de-cd557d5a0f25 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] HTTP exception thrown: Instance b3439aee-0673-4237-9ac0-67d6959acdad could not be found. Apr 07 13:11:26.524890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-19cf3580-2777-4a15-94de-cd557d5a0f25 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Returning 404 to user: Instance b3439aee-0673-4237-9ac0-67d6959acdad could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:11:26.525700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-19cf3580-2777-4a15-94de-cd557d5a0f25 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 404 len: 111 microversion: 2.1 time: 0.027699 Apr 07 13:11:26.526201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 402/920] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:11:26 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:11:26.534604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-caaa8747-0c18-47d1-8c2b-0a9dde3a5ff4 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '.version_select at 0x7fde584ae5e0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:26.556513 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-caaa8747-0c18-47d1-8c2b-0a9dde3a5ff4 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1184296923" status: 202 len: 0 microversion: 2.1 time: 0.025885 Apr 07 13:11:26.557079 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 519/921] 10.222.0.15 () {58 vars in 1220 bytes} [Thu Apr 7 13:11:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1184296923 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:11:27.416329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0d4541d0-0278-4e45-bbd4-7b87c12b8e5b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:27.417141 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0d4541d0-0278-4e45-bbd4-7b87c12b8e5b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:27.423447 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d4541d0-0278-4e45-bbd4-7b87c12b8e5b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:27.423903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d4541d0-0278-4e45-bbd4-7b87c12b8e5b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:27.424713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d4541d0-0278-4e45-bbd4-7b87c12b8e5b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:27.425143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d4541d0-0278-4e45-bbd4-7b87c12b8e5b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:27.454099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0d4541d0-0278-4e45-bbd4-7b87c12b8e5b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Apr 07 13:11:27.454651 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 403/922] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:28.465348 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-764c29f6-a30b-4aa8-81b2-b9be05350407 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:28.466280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-764c29f6-a30b-4aa8-81b2-b9be05350407 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:28.472904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-764c29f6-a30b-4aa8-81b2-b9be05350407 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:28.473354 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-764c29f6-a30b-4aa8-81b2-b9be05350407 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:28.474115 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-764c29f6-a30b-4aa8-81b2-b9be05350407 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:28.475070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-764c29f6-a30b-4aa8-81b2-b9be05350407 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:28.502810 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-764c29f6-a30b-4aa8-81b2-b9be05350407 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041936 Apr 07 13:11:28.503364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 520/923] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:28 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:29.514733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-91a6ab26-9c66-48a0-a5d9-d06c483f0e2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:29.515658 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-91a6ab26-9c66-48a0-a5d9-d06c483f0e2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:29.522964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-91a6ab26-9c66-48a0-a5d9-d06c483f0e2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:29.523422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-91a6ab26-9c66-48a0-a5d9-d06c483f0e2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:29.524231 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-91a6ab26-9c66-48a0-a5d9-d06c483f0e2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:29.524677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-91a6ab26-9c66-48a0-a5d9-d06c483f0e2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:29.553473 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-91a6ab26-9c66-48a0-a5d9-d06c483f0e2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 Apr 07 13:11:29.554275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 404/924] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:29 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:30.564661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f4e3e937-9b6a-4899-99a8-f4042f277e4b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:30.565587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f4e3e937-9b6a-4899-99a8-f4042f277e4b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:30.572412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f4e3e937-9b6a-4899-99a8-f4042f277e4b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:30.572894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f4e3e937-9b6a-4899-99a8-f4042f277e4b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:30.573633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f4e3e937-9b6a-4899-99a8-f4042f277e4b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:30.574064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f4e3e937-9b6a-4899-99a8-f4042f277e4b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:30.604187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f4e3e937-9b6a-4899-99a8-f4042f277e4b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043448 Apr 07 13:11:30.604751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 521/925] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:30 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:31.615828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e2c619f3-7868-4c05-bba6-c99b680b0cd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:31.616798 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e2c619f3-7868-4c05-bba6-c99b680b0cd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:31.623105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e2c619f3-7868-4c05-bba6-c99b680b0cd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:31.623567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e2c619f3-7868-4c05-bba6-c99b680b0cd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:31.624380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e2c619f3-7868-4c05-bba6-c99b680b0cd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:31.624828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e2c619f3-7868-4c05-bba6-c99b680b0cd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:31.652157 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e2c619f3-7868-4c05-bba6-c99b680b0cd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040884 Apr 07 13:11:31.652698 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 405/926] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:31 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:32.664046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-180454a8-26de-4345-b338-4e7518608c71 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:32.664945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-180454a8-26de-4345-b338-4e7518608c71 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:32.671190 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-180454a8-26de-4345-b338-4e7518608c71 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:32.671653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-180454a8-26de-4345-b338-4e7518608c71 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:32.672449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-180454a8-26de-4345-b338-4e7518608c71 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:32.672886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-180454a8-26de-4345-b338-4e7518608c71 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:32.700993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-180454a8-26de-4345-b338-4e7518608c71 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 Apr 07 13:11:32.701530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 522/927] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:33.714137 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f1b1c195-c91e-40d6-9453-e133008cb1f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:33.714137 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f1b1c195-c91e-40d6-9453-e133008cb1f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:33.720257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1b1c195-c91e-40d6-9453-e133008cb1f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:33.720721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1b1c195-c91e-40d6-9453-e133008cb1f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:33.721497 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1b1c195-c91e-40d6-9453-e133008cb1f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:33.721945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1b1c195-c91e-40d6-9453-e133008cb1f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:33.749511 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f1b1c195-c91e-40d6-9453-e133008cb1f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040984 Apr 07 13:11:33.750046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 406/928] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:33 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:34.761383 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0433d7f2-d67e-4ac4-bcad-8e8092cee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:34.762218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0433d7f2-d67e-4ac4-bcad-8e8092cee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:34.768655 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0433d7f2-d67e-4ac4-bcad-8e8092cee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:34.769111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0433d7f2-d67e-4ac4-bcad-8e8092cee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:34.769873 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0433d7f2-d67e-4ac4-bcad-8e8092cee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:34.770311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0433d7f2-d67e-4ac4-bcad-8e8092cee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:34.798550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0433d7f2-d67e-4ac4-bcad-8e8092cee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041150 Apr 07 13:11:34.799065 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 523/929] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:34 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:35.809868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-38893a26-5b87-489f-8cf0-90fdb7ae00f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:35.810802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-38893a26-5b87-489f-8cf0-90fdb7ae00f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:35.816816 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38893a26-5b87-489f-8cf0-90fdb7ae00f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:35.817279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38893a26-5b87-489f-8cf0-90fdb7ae00f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:35.818051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38893a26-5b87-489f-8cf0-90fdb7ae00f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:35.818675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38893a26-5b87-489f-8cf0-90fdb7ae00f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:35.848414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-38893a26-5b87-489f-8cf0-90fdb7ae00f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042319 Apr 07 13:11:35.848964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 407/930] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:35 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:36.860163 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3d64a260-e5e0-405b-ac86-1ac79049aece tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:36.861078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3d64a260-e5e0-405b-ac86-1ac79049aece tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:36.867954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d64a260-e5e0-405b-ac86-1ac79049aece tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:36.868432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d64a260-e5e0-405b-ac86-1ac79049aece tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:36.869199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d64a260-e5e0-405b-ac86-1ac79049aece tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:36.869633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d64a260-e5e0-405b-ac86-1ac79049aece tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:36.899831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3d64a260-e5e0-405b-ac86-1ac79049aece tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 Apr 07 13:11:36.900410 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 524/931] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:36 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:37.917052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c62c95b0-c39e-4700-ab29-8e31aa2c76d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:37.917999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c62c95b0-c39e-4700-ab29-8e31aa2c76d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:37.924385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c62c95b0-c39e-4700-ab29-8e31aa2c76d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:37.924845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c62c95b0-c39e-4700-ab29-8e31aa2c76d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:37.925624 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c62c95b0-c39e-4700-ab29-8e31aa2c76d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:37.926160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c62c95b0-c39e-4700-ab29-8e31aa2c76d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:37.962182 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c62c95b0-c39e-4700-ab29-8e31aa2c76d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049995 Apr 07 13:11:37.962767 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 408/932] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:38.980907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-024b1488-2491-442a-8f08-356e1e00603f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:38.980907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-024b1488-2491-442a-8f08-356e1e00603f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:38.980907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-024b1488-2491-442a-8f08-356e1e00603f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:38.981988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-024b1488-2491-442a-8f08-356e1e00603f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:38.982170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-024b1488-2491-442a-8f08-356e1e00603f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:38.982504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-024b1488-2491-442a-8f08-356e1e00603f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:39.013371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-024b1488-2491-442a-8f08-356e1e00603f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044184 Apr 07 13:11:39.014328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 525/933] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:40.026150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4f7d4e8d-936f-47e4-bea5-e4891a2ff2f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:40.027216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4f7d4e8d-936f-47e4-bea5-e4891a2ff2f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:40.034173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4f7d4e8d-936f-47e4-bea5-e4891a2ff2f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:40.034712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4f7d4e8d-936f-47e4-bea5-e4891a2ff2f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:40.035542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4f7d4e8d-936f-47e4-bea5-e4891a2ff2f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:40.036061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4f7d4e8d-936f-47e4-bea5-e4891a2ff2f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:40.069478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4f7d4e8d-936f-47e4-bea5-e4891a2ff2f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047113 Apr 07 13:11:40.070047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 409/934] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:40 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:41.080747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ab9d0f01-8d3d-49a1-9e28-86e32b63fb03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:41.081708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ab9d0f01-8d3d-49a1-9e28-86e32b63fb03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:41.088651 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab9d0f01-8d3d-49a1-9e28-86e32b63fb03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:41.089105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab9d0f01-8d3d-49a1-9e28-86e32b63fb03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:41.089882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab9d0f01-8d3d-49a1-9e28-86e32b63fb03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:41.090320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab9d0f01-8d3d-49a1-9e28-86e32b63fb03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:41.121068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ab9d0f01-8d3d-49a1-9e28-86e32b63fb03 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044253 Apr 07 13:11:41.121633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 526/935] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:41 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:42.132606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3cee3ee9-1c31-492c-8661-303933e31ddf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:42.133692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3cee3ee9-1c31-492c-8661-303933e31ddf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:42.140269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3cee3ee9-1c31-492c-8661-303933e31ddf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:42.140729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3cee3ee9-1c31-492c-8661-303933e31ddf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:42.141511 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3cee3ee9-1c31-492c-8661-303933e31ddf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:42.141954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3cee3ee9-1c31-492c-8661-303933e31ddf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:42.171860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3cee3ee9-1c31-492c-8661-303933e31ddf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043253 Apr 07 13:11:42.172454 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 410/936] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:42 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:43.183775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b4806a62-509c-41b8-a15a-ff7f267a25db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:43.184857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b4806a62-509c-41b8-a15a-ff7f267a25db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:43.191162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4806a62-509c-41b8-a15a-ff7f267a25db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:43.191621 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4806a62-509c-41b8-a15a-ff7f267a25db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:43.192640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4806a62-509c-41b8-a15a-ff7f267a25db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:43.193654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4806a62-509c-41b8-a15a-ff7f267a25db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:43.223114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b4806a62-509c-41b8-a15a-ff7f267a25db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043153 Apr 07 13:11:43.223675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 527/937] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:43 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:44.234980 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3c1efd05-000d-480a-b403-acdc5cc49775 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:44.235921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3c1efd05-000d-480a-b403-acdc5cc49775 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:44.242320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c1efd05-000d-480a-b403-acdc5cc49775 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:44.242831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c1efd05-000d-480a-b403-acdc5cc49775 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:44.243698 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c1efd05-000d-480a-b403-acdc5cc49775 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:44.244269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c1efd05-000d-480a-b403-acdc5cc49775 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:44.276901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3c1efd05-000d-480a-b403-acdc5cc49775 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046765 Apr 07 13:11:44.277461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 411/938] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:44 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:45.289356 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5323b318-4245-4a46-8fb9-0050a9400a5e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:45.290285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5323b318-4245-4a46-8fb9-0050a9400a5e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:45.296654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5323b318-4245-4a46-8fb9-0050a9400a5e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:45.297109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5323b318-4245-4a46-8fb9-0050a9400a5e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:45.297874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5323b318-4245-4a46-8fb9-0050a9400a5e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:45.298313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5323b318-4245-4a46-8fb9-0050a9400a5e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:45.326849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5323b318-4245-4a46-8fb9-0050a9400a5e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042068 Apr 07 13:11:45.327408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 528/939] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:45 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:46.338414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cc9b5f00-447b-4c7b-8e77-e1d4cf947380 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:46.339487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cc9b5f00-447b-4c7b-8e77-e1d4cf947380 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:46.345959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc9b5f00-447b-4c7b-8e77-e1d4cf947380 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:46.346481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc9b5f00-447b-4c7b-8e77-e1d4cf947380 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:46.347257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc9b5f00-447b-4c7b-8e77-e1d4cf947380 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:46.347756 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc9b5f00-447b-4c7b-8e77-e1d4cf947380 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:46.376685 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cc9b5f00-447b-4c7b-8e77-e1d4cf947380 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042278 Apr 07 13:11:46.377234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 412/940] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:46 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:47.388877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ebdd7714-c9ba-49e2-8b04-e2c2fb56cda2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:47.389817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ebdd7714-c9ba-49e2-8b04-e2c2fb56cda2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:47.396685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ebdd7714-c9ba-49e2-8b04-e2c2fb56cda2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:47.397201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ebdd7714-c9ba-49e2-8b04-e2c2fb56cda2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:47.397980 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ebdd7714-c9ba-49e2-8b04-e2c2fb56cda2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:47.398424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ebdd7714-c9ba-49e2-8b04-e2c2fb56cda2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:47.429657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ebdd7714-c9ba-49e2-8b04-e2c2fb56cda2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Apr 07 13:11:47.430226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 529/941] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:47 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:48.441134 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e17cea32-3675-459c-bd88-4681de992253 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:48.442070 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e17cea32-3675-459c-bd88-4681de992253 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:48.449163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e17cea32-3675-459c-bd88-4681de992253 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:48.449623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e17cea32-3675-459c-bd88-4681de992253 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:48.450518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e17cea32-3675-459c-bd88-4681de992253 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:48.450965 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e17cea32-3675-459c-bd88-4681de992253 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:48.478911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e17cea32-3675-459c-bd88-4681de992253 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041606 Apr 07 13:11:48.479456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 413/942] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:48 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:49.490597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d0e45e5a-3f33-4869-92f1-26415d87154e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:49.491529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d0e45e5a-3f33-4869-92f1-26415d87154e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:49.497984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0e45e5a-3f33-4869-92f1-26415d87154e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:49.498447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0e45e5a-3f33-4869-92f1-26415d87154e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:49.499220 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0e45e5a-3f33-4869-92f1-26415d87154e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:49.499660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0e45e5a-3f33-4869-92f1-26415d87154e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:49.529556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d0e45e5a-3f33-4869-92f1-26415d87154e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Apr 07 13:11:49.530123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 530/943] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:49 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:50.541657 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-255499c6-3550-4c0d-b24e-5074d201f498 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:50.542584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-255499c6-3550-4c0d-b24e-5074d201f498 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:50.548861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-255499c6-3550-4c0d-b24e-5074d201f498 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:50.549274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-255499c6-3550-4c0d-b24e-5074d201f498 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:50.550034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-255499c6-3550-4c0d-b24e-5074d201f498 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:50.550476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-255499c6-3550-4c0d-b24e-5074d201f498 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:50.579448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-255499c6-3550-4c0d-b24e-5074d201f498 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041605 Apr 07 13:11:50.583122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 414/944] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:51.590760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e79c8af6-f2d4-4501-9e97-6f400b149152 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:51.592376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e79c8af6-f2d4-4501-9e97-6f400b149152 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:51.599478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e79c8af6-f2d4-4501-9e97-6f400b149152 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:51.599905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e79c8af6-f2d4-4501-9e97-6f400b149152 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:51.600717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e79c8af6-f2d4-4501-9e97-6f400b149152 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:51.601162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e79c8af6-f2d4-4501-9e97-6f400b149152 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:51.631714 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e79c8af6-f2d4-4501-9e97-6f400b149152 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Apr 07 13:11:51.632306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 531/945] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:51 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:52.642710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5b59eec9-5d90-41d9-86cb-d1d6214307f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:52.643635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5b59eec9-5d90-41d9-86cb-d1d6214307f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:52.651034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b59eec9-5d90-41d9-86cb-d1d6214307f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:52.651484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b59eec9-5d90-41d9-86cb-d1d6214307f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:52.652272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b59eec9-5d90-41d9-86cb-d1d6214307f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:52.652839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b59eec9-5d90-41d9-86cb-d1d6214307f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:52.683583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5b59eec9-5d90-41d9-86cb-d1d6214307f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044720 Apr 07 13:11:52.684155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 415/946] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:52 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:53.695669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-846ff8cc-cb3a-49c1-9505-5caed31ca20e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:53.696632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-846ff8cc-cb3a-49c1-9505-5caed31ca20e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:53.702421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-846ff8cc-cb3a-49c1-9505-5caed31ca20e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:53.702876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-846ff8cc-cb3a-49c1-9505-5caed31ca20e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:53.703652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-846ff8cc-cb3a-49c1-9505-5caed31ca20e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:53.704095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-846ff8cc-cb3a-49c1-9505-5caed31ca20e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:53.738308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-846ff8cc-cb3a-49c1-9505-5caed31ca20e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046983 Apr 07 13:11:53.739823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 532/947] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:53 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:54.750768 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0a8b0632-086e-4200-872f-9a6b4ac5a898 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:54.751728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0a8b0632-086e-4200-872f-9a6b4ac5a898 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:54.758462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a8b0632-086e-4200-872f-9a6b4ac5a898 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:54.758921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a8b0632-086e-4200-872f-9a6b4ac5a898 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:54.759700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a8b0632-086e-4200-872f-9a6b4ac5a898 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:54.760174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a8b0632-086e-4200-872f-9a6b4ac5a898 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:54.789660 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0a8b0632-086e-4200-872f-9a6b4ac5a898 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042848 Apr 07 13:11:54.790209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 416/948] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:54 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:55.801068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4b083ad9-6495-4a35-87a5-cfbbee4a855e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:55.802064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4b083ad9-6495-4a35-87a5-cfbbee4a855e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:55.808675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b083ad9-6495-4a35-87a5-cfbbee4a855e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:55.809124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b083ad9-6495-4a35-87a5-cfbbee4a855e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:55.809896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b083ad9-6495-4a35-87a5-cfbbee4a855e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:55.810445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b083ad9-6495-4a35-87a5-cfbbee4a855e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:55.839807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4b083ad9-6495-4a35-87a5-cfbbee4a855e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Apr 07 13:11:55.840483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 533/949] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:55 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:56.851911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cb497ede-6a51-418d-86b6-bdd28ace18de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:56.852920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cb497ede-6a51-418d-86b6-bdd28ace18de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:56.859240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb497ede-6a51-418d-86b6-bdd28ace18de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:56.859701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb497ede-6a51-418d-86b6-bdd28ace18de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:56.860509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb497ede-6a51-418d-86b6-bdd28ace18de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:56.861039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb497ede-6a51-418d-86b6-bdd28ace18de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:56.889897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cb497ede-6a51-418d-86b6-bdd28ace18de tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042425 Apr 07 13:11:56.890456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 417/950] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:56 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:57.902167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-db4bc274-2146-4814-8dd2-e82c84a8c021 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:57.903135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-db4bc274-2146-4814-8dd2-e82c84a8c021 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:57.910227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-db4bc274-2146-4814-8dd2-e82c84a8c021 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:57.910682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-db4bc274-2146-4814-8dd2-e82c84a8c021 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:57.911460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-db4bc274-2146-4814-8dd2-e82c84a8c021 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:57.911889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-db4bc274-2146-4814-8dd2-e82c84a8c021 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:57.940381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-db4bc274-2146-4814-8dd2-e82c84a8c021 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042115 Apr 07 13:11:57.940946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 534/951] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:11:58.951920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f1b445aa-88f3-42d2-b0dd-a5d22e5fc92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:11:58.952888 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f1b445aa-88f3-42d2-b0dd-a5d22e5fc92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:11:58.959940 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1b445aa-88f3-42d2-b0dd-a5d22e5fc92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:58.960576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1b445aa-88f3-42d2-b0dd-a5d22e5fc92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:58.961290 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1b445aa-88f3-42d2-b0dd-a5d22e5fc92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:11:58.961726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1b445aa-88f3-42d2-b0dd-a5d22e5fc92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:11:58.991553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f1b445aa-88f3-42d2-b0dd-a5d22e5fc92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043537 Apr 07 13:11:58.992105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 418/952] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:00.003352 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5bc30e86-1bf6-465e-9f88-381163417f7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:00.004308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5bc30e86-1bf6-465e-9f88-381163417f7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:00.010979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bc30e86-1bf6-465e-9f88-381163417f7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:00.011424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bc30e86-1bf6-465e-9f88-381163417f7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:00.012215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bc30e86-1bf6-465e-9f88-381163417f7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:00.012657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bc30e86-1bf6-465e-9f88-381163417f7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:00.041320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5bc30e86-1bf6-465e-9f88-381163417f7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041903 Apr 07 13:12:00.041883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 535/953] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:11:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:01.053415 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dfb3876f-fbac-4229-af7e-c6c355d0ed6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:01.054352 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dfb3876f-fbac-4229-af7e-c6c355d0ed6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:01.060732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dfb3876f-fbac-4229-af7e-c6c355d0ed6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:01.061194 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dfb3876f-fbac-4229-af7e-c6c355d0ed6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:01.061967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dfb3876f-fbac-4229-af7e-c6c355d0ed6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:01.062411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dfb3876f-fbac-4229-af7e-c6c355d0ed6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:01.091282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dfb3876f-fbac-4229-af7e-c6c355d0ed6b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042431 Apr 07 13:12:01.091840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 419/954] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:01 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:02.103786 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0db6fabc-3d86-4dda-885d-48486b87a053 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:02.104757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0db6fabc-3d86-4dda-885d-48486b87a053 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:02.111022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0db6fabc-3d86-4dda-885d-48486b87a053 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:02.111471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0db6fabc-3d86-4dda-885d-48486b87a053 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:02.112257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0db6fabc-3d86-4dda-885d-48486b87a053 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:02.112692 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0db6fabc-3d86-4dda-885d-48486b87a053 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:02.141989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0db6fabc-3d86-4dda-885d-48486b87a053 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042981 Apr 07 13:12:02.142553 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 536/955] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:02 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:03.154304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d02ed54f-ea6f-4bdf-a01d-3e35e53fb03c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:03.155236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d02ed54f-ea6f-4bdf-a01d-3e35e53fb03c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:03.162291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d02ed54f-ea6f-4bdf-a01d-3e35e53fb03c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:03.162740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d02ed54f-ea6f-4bdf-a01d-3e35e53fb03c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:03.163515 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d02ed54f-ea6f-4bdf-a01d-3e35e53fb03c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:03.163977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d02ed54f-ea6f-4bdf-a01d-3e35e53fb03c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:03.193086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d02ed54f-ea6f-4bdf-a01d-3e35e53fb03c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042657 Apr 07 13:12:03.193645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 420/956] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:03 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:04.203708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-883c2d0e-a46c-46bb-bc14-16c262fd7a91 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:04.204583 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-883c2d0e-a46c-46bb-bc14-16c262fd7a91 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:04.211474 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-883c2d0e-a46c-46bb-bc14-16c262fd7a91 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:04.211931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-883c2d0e-a46c-46bb-bc14-16c262fd7a91 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:04.212728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-883c2d0e-a46c-46bb-bc14-16c262fd7a91 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:04.213160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-883c2d0e-a46c-46bb-bc14-16c262fd7a91 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:04.243836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-883c2d0e-a46c-46bb-bc14-16c262fd7a91 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044055 Apr 07 13:12:04.246083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 537/957] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:04 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:05.256155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-db620aa2-f5c3-4bc9-9908-4452ac01c500 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:05.257020 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-db620aa2-f5c3-4bc9-9908-4452ac01c500 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:05.262857 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db620aa2-f5c3-4bc9-9908-4452ac01c500 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:05.263305 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db620aa2-f5c3-4bc9-9908-4452ac01c500 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:05.264062 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db620aa2-f5c3-4bc9-9908-4452ac01c500 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:05.264527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db620aa2-f5c3-4bc9-9908-4452ac01c500 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:05.293884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-db620aa2-f5c3-4bc9-9908-4452ac01c500 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041881 Apr 07 13:12:05.294450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 421/958] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:05 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:06.305935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7e120453-b691-450a-8473-c75d5893c75b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:06.306776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7e120453-b691-450a-8473-c75d5893c75b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:06.312968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7e120453-b691-450a-8473-c75d5893c75b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:06.313413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7e120453-b691-450a-8473-c75d5893c75b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:06.314165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7e120453-b691-450a-8473-c75d5893c75b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:06.314595 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7e120453-b691-450a-8473-c75d5893c75b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:06.344563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7e120453-b691-450a-8473-c75d5893c75b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Apr 07 13:12:06.345117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 538/959] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:06 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:07.355871 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5e082517-19a5-4844-ba9a-f18e1a3186e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:07.356837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5e082517-19a5-4844-ba9a-f18e1a3186e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:07.363094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e082517-19a5-4844-ba9a-f18e1a3186e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:07.363570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e082517-19a5-4844-ba9a-f18e1a3186e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:07.364951 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e082517-19a5-4844-ba9a-f18e1a3186e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:07.365396 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e082517-19a5-4844-ba9a-f18e1a3186e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:07.394014 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5e082517-19a5-4844-ba9a-f18e1a3186e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041982 Apr 07 13:12:07.394571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 422/960] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:07 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:08.405633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6e36498a-1ec7-49e3-94a6-6a6fd72575a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:08.406480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6e36498a-1ec7-49e3-94a6-6a6fd72575a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:08.413493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e36498a-1ec7-49e3-94a6-6a6fd72575a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:08.413935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e36498a-1ec7-49e3-94a6-6a6fd72575a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:08.414685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e36498a-1ec7-49e3-94a6-6a6fd72575a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:08.415117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e36498a-1ec7-49e3-94a6-6a6fd72575a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:08.443970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6e36498a-1ec7-49e3-94a6-6a6fd72575a2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042315 Apr 07 13:12:08.444572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 539/961] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:08 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:09.455672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a3deeb6d-8ba0-45fe-b74e-aca0cd8b577a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:09.456623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a3deeb6d-8ba0-45fe-b74e-aca0cd8b577a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:09.463323 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a3deeb6d-8ba0-45fe-b74e-aca0cd8b577a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:09.463777 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a3deeb6d-8ba0-45fe-b74e-aca0cd8b577a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:09.464555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a3deeb6d-8ba0-45fe-b74e-aca0cd8b577a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:09.464987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a3deeb6d-8ba0-45fe-b74e-aca0cd8b577a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:09.493940 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a3deeb6d-8ba0-45fe-b74e-aca0cd8b577a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042271 Apr 07 13:12:09.494482 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 423/962] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:09 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:10.504382 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-653d3b50-206a-478b-8612-44cb26c72a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:10.505397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-653d3b50-206a-478b-8612-44cb26c72a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:10.511686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-653d3b50-206a-478b-8612-44cb26c72a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:10.512091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-653d3b50-206a-478b-8612-44cb26c72a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:10.512892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-653d3b50-206a-478b-8612-44cb26c72a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:10.513328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-653d3b50-206a-478b-8612-44cb26c72a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:10.541641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-653d3b50-206a-478b-8612-44cb26c72a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041238 Apr 07 13:12:10.542191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 540/963] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:10 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:11.555836 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1db9b73c-89fe-4191-91bc-027450bd01b0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:11.556794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1db9b73c-89fe-4191-91bc-027450bd01b0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:11.563531 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1db9b73c-89fe-4191-91bc-027450bd01b0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:11.563912 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1db9b73c-89fe-4191-91bc-027450bd01b0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:11.564713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1db9b73c-89fe-4191-91bc-027450bd01b0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:11.565149 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1db9b73c-89fe-4191-91bc-027450bd01b0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:11.606220 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1db9b73c-89fe-4191-91bc-027450bd01b0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055876 Apr 07 13:12:11.606778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 424/964] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:11 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:12.617788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7db9ff47-b437-41a9-9f37-5334b2d9e064 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:12.618762 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7db9ff47-b437-41a9-9f37-5334b2d9e064 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:12.625087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7db9ff47-b437-41a9-9f37-5334b2d9e064 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:12.625540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7db9ff47-b437-41a9-9f37-5334b2d9e064 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:12.626299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7db9ff47-b437-41a9-9f37-5334b2d9e064 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:12.626736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7db9ff47-b437-41a9-9f37-5334b2d9e064 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:12.655664 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7db9ff47-b437-41a9-9f37-5334b2d9e064 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041861 Apr 07 13:12:12.656538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 541/965] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:12 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:13.667818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-09c604bb-77a7-4a18-b131-14c6cf8ebbcb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:13.668775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-09c604bb-77a7-4a18-b131-14c6cf8ebbcb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:13.675077 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-09c604bb-77a7-4a18-b131-14c6cf8ebbcb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:13.675479 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-09c604bb-77a7-4a18-b131-14c6cf8ebbcb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:13.676907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-09c604bb-77a7-4a18-b131-14c6cf8ebbcb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:13.677428 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-09c604bb-77a7-4a18-b131-14c6cf8ebbcb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:13.704785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-09c604bb-77a7-4a18-b131-14c6cf8ebbcb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040870 Apr 07 13:12:13.705333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 425/966] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:13 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:14.716577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c5271544-b758-4a5b-b328-3fab05ecb0b5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:14.717686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c5271544-b758-4a5b-b328-3fab05ecb0b5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:14.724805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c5271544-b758-4a5b-b328-3fab05ecb0b5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:14.725197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c5271544-b758-4a5b-b328-3fab05ecb0b5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:14.725982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c5271544-b758-4a5b-b328-3fab05ecb0b5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:14.726421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c5271544-b758-4a5b-b328-3fab05ecb0b5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:14.755806 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c5271544-b758-4a5b-b328-3fab05ecb0b5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042110 Apr 07 13:12:14.759010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 542/967] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:14 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:15.766771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d4e4e9e3-7ace-4877-a401-a37c721f5e1b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:15.767613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d4e4e9e3-7ace-4877-a401-a37c721f5e1b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:15.774304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d4e4e9e3-7ace-4877-a401-a37c721f5e1b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:15.774761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d4e4e9e3-7ace-4877-a401-a37c721f5e1b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:15.775525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d4e4e9e3-7ace-4877-a401-a37c721f5e1b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:15.776059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d4e4e9e3-7ace-4877-a401-a37c721f5e1b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:15.805475 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d4e4e9e3-7ace-4877-a401-a37c721f5e1b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042722 Apr 07 13:12:15.806026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 426/968] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:15 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:16.817884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-45657542-f09c-45cb-bca9-04909a44846f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:16.818849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-45657542-f09c-45cb-bca9-04909a44846f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:16.825123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45657542-f09c-45cb-bca9-04909a44846f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:16.825572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45657542-f09c-45cb-bca9-04909a44846f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:16.826332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45657542-f09c-45cb-bca9-04909a44846f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:16.826767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45657542-f09c-45cb-bca9-04909a44846f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:16.854648 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-45657542-f09c-45cb-bca9-04909a44846f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041573 Apr 07 13:12:16.855197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 543/969] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:16 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:17.866561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a20f2e8d-fd7d-4b88-9082-9049fdff6594 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:17.867495 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a20f2e8d-fd7d-4b88-9082-9049fdff6594 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:17.873777 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a20f2e8d-fd7d-4b88-9082-9049fdff6594 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:17.874236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a20f2e8d-fd7d-4b88-9082-9049fdff6594 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:17.875006 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a20f2e8d-fd7d-4b88-9082-9049fdff6594 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:17.875447 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a20f2e8d-fd7d-4b88-9082-9049fdff6594 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:17.906161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a20f2e8d-fd7d-4b88-9082-9049fdff6594 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Apr 07 13:12:17.908448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 427/970] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:17 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:18.918767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-021970e5-e99e-48bb-9010-86366b4fe797 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:18.919694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-021970e5-e99e-48bb-9010-86366b4fe797 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:18.926920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-021970e5-e99e-48bb-9010-86366b4fe797 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:18.927459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-021970e5-e99e-48bb-9010-86366b4fe797 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:18.928086 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-021970e5-e99e-48bb-9010-86366b4fe797 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:18.928563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-021970e5-e99e-48bb-9010-86366b4fe797 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:18.955811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-021970e5-e99e-48bb-9010-86366b4fe797 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040949 Apr 07 13:12:18.956396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 544/971] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:19.967130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f7234a34-3e65-4f09-b0e5-08ef3894238a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:19.968057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f7234a34-3e65-4f09-b0e5-08ef3894238a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:19.974994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f7234a34-3e65-4f09-b0e5-08ef3894238a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:19.975530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f7234a34-3e65-4f09-b0e5-08ef3894238a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:19.976694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f7234a34-3e65-4f09-b0e5-08ef3894238a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:19.977447 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f7234a34-3e65-4f09-b0e5-08ef3894238a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:20.006506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f7234a34-3e65-4f09-b0e5-08ef3894238a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043251 Apr 07 13:12:20.007041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 428/972] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:19 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:21.017990 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2c4fbb13-2dfc-4696-b1f4-3dd563a9a4fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:21.018919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2c4fbb13-2dfc-4696-b1f4-3dd563a9a4fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:21.025871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c4fbb13-2dfc-4696-b1f4-3dd563a9a4fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:21.026322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c4fbb13-2dfc-4696-b1f4-3dd563a9a4fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:21.027090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c4fbb13-2dfc-4696-b1f4-3dd563a9a4fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:21.027532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c4fbb13-2dfc-4696-b1f4-3dd563a9a4fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:21.055091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2c4fbb13-2dfc-4696-b1f4-3dd563a9a4fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041054 Apr 07 13:12:21.055575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 545/973] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:21 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:22.067046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-76fc45f6-590b-4efe-897f-52cf11b4a8d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:22.068097 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-76fc45f6-590b-4efe-897f-52cf11b4a8d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:22.074405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76fc45f6-590b-4efe-897f-52cf11b4a8d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:22.074862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76fc45f6-590b-4efe-897f-52cf11b4a8d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:22.075629 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76fc45f6-590b-4efe-897f-52cf11b4a8d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:22.076074 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76fc45f6-590b-4efe-897f-52cf11b4a8d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:22.104732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-76fc45f6-590b-4efe-897f-52cf11b4a8d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041790 Apr 07 13:12:22.105277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 429/974] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:22 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:23.116424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-348f31f0-a12e-4e4b-b730-358b8410d78a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:23.117389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-348f31f0-a12e-4e4b-b730-358b8410d78a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:23.123286 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-348f31f0-a12e-4e4b-b730-358b8410d78a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:23.123737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-348f31f0-a12e-4e4b-b730-358b8410d78a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:23.124523 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-348f31f0-a12e-4e4b-b730-358b8410d78a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:23.124963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-348f31f0-a12e-4e4b-b730-358b8410d78a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:23.153757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-348f31f0-a12e-4e4b-b730-358b8410d78a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041495 Apr 07 13:12:23.154234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 546/975] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:23 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:24.165786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c290a6a0-0a77-4438-8997-48964ed42a97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:24.166712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c290a6a0-0a77-4438-8997-48964ed42a97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:24.173052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c290a6a0-0a77-4438-8997-48964ed42a97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:24.173501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c290a6a0-0a77-4438-8997-48964ed42a97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:24.174262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c290a6a0-0a77-4438-8997-48964ed42a97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:24.174694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c290a6a0-0a77-4438-8997-48964ed42a97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:24.202588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c290a6a0-0a77-4438-8997-48964ed42a97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040726 Apr 07 13:12:24.203133 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 430/976] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:24 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:25.214213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8e52e0b1-abdb-40c7-8075-e3303528faa8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:25.215148 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8e52e0b1-abdb-40c7-8075-e3303528faa8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:25.221408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8e52e0b1-abdb-40c7-8075-e3303528faa8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:25.221861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8e52e0b1-abdb-40c7-8075-e3303528faa8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:25.222619 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8e52e0b1-abdb-40c7-8075-e3303528faa8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:25.223085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8e52e0b1-abdb-40c7-8075-e3303528faa8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:25.250944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8e52e0b1-abdb-40c7-8075-e3303528faa8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040724 Apr 07 13:12:25.251482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 547/977] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:25 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:26.263144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fdb56d37-f5fe-4f81-b82f-170f520fd94a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:26.264085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fdb56d37-f5fe-4f81-b82f-170f520fd94a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:26.271078 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdb56d37-f5fe-4f81-b82f-170f520fd94a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:26.271537 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdb56d37-f5fe-4f81-b82f-170f520fd94a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:26.272345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdb56d37-f5fe-4f81-b82f-170f520fd94a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:26.272783 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdb56d37-f5fe-4f81-b82f-170f520fd94a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:26.301322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fdb56d37-f5fe-4f81-b82f-170f520fd94a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042044 Apr 07 13:12:26.301883 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 431/978] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:26 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:27.312169 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fe8d7c2d-b04e-4152-8c0f-706ff556ff64 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:27.313155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fe8d7c2d-b04e-4152-8c0f-706ff556ff64 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:27.319626 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe8d7c2d-b04e-4152-8c0f-706ff556ff64 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:27.320081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe8d7c2d-b04e-4152-8c0f-706ff556ff64 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:27.320872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe8d7c2d-b04e-4152-8c0f-706ff556ff64 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:27.321308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe8d7c2d-b04e-4152-8c0f-706ff556ff64 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:27.350523 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fe8d7c2d-b04e-4152-8c0f-706ff556ff64 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042310 Apr 07 13:12:27.351072 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 548/979] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:12:28.361074 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a7a990c9-c3df-4580-bd76-21f8a16d0c4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:28.362007 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a7a990c9-c3df-4580-bd76-21f8a16d0c4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:28.368840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a7a990c9-c3df-4580-bd76-21f8a16d0c4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:28.369295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a7a990c9-c3df-4580-bd76-21f8a16d0c4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:28.370069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a7a990c9-c3df-4580-bd76-21f8a16d0c4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:28.370511 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a7a990c9-c3df-4580-bd76-21f8a16d0c4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:28.398348 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a7a990c9-c3df-4580-bd76-21f8a16d0c4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041205 Apr 07 13:12:28.398882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 432/980] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:28 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:29.409996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1c9beec1-2c79-4d64-a011-8ef275ca5305 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:29.411104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1c9beec1-2c79-4d64-a011-8ef275ca5305 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:29.417338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1c9beec1-2c79-4d64-a011-8ef275ca5305 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:29.417788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1c9beec1-2c79-4d64-a011-8ef275ca5305 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:29.418551 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1c9beec1-2c79-4d64-a011-8ef275ca5305 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:29.418987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1c9beec1-2c79-4d64-a011-8ef275ca5305 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:29.447895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1c9beec1-2c79-4d64-a011-8ef275ca5305 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042079 Apr 07 13:12:29.448493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 549/981] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:29 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:30.459959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cf5d02b5-584e-44ac-a8d0-9e8ebd100874 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:30.460933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cf5d02b5-584e-44ac-a8d0-9e8ebd100874 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:30.467147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf5d02b5-584e-44ac-a8d0-9e8ebd100874 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:30.467601 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf5d02b5-584e-44ac-a8d0-9e8ebd100874 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:30.468384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf5d02b5-584e-44ac-a8d0-9e8ebd100874 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:30.468828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf5d02b5-584e-44ac-a8d0-9e8ebd100874 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:30.497545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cf5d02b5-584e-44ac-a8d0-9e8ebd100874 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042018 Apr 07 13:12:30.498139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 433/982] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:30 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:31.509572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ede1c3e6-9a00-453b-a586-096c4cc923f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:31.510520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ede1c3e6-9a00-453b-a586-096c4cc923f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:31.516710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ede1c3e6-9a00-453b-a586-096c4cc923f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:31.517158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ede1c3e6-9a00-453b-a586-096c4cc923f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:31.517938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ede1c3e6-9a00-453b-a586-096c4cc923f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:31.518373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ede1c3e6-9a00-453b-a586-096c4cc923f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:31.547431 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ede1c3e6-9a00-453b-a586-096c4cc923f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041849 Apr 07 13:12:31.547962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 550/983] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:31 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:32.559054 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8d5bedab-5e80-4ab7-861c-53d6448a5fe0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:32.559973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8d5bedab-5e80-4ab7-861c-53d6448a5fe0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:32.566289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d5bedab-5e80-4ab7-861c-53d6448a5fe0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:32.566923 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d5bedab-5e80-4ab7-861c-53d6448a5fe0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:32.567609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d5bedab-5e80-4ab7-861c-53d6448a5fe0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:32.568044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d5bedab-5e80-4ab7-861c-53d6448a5fe0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:32.596511 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8d5bedab-5e80-4ab7-861c-53d6448a5fe0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041435 Apr 07 13:12:32.597072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 434/984] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:33.608110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2a09a294-045e-4225-a460-003af22f33a6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:33.609076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2a09a294-045e-4225-a460-003af22f33a6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:33.615419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2a09a294-045e-4225-a460-003af22f33a6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:33.615902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2a09a294-045e-4225-a460-003af22f33a6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:33.616704 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2a09a294-045e-4225-a460-003af22f33a6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:33.617136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2a09a294-045e-4225-a460-003af22f33a6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:33.646119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2a09a294-045e-4225-a460-003af22f33a6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041907 Apr 07 13:12:33.646669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 551/985] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:33 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:34.657614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-658a046b-b31d-4f06-a10e-378521a4aed8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:34.658539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-658a046b-b31d-4f06-a10e-378521a4aed8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:34.665061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-658a046b-b31d-4f06-a10e-378521a4aed8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:34.665526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-658a046b-b31d-4f06-a10e-378521a4aed8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:34.666293 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-658a046b-b31d-4f06-a10e-378521a4aed8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:34.666730 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-658a046b-b31d-4f06-a10e-378521a4aed8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:34.694895 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-658a046b-b31d-4f06-a10e-378521a4aed8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041223 Apr 07 13:12:34.695433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 435/986] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:34 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:35.706202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-83a15cd5-a816-4ee4-bd40-2d908f405cf8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:35.707422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-83a15cd5-a816-4ee4-bd40-2d908f405cf8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:35.713817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-83a15cd5-a816-4ee4-bd40-2d908f405cf8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:35.714298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-83a15cd5-a816-4ee4-bd40-2d908f405cf8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:35.715085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-83a15cd5-a816-4ee4-bd40-2d908f405cf8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:35.715519 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-83a15cd5-a816-4ee4-bd40-2d908f405cf8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:35.743366 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-83a15cd5-a816-4ee4-bd40-2d908f405cf8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041091 Apr 07 13:12:35.743901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 552/987] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:35 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:36.755586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f1cdc24f-958d-4e1e-bc78-6dc50ef06948 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:36.756634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f1cdc24f-958d-4e1e-bc78-6dc50ef06948 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:36.762920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1cdc24f-958d-4e1e-bc78-6dc50ef06948 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:36.763368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1cdc24f-958d-4e1e-bc78-6dc50ef06948 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:36.764129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1cdc24f-958d-4e1e-bc78-6dc50ef06948 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:36.764592 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1cdc24f-958d-4e1e-bc78-6dc50ef06948 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:36.793619 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f1cdc24f-958d-4e1e-bc78-6dc50ef06948 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042935 Apr 07 13:12:36.794152 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 436/988] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:36 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:37.805782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8c2f44c0-ce2a-4c56-9c0e-4761491b534c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:37.806710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8c2f44c0-ce2a-4c56-9c0e-4761491b534c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:37.812968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8c2f44c0-ce2a-4c56-9c0e-4761491b534c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:37.813422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8c2f44c0-ce2a-4c56-9c0e-4761491b534c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:37.814186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8c2f44c0-ce2a-4c56-9c0e-4761491b534c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:37.814626 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8c2f44c0-ce2a-4c56-9c0e-4761491b534c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:37.843724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8c2f44c0-ce2a-4c56-9c0e-4761491b534c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041903 Apr 07 13:12:37.844222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 553/989] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:38.855006 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f5d2f39f-a92c-4a76-9671-fd9a4d80e94f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:38.855972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f5d2f39f-a92c-4a76-9671-fd9a4d80e94f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:38.862217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5d2f39f-a92c-4a76-9671-fd9a4d80e94f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:38.862666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5d2f39f-a92c-4a76-9671-fd9a4d80e94f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:38.864072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5d2f39f-a92c-4a76-9671-fd9a4d80e94f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:38.864556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5d2f39f-a92c-4a76-9671-fd9a4d80e94f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:38.892783 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f5d2f39f-a92c-4a76-9671-fd9a4d80e94f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041757 Apr 07 13:12:38.893315 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 437/990] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:39.904083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-037c2fbe-2920-46f0-bfca-632b215c4310 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:39.905037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-037c2fbe-2920-46f0-bfca-632b215c4310 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:39.912012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-037c2fbe-2920-46f0-bfca-632b215c4310 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:39.912491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-037c2fbe-2920-46f0-bfca-632b215c4310 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:39.913260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-037c2fbe-2920-46f0-bfca-632b215c4310 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:39.913706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-037c2fbe-2920-46f0-bfca-632b215c4310 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:39.941797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-037c2fbe-2920-46f0-bfca-632b215c4310 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041132 Apr 07 13:12:39.942341 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 554/991] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:39 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:40.953128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fb9f0b83-84fb-4795-9a9a-01b07fa68bdf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:40.954103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fb9f0b83-84fb-4795-9a9a-01b07fa68bdf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:40.961112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb9f0b83-84fb-4795-9a9a-01b07fa68bdf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:40.961572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb9f0b83-84fb-4795-9a9a-01b07fa68bdf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:40.962350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb9f0b83-84fb-4795-9a9a-01b07fa68bdf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:40.962794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb9f0b83-84fb-4795-9a9a-01b07fa68bdf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:40.990992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fb9f0b83-84fb-4795-9a9a-01b07fa68bdf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041815 Apr 07 13:12:40.991536 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 438/992] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:40 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:42.002210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ed5d3fe0-53c1-4cce-b14f-e780a3e09ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:42.003122 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ed5d3fe0-53c1-4cce-b14f-e780a3e09ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:42.009803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ed5d3fe0-53c1-4cce-b14f-e780a3e09ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:42.010253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ed5d3fe0-53c1-4cce-b14f-e780a3e09ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:42.011001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ed5d3fe0-53c1-4cce-b14f-e780a3e09ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:42.011433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ed5d3fe0-53c1-4cce-b14f-e780a3e09ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:42.039670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ed5d3fe0-53c1-4cce-b14f-e780a3e09ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041318 Apr 07 13:12:42.040237 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 555/993] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:41 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:43.051640 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7705c877-05c6-484c-8b7e-ad90f059cdb7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:43.052599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7705c877-05c6-484c-8b7e-ad90f059cdb7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:43.058842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7705c877-05c6-484c-8b7e-ad90f059cdb7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:43.059295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7705c877-05c6-484c-8b7e-ad90f059cdb7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:43.060064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7705c877-05c6-484c-8b7e-ad90f059cdb7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:43.060526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7705c877-05c6-484c-8b7e-ad90f059cdb7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:43.088612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7705c877-05c6-484c-8b7e-ad90f059cdb7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041366 Apr 07 13:12:43.089156 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 439/994] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:43 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:44.100063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f8bcc4d6-8beb-4ad7-935f-b5efff96dcfe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:44.101171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f8bcc4d6-8beb-4ad7-935f-b5efff96dcfe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:44.107488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8bcc4d6-8beb-4ad7-935f-b5efff96dcfe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:44.107937 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8bcc4d6-8beb-4ad7-935f-b5efff96dcfe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:44.108735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8bcc4d6-8beb-4ad7-935f-b5efff96dcfe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:44.109168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8bcc4d6-8beb-4ad7-935f-b5efff96dcfe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:44.139207 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f8bcc4d6-8beb-4ad7-935f-b5efff96dcfe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043088 Apr 07 13:12:44.139772 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 556/995] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:44 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:45.151218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eb2903fe-a81e-423e-90b2-d57df8324cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:45.152290 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-eb2903fe-a81e-423e-90b2-d57df8324cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:45.158539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb2903fe-a81e-423e-90b2-d57df8324cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:45.159236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb2903fe-a81e-423e-90b2-d57df8324cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:45.160724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb2903fe-a81e-423e-90b2-d57df8324cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:45.161162 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb2903fe-a81e-423e-90b2-d57df8324cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:45.188802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eb2903fe-a81e-423e-90b2-d57df8324cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041476 Apr 07 13:12:45.189338 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 440/996] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:45 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:46.201150 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-072b4f43-96bd-4eda-a2a4-d713e98257d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:46.202073 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-072b4f43-96bd-4eda-a2a4-d713e98257d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:46.208685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-072b4f43-96bd-4eda-a2a4-d713e98257d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:46.209141 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-072b4f43-96bd-4eda-a2a4-d713e98257d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:46.209910 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-072b4f43-96bd-4eda-a2a4-d713e98257d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:46.210346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-072b4f43-96bd-4eda-a2a4-d713e98257d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:46.238140 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-072b4f43-96bd-4eda-a2a4-d713e98257d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040390 Apr 07 13:12:46.238694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 557/997] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:46 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:47.249454 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4dd841f9-bf8a-4946-8245-9a51d7649422 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:47.250379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4dd841f9-bf8a-4946-8245-9a51d7649422 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:47.256858 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4dd841f9-bf8a-4946-8245-9a51d7649422 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:47.257404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4dd841f9-bf8a-4946-8245-9a51d7649422 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:47.258171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4dd841f9-bf8a-4946-8245-9a51d7649422 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:47.258605 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4dd841f9-bf8a-4946-8245-9a51d7649422 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:47.287605 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4dd841f9-bf8a-4946-8245-9a51d7649422 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042070 Apr 07 13:12:47.288160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 441/998] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:47 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:48.298840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3c61aef9-ed71-43a8-93af-fdbbcfb9a660 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:48.299769 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3c61aef9-ed71-43a8-93af-fdbbcfb9a660 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:48.307568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c61aef9-ed71-43a8-93af-fdbbcfb9a660 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:48.308017 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c61aef9-ed71-43a8-93af-fdbbcfb9a660 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:48.308847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c61aef9-ed71-43a8-93af-fdbbcfb9a660 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:48.309286 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c61aef9-ed71-43a8-93af-fdbbcfb9a660 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:48.337509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3c61aef9-ed71-43a8-93af-fdbbcfb9a660 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Apr 07 13:12:48.338058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 558/999] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:48 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:49.348224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7f834b78-83e2-43de-8b0e-b5d7f40c6461 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:49.349086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7f834b78-83e2-43de-8b0e-b5d7f40c6461 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:49.355251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7f834b78-83e2-43de-8b0e-b5d7f40c6461 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:49.355709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7f834b78-83e2-43de-8b0e-b5d7f40c6461 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:49.356486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7f834b78-83e2-43de-8b0e-b5d7f40c6461 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:49.356927 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7f834b78-83e2-43de-8b0e-b5d7f40c6461 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:49.385030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7f834b78-83e2-43de-8b0e-b5d7f40c6461 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040907 Apr 07 13:12:49.385562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 442/1000] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:49 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:50.396100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-14f41a9d-02f7-4bb8-af4e-3673281e4de1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:50.397182 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-14f41a9d-02f7-4bb8-af4e-3673281e4de1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:50.403613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14f41a9d-02f7-4bb8-af4e-3673281e4de1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:50.404063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14f41a9d-02f7-4bb8-af4e-3673281e4de1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:50.404904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14f41a9d-02f7-4bb8-af4e-3673281e4de1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:50.405345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14f41a9d-02f7-4bb8-af4e-3673281e4de1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:50.434637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-14f41a9d-02f7-4bb8-af4e-3673281e4de1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043081 Apr 07 13:12:50.436787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 559/1001] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:51.446102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-acaf6dbe-99fa-4b92-a653-53f2d352f23c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:51.447057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-acaf6dbe-99fa-4b92-a653-53f2d352f23c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:51.453321 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-acaf6dbe-99fa-4b92-a653-53f2d352f23c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:51.453780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-acaf6dbe-99fa-4b92-a653-53f2d352f23c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:51.454555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-acaf6dbe-99fa-4b92-a653-53f2d352f23c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:51.454993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-acaf6dbe-99fa-4b92-a653-53f2d352f23c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:51.484844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-acaf6dbe-99fa-4b92-a653-53f2d352f23c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Apr 07 13:12:51.485414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 443/1002] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:51 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:52.496544 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6f51511a-27e1-4e92-9849-a71e6d431ea8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:52.497479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6f51511a-27e1-4e92-9849-a71e6d431ea8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:52.503432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f51511a-27e1-4e92-9849-a71e6d431ea8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:52.503923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f51511a-27e1-4e92-9849-a71e6d431ea8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:52.504721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f51511a-27e1-4e92-9849-a71e6d431ea8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:52.505166 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f51511a-27e1-4e92-9849-a71e6d431ea8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:52.533180 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6f51511a-27e1-4e92-9849-a71e6d431ea8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040744 Apr 07 13:12:52.533736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 560/1003] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:52 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:53.545304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1d04d64c-a948-423c-96f7-ce060b81ab62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:53.546284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1d04d64c-a948-423c-96f7-ce060b81ab62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:53.552539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1d04d64c-a948-423c-96f7-ce060b81ab62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:53.552996 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1d04d64c-a948-423c-96f7-ce060b81ab62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:53.553771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1d04d64c-a948-423c-96f7-ce060b81ab62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:53.554207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1d04d64c-a948-423c-96f7-ce060b81ab62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:53.582268 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1d04d64c-a948-423c-96f7-ce060b81ab62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040262 Apr 07 13:12:53.583099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 444/1004] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:53 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:54.593628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b7603ffb-154d-4b3b-b141-df839d7c8cae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:54.594551 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b7603ffb-154d-4b3b-b141-df839d7c8cae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:54.601636 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b7603ffb-154d-4b3b-b141-df839d7c8cae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:54.602085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b7603ffb-154d-4b3b-b141-df839d7c8cae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:54.602842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b7603ffb-154d-4b3b-b141-df839d7c8cae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:54.603275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b7603ffb-154d-4b3b-b141-df839d7c8cae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:54.633528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b7603ffb-154d-4b3b-b141-df839d7c8cae tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Apr 07 13:12:54.634081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 561/1005] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:54 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:55.644978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-57704674-05ba-4f5d-9db3-4980771ad4d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:55.645919 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-57704674-05ba-4f5d-9db3-4980771ad4d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:55.652240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57704674-05ba-4f5d-9db3-4980771ad4d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:55.652695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57704674-05ba-4f5d-9db3-4980771ad4d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:55.653462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57704674-05ba-4f5d-9db3-4980771ad4d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:55.653903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57704674-05ba-4f5d-9db3-4980771ad4d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:55.682864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-57704674-05ba-4f5d-9db3-4980771ad4d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041802 Apr 07 13:12:55.683413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 445/1006] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:55 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:56.694782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-33e00e2e-ab0a-4001-b665-dc5666b3e085 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:56.695772 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-33e00e2e-ab0a-4001-b665-dc5666b3e085 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:56.702010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33e00e2e-ab0a-4001-b665-dc5666b3e085 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:56.702461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33e00e2e-ab0a-4001-b665-dc5666b3e085 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:56.703218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33e00e2e-ab0a-4001-b665-dc5666b3e085 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:56.703647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33e00e2e-ab0a-4001-b665-dc5666b3e085 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:56.730860 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-33e00e2e-ab0a-4001-b665-dc5666b3e085 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040795 Apr 07 13:12:56.731397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 562/1007] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:56 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:57.742551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-306f86af-6eb0-45ab-b0a3-8b421324b886 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:57.744161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-306f86af-6eb0-45ab-b0a3-8b421324b886 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:57.750769 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-306f86af-6eb0-45ab-b0a3-8b421324b886 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:57.751230 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-306f86af-6eb0-45ab-b0a3-8b421324b886 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:57.752000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-306f86af-6eb0-45ab-b0a3-8b421324b886 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:57.752462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-306f86af-6eb0-45ab-b0a3-8b421324b886 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:57.780897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-306f86af-6eb0-45ab-b0a3-8b421324b886 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042332 Apr 07 13:12:57.781483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 446/1008] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:58.793033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e33b6504-873b-43b8-959d-b6e5f48ab6a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:58.793957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e33b6504-873b-43b8-959d-b6e5f48ab6a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:58.800953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e33b6504-873b-43b8-959d-b6e5f48ab6a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:58.801399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e33b6504-873b-43b8-959d-b6e5f48ab6a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:58.802150 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e33b6504-873b-43b8-959d-b6e5f48ab6a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:58.802582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e33b6504-873b-43b8-959d-b6e5f48ab6a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:58.830862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e33b6504-873b-43b8-959d-b6e5f48ab6a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041691 Apr 07 13:12:58.831511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 563/1009] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:12:59.842311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b3e29b70-ad42-4fb9-88f3-be3fe0b608d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:12:59.843181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b3e29b70-ad42-4fb9-88f3-be3fe0b608d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:12:59.850115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3e29b70-ad42-4fb9-88f3-be3fe0b608d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:59.850569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3e29b70-ad42-4fb9-88f3-be3fe0b608d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:59.851333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3e29b70-ad42-4fb9-88f3-be3fe0b608d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:12:59.851772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3e29b70-ad42-4fb9-88f3-be3fe0b608d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:12:59.879917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b3e29b70-ad42-4fb9-88f3-be3fe0b608d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041488 Apr 07 13:12:59.880485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 447/1010] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:12:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:00.890723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2c9e2ae5-c768-4abc-ae21-571ea77602dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:00.891653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2c9e2ae5-c768-4abc-ae21-571ea77602dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:00.898619 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c9e2ae5-c768-4abc-ae21-571ea77602dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:00.899070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c9e2ae5-c768-4abc-ae21-571ea77602dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:00.899831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c9e2ae5-c768-4abc-ae21-571ea77602dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:00.900303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c9e2ae5-c768-4abc-ae21-571ea77602dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:00.928298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2c9e2ae5-c768-4abc-ae21-571ea77602dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041441 Apr 07 13:13:00.928843 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 564/1011] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:00 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:01.939213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e42ab7a1-d604-451c-a2e3-8bfeaa39d04b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:01.940171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e42ab7a1-d604-451c-a2e3-8bfeaa39d04b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:01.946501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e42ab7a1-d604-451c-a2e3-8bfeaa39d04b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:01.946950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e42ab7a1-d604-451c-a2e3-8bfeaa39d04b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:01.947709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e42ab7a1-d604-451c-a2e3-8bfeaa39d04b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:01.948159 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e42ab7a1-d604-451c-a2e3-8bfeaa39d04b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:01.976623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e42ab7a1-d604-451c-a2e3-8bfeaa39d04b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041265 Apr 07 13:13:01.977158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 448/1012] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:01 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:02.988605 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3b3edc73-900d-4881-a271-240c8abf59e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:02.989542 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3b3edc73-900d-4881-a271-240c8abf59e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:02.995781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b3edc73-900d-4881-a271-240c8abf59e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:02.996272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b3edc73-900d-4881-a271-240c8abf59e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:02.997039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b3edc73-900d-4881-a271-240c8abf59e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:02.997475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b3edc73-900d-4881-a271-240c8abf59e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:03.025055 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3b3edc73-900d-4881-a271-240c8abf59e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041063 Apr 07 13:13:03.025598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 565/1013] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:02 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:04.037436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-25773dd0-ff2f-45f4-96e4-4a39cd67ab74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:04.038397 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-25773dd0-ff2f-45f4-96e4-4a39cd67ab74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:04.049197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25773dd0-ff2f-45f4-96e4-4a39cd67ab74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:04.049197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25773dd0-ff2f-45f4-96e4-4a39cd67ab74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:04.049197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25773dd0-ff2f-45f4-96e4-4a39cd67ab74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:04.049197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25773dd0-ff2f-45f4-96e4-4a39cd67ab74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:04.076221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-25773dd0-ff2f-45f4-96e4-4a39cd67ab74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Apr 07 13:13:04.076787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 449/1014] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:04 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:05.087089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-515be985-b92f-4658-bc27-5b25a24edeea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:05.088008 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-515be985-b92f-4658-bc27-5b25a24edeea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:05.094162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-515be985-b92f-4658-bc27-5b25a24edeea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:05.094614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-515be985-b92f-4658-bc27-5b25a24edeea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:05.095369 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-515be985-b92f-4658-bc27-5b25a24edeea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:05.095800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-515be985-b92f-4658-bc27-5b25a24edeea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:05.124492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-515be985-b92f-4658-bc27-5b25a24edeea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041174 Apr 07 13:13:05.125084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 566/1015] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:05 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:06.140863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-67aa3a0f-3897-463d-9691-75759122023c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:06.141800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-67aa3a0f-3897-463d-9691-75759122023c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:06.148044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-67aa3a0f-3897-463d-9691-75759122023c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:06.148537 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-67aa3a0f-3897-463d-9691-75759122023c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:06.149310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-67aa3a0f-3897-463d-9691-75759122023c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:06.149746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-67aa3a0f-3897-463d-9691-75759122023c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:06.178534 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-67aa3a0f-3897-463d-9691-75759122023c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041736 Apr 07 13:13:06.179070 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 450/1016] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:06 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:07.189931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7a3981f3-68bf-4675-add7-be3826d4145a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:07.191483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7a3981f3-68bf-4675-add7-be3826d4145a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:07.197692 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7a3981f3-68bf-4675-add7-be3826d4145a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:07.198153 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7a3981f3-68bf-4675-add7-be3826d4145a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:07.198912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7a3981f3-68bf-4675-add7-be3826d4145a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:07.199354 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7a3981f3-68bf-4675-add7-be3826d4145a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:07.227229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7a3981f3-68bf-4675-add7-be3826d4145a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 Apr 07 13:13:07.227778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 567/1017] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:07 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:08.239209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-206b3e17-335a-4945-8c78-9150cc610945 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:08.240163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-206b3e17-335a-4945-8c78-9150cc610945 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:08.246594 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-206b3e17-335a-4945-8c78-9150cc610945 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:08.247049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-206b3e17-335a-4945-8c78-9150cc610945 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:08.247820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-206b3e17-335a-4945-8c78-9150cc610945 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:08.248294 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-206b3e17-335a-4945-8c78-9150cc610945 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:08.276020 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-206b3e17-335a-4945-8c78-9150cc610945 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041390 Apr 07 13:13:08.276594 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 451/1018] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:08 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:09.287838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-48767cd5-57c1-4c3d-91b1-ffe50ccb1003 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:09.288797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-48767cd5-57c1-4c3d-91b1-ffe50ccb1003 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:09.294988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-48767cd5-57c1-4c3d-91b1-ffe50ccb1003 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:09.295454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-48767cd5-57c1-4c3d-91b1-ffe50ccb1003 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:09.296248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-48767cd5-57c1-4c3d-91b1-ffe50ccb1003 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:09.296689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-48767cd5-57c1-4c3d-91b1-ffe50ccb1003 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:09.325358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-48767cd5-57c1-4c3d-91b1-ffe50ccb1003 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042421 Apr 07 13:13:09.325903 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 568/1019] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:09 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:10.339291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3d64b037-191d-41df-bfaa-89d9348986fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:10.340460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3d64b037-191d-41df-bfaa-89d9348986fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:10.347904 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d64b037-191d-41df-bfaa-89d9348986fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:10.348481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d64b037-191d-41df-bfaa-89d9348986fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:10.349275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d64b037-191d-41df-bfaa-89d9348986fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:10.349719 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d64b037-191d-41df-bfaa-89d9348986fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:10.387390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3d64b037-191d-41df-bfaa-89d9348986fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053813 Apr 07 13:13:10.388240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 452/1020] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:10 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:11.400083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-578258a2-9447-4784-bb95-e73c114d06db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:11.401022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-578258a2-9447-4784-bb95-e73c114d06db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:11.407321 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-578258a2-9447-4784-bb95-e73c114d06db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:11.407724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-578258a2-9447-4784-bb95-e73c114d06db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:11.408650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-578258a2-9447-4784-bb95-e73c114d06db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:11.409844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-578258a2-9447-4784-bb95-e73c114d06db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:11.438162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-578258a2-9447-4784-bb95-e73c114d06db tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 Apr 07 13:13:11.438713 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 569/1021] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:11 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:12.451105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8fd7a414-d1a2-414a-a3a4-2e7cf474b23b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:12.452050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8fd7a414-d1a2-414a-a3a4-2e7cf474b23b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:12.459687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8fd7a414-d1a2-414a-a3a4-2e7cf474b23b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:12.460190 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8fd7a414-d1a2-414a-a3a4-2e7cf474b23b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:12.460964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8fd7a414-d1a2-414a-a3a4-2e7cf474b23b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:12.461397 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8fd7a414-d1a2-414a-a3a4-2e7cf474b23b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:12.492531 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8fd7a414-d1a2-414a-a3a4-2e7cf474b23b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046484 Apr 07 13:13:12.493112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 453/1022] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:12 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:13.506809 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-71b3c48d-b717-4b7f-9109-7beda945fbd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:13.507830 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-71b3c48d-b717-4b7f-9109-7beda945fbd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:13.514011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-71b3c48d-b717-4b7f-9109-7beda945fbd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:13.514463 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-71b3c48d-b717-4b7f-9109-7beda945fbd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:13.515220 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-71b3c48d-b717-4b7f-9109-7beda945fbd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:13.515654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-71b3c48d-b717-4b7f-9109-7beda945fbd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:13.544614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-71b3c48d-b717-4b7f-9109-7beda945fbd3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041827 Apr 07 13:13:13.545162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 570/1023] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:13 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:14.556745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1429958c-4d8c-476a-a62f-0fbb08df646c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:14.557680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1429958c-4d8c-476a-a62f-0fbb08df646c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:14.563873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1429958c-4d8c-476a-a62f-0fbb08df646c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:14.564363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1429958c-4d8c-476a-a62f-0fbb08df646c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:14.565133 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1429958c-4d8c-476a-a62f-0fbb08df646c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:14.566252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1429958c-4d8c-476a-a62f-0fbb08df646c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:14.594462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1429958c-4d8c-476a-a62f-0fbb08df646c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041811 Apr 07 13:13:14.595013 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 454/1024] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:14 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:15.605682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a3235fe5-0586-49ef-8d41-e771a1dc8574 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:15.606609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a3235fe5-0586-49ef-8d41-e771a1dc8574 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:15.613386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a3235fe5-0586-49ef-8d41-e771a1dc8574 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:15.613951 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a3235fe5-0586-49ef-8d41-e771a1dc8574 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:15.614722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a3235fe5-0586-49ef-8d41-e771a1dc8574 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:15.615160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a3235fe5-0586-49ef-8d41-e771a1dc8574 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:15.644808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a3235fe5-0586-49ef-8d41-e771a1dc8574 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042937 Apr 07 13:13:15.645375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 571/1025] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:15 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:16.656120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4ed526c9-23d7-4095-89db-af86441d2e06 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:16.657209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4ed526c9-23d7-4095-89db-af86441d2e06 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:16.663810 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ed526c9-23d7-4095-89db-af86441d2e06 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:16.664303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ed526c9-23d7-4095-89db-af86441d2e06 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:16.665070 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ed526c9-23d7-4095-89db-af86441d2e06 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:16.665503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ed526c9-23d7-4095-89db-af86441d2e06 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:16.693939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4ed526c9-23d7-4095-89db-af86441d2e06 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 Apr 07 13:13:16.694471 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 455/1026] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:16 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:17.705284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9520dcd1-5cdb-4c51-89ae-1f90ef69b8c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:17.706792 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9520dcd1-5cdb-4c51-89ae-1f90ef69b8c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:17.713036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9520dcd1-5cdb-4c51-89ae-1f90ef69b8c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:17.713480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9520dcd1-5cdb-4c51-89ae-1f90ef69b8c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:17.714236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9520dcd1-5cdb-4c51-89ae-1f90ef69b8c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:17.714666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9520dcd1-5cdb-4c51-89ae-1f90ef69b8c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:17.744349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9520dcd1-5cdb-4c51-89ae-1f90ef69b8c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042969 Apr 07 13:13:17.747987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 572/1027] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:17 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:18.755882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bfc949dd-6a89-4a2e-b096-0b2ba47422a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:18.756874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bfc949dd-6a89-4a2e-b096-0b2ba47422a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:18.763118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bfc949dd-6a89-4a2e-b096-0b2ba47422a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:18.763602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bfc949dd-6a89-4a2e-b096-0b2ba47422a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:18.764408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bfc949dd-6a89-4a2e-b096-0b2ba47422a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:18.764848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bfc949dd-6a89-4a2e-b096-0b2ba47422a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:18.793864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bfc949dd-6a89-4a2e-b096-0b2ba47422a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042508 Apr 07 13:13:18.794413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 456/1028] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:19.805304 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8424c31a-eaa4-4e37-b1f8-4bbef0a52a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:19.806236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8424c31a-eaa4-4e37-b1f8-4bbef0a52a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:19.812523 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8424c31a-eaa4-4e37-b1f8-4bbef0a52a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:19.812981 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8424c31a-eaa4-4e37-b1f8-4bbef0a52a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:19.813751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8424c31a-eaa4-4e37-b1f8-4bbef0a52a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:19.814192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8424c31a-eaa4-4e37-b1f8-4bbef0a52a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:19.842878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8424c31a-eaa4-4e37-b1f8-4bbef0a52a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041425 Apr 07 13:13:19.843430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 573/1029] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:19 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:20.853730 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-15fb7d4c-df1e-4237-96b2-e0964b7218f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:20.854743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-15fb7d4c-df1e-4237-96b2-e0964b7218f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:20.861199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-15fb7d4c-df1e-4237-96b2-e0964b7218f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:20.861654 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-15fb7d4c-df1e-4237-96b2-e0964b7218f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:20.863110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-15fb7d4c-df1e-4237-96b2-e0964b7218f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:20.863557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-15fb7d4c-df1e-4237-96b2-e0964b7218f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:20.893630 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-15fb7d4c-df1e-4237-96b2-e0964b7218f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Apr 07 13:13:20.894289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 457/1030] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:20 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:21.905415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-246496c1-1ed1-4f21-9683-4433fa5f1f36 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:21.906401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-246496c1-1ed1-4f21-9683-4433fa5f1f36 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:21.913451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-246496c1-1ed1-4f21-9683-4433fa5f1f36 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:21.913970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-246496c1-1ed1-4f21-9683-4433fa5f1f36 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:21.914807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-246496c1-1ed1-4f21-9683-4433fa5f1f36 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:21.915245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-246496c1-1ed1-4f21-9683-4433fa5f1f36 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:21.943872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-246496c1-1ed1-4f21-9683-4433fa5f1f36 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042686 Apr 07 13:13:21.944453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 574/1031] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:21 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:22.955088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-acbb64a6-be92-49e4-a1ff-ce3cbb32e8fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:22.956045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-acbb64a6-be92-49e4-a1ff-ce3cbb32e8fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:22.962689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-acbb64a6-be92-49e4-a1ff-ce3cbb32e8fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:22.963152 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-acbb64a6-be92-49e4-a1ff-ce3cbb32e8fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:22.963937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-acbb64a6-be92-49e4-a1ff-ce3cbb32e8fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:22.964408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-acbb64a6-be92-49e4-a1ff-ce3cbb32e8fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:22.992860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-acbb64a6-be92-49e4-a1ff-ce3cbb32e8fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041781 Apr 07 13:13:22.993410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 458/1032] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:22 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:24.004621 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-43df9297-a0d0-4299-bbaf-094870c9880f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:24.005703 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-43df9297-a0d0-4299-bbaf-094870c9880f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:24.012191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-43df9297-a0d0-4299-bbaf-094870c9880f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:24.012650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-43df9297-a0d0-4299-bbaf-094870c9880f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:24.013420 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-43df9297-a0d0-4299-bbaf-094870c9880f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:24.013987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-43df9297-a0d0-4299-bbaf-094870c9880f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:24.042798 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-43df9297-a0d0-4299-bbaf-094870c9880f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042520 Apr 07 13:13:24.043203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 575/1033] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:23 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:25.054068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-69db17c1-371c-457c-bd2b-a088d8370b5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:25.054997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-69db17c1-371c-457c-bd2b-a088d8370b5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:25.062392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-69db17c1-371c-457c-bd2b-a088d8370b5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:25.062846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-69db17c1-371c-457c-bd2b-a088d8370b5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:25.063623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-69db17c1-371c-457c-bd2b-a088d8370b5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:25.064043 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-69db17c1-371c-457c-bd2b-a088d8370b5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:25.094650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-69db17c1-371c-457c-bd2b-a088d8370b5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044483 Apr 07 13:13:25.095216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 459/1034] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:25 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:26.106763 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7068d7b6-4ecf-42d1-9da5-04eb84dc136d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:26.107689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7068d7b6-4ecf-42d1-9da5-04eb84dc136d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:26.114565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7068d7b6-4ecf-42d1-9da5-04eb84dc136d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:26.115016 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7068d7b6-4ecf-42d1-9da5-04eb84dc136d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:26.115787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7068d7b6-4ecf-42d1-9da5-04eb84dc136d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:26.116253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7068d7b6-4ecf-42d1-9da5-04eb84dc136d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:26.146519 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7068d7b6-4ecf-42d1-9da5-04eb84dc136d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043553 Apr 07 13:13:26.147061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 576/1035] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:26 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:27.158139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bcb3d2b3-0f8e-46aa-b98c-9fa8b34f6e74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:27.159557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bcb3d2b3-0f8e-46aa-b98c-9fa8b34f6e74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:27.165905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bcb3d2b3-0f8e-46aa-b98c-9fa8b34f6e74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:27.166363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bcb3d2b3-0f8e-46aa-b98c-9fa8b34f6e74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:27.167139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bcb3d2b3-0f8e-46aa-b98c-9fa8b34f6e74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:27.167580 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bcb3d2b3-0f8e-46aa-b98c-9fa8b34f6e74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:27.196642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bcb3d2b3-0f8e-46aa-b98c-9fa8b34f6e74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042374 Apr 07 13:13:27.197385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 460/1036] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:28.209116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-afe88966-28cf-4170-975c-caad0d07d411 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:28.210431 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-afe88966-28cf-4170-975c-caad0d07d411 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:28.217357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afe88966-28cf-4170-975c-caad0d07d411 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:28.217814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afe88966-28cf-4170-975c-caad0d07d411 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:28.218942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afe88966-28cf-4170-975c-caad0d07d411 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:28.219518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afe88966-28cf-4170-975c-caad0d07d411 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:28.248967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-afe88966-28cf-4170-975c-caad0d07d411 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044378 Apr 07 13:13:28.249532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 577/1037] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:28 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:29.260454 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-29580d23-1643-4802-a8a0-ab6c4c25cdc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:29.261385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-29580d23-1643-4802-a8a0-ab6c4c25cdc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:29.267684 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-29580d23-1643-4802-a8a0-ab6c4c25cdc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:29.268168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-29580d23-1643-4802-a8a0-ab6c4c25cdc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:29.268956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-29580d23-1643-4802-a8a0-ab6c4c25cdc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:29.269391 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-29580d23-1643-4802-a8a0-ab6c4c25cdc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:29.298236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-29580d23-1643-4802-a8a0-ab6c4c25cdc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041743 Apr 07 13:13:29.298789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 461/1038] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:29 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:30.310292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7a989a7c-2549-46fa-ba9f-010dfa33f6da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:30.311222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7a989a7c-2549-46fa-ba9f-010dfa33f6da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:30.318048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7a989a7c-2549-46fa-ba9f-010dfa33f6da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:30.318502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7a989a7c-2549-46fa-ba9f-010dfa33f6da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:30.319266 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7a989a7c-2549-46fa-ba9f-010dfa33f6da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:30.319699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7a989a7c-2549-46fa-ba9f-010dfa33f6da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:30.351459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7a989a7c-2549-46fa-ba9f-010dfa33f6da tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045085 Apr 07 13:13:30.352303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 578/1039] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:30 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:31.363346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-25eb84f0-4793-425b-a68f-4539c1f3b989 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:31.365139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-25eb84f0-4793-425b-a68f-4539c1f3b989 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:31.371906 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25eb84f0-4793-425b-a68f-4539c1f3b989 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:31.372415 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25eb84f0-4793-425b-a68f-4539c1f3b989 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:31.373558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25eb84f0-4793-425b-a68f-4539c1f3b989 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:31.373919 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25eb84f0-4793-425b-a68f-4539c1f3b989 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:31.416600 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-25eb84f0-4793-425b-a68f-4539c1f3b989 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057292 Apr 07 13:13:31.420419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 462/1040] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:31 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:32.428854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e06ccf4b-84c4-485a-b598-e728a901bf14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:32.429787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e06ccf4b-84c4-485a-b598-e728a901bf14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:32.436903 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e06ccf4b-84c4-485a-b598-e728a901bf14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:32.437739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e06ccf4b-84c4-485a-b598-e728a901bf14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:32.439007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e06ccf4b-84c4-485a-b598-e728a901bf14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:32.439458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e06ccf4b-84c4-485a-b598-e728a901bf14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:32.469642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e06ccf4b-84c4-485a-b598-e728a901bf14 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045780 Apr 07 13:13:32.470201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 579/1041] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:33.481037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0a153a20-5667-4855-b64b-a58ab3c2be3b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:33.481972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0a153a20-5667-4855-b64b-a58ab3c2be3b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:33.488539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a153a20-5667-4855-b64b-a58ab3c2be3b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:33.488909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a153a20-5667-4855-b64b-a58ab3c2be3b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:33.489680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a153a20-5667-4855-b64b-a58ab3c2be3b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:33.490123 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a153a20-5667-4855-b64b-a58ab3c2be3b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:33.520489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0a153a20-5667-4855-b64b-a58ab3c2be3b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043236 Apr 07 13:13:33.521048 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 463/1042] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:33 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:34.531831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3d7b6bdf-c85c-41cb-ad68-9c6d0e338b44 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:34.532785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3d7b6bdf-c85c-41cb-ad68-9c6d0e338b44 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:34.539194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d7b6bdf-c85c-41cb-ad68-9c6d0e338b44 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:34.539645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d7b6bdf-c85c-41cb-ad68-9c6d0e338b44 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:34.540428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d7b6bdf-c85c-41cb-ad68-9c6d0e338b44 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:34.540864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d7b6bdf-c85c-41cb-ad68-9c6d0e338b44 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:34.576958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3d7b6bdf-c85c-41cb-ad68-9c6d0e338b44 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048933 Apr 07 13:13:34.577571 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 580/1043] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:34 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:35.589161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7c492e64-59b2-4538-9af2-4f5a69ee4cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:35.590098 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7c492e64-59b2-4538-9af2-4f5a69ee4cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:35.596069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7c492e64-59b2-4538-9af2-4f5a69ee4cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:35.597950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7c492e64-59b2-4538-9af2-4f5a69ee4cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:35.598763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7c492e64-59b2-4538-9af2-4f5a69ee4cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:35.599203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7c492e64-59b2-4538-9af2-4f5a69ee4cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:35.629822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7c492e64-59b2-4538-9af2-4f5a69ee4cf9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044557 Apr 07 13:13:35.630381 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 464/1044] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:35 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:36.766591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-aea94742-2466-4846-b24b-89c4738b8b28 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:36.767500 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-aea94742-2466-4846-b24b-89c4738b8b28 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:36.773458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aea94742-2466-4846-b24b-89c4738b8b28 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:36.773917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aea94742-2466-4846-b24b-89c4738b8b28 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:36.774688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aea94742-2466-4846-b24b-89c4738b8b28 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:36.775126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aea94742-2466-4846-b24b-89c4738b8b28 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:36.805487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-aea94742-2466-4846-b24b-89c4738b8b28 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168207 Apr 07 13:13:36.806034 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 581/1045] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:36 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:37.816467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-52c00b3b-b0a5-4890-ba06-45863a47ca21 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:37.817435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-52c00b3b-b0a5-4890-ba06-45863a47ca21 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:37.823791 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-52c00b3b-b0a5-4890-ba06-45863a47ca21 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:37.824294 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-52c00b3b-b0a5-4890-ba06-45863a47ca21 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:37.825076 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-52c00b3b-b0a5-4890-ba06-45863a47ca21 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:37.825519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-52c00b3b-b0a5-4890-ba06-45863a47ca21 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:37.855250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-52c00b3b-b0a5-4890-ba06-45863a47ca21 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042806 Apr 07 13:13:37.855842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 465/1046] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:38.867252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-55f556a7-21ad-4123-9db5-604638b40e72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:38.868203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-55f556a7-21ad-4123-9db5-604638b40e72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:38.874525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55f556a7-21ad-4123-9db5-604638b40e72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:38.875014 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55f556a7-21ad-4123-9db5-604638b40e72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:38.875800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55f556a7-21ad-4123-9db5-604638b40e72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:38.876259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55f556a7-21ad-4123-9db5-604638b40e72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:38.903873 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-55f556a7-21ad-4123-9db5-604638b40e72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040557 Apr 07 13:13:38.904449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 582/1047] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:13:39.915138 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-030ef920-92f5-44b6-9e9a-458672d91057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:39.916064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-030ef920-92f5-44b6-9e9a-458672d91057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:39.922482 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-030ef920-92f5-44b6-9e9a-458672d91057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:39.922936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-030ef920-92f5-44b6-9e9a-458672d91057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:39.923699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-030ef920-92f5-44b6-9e9a-458672d91057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:39.924285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-030ef920-92f5-44b6-9e9a-458672d91057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:39.951801 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-030ef920-92f5-44b6-9e9a-458672d91057 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040584 Apr 07 13:13:39.952372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 466/1048] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:39 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:40.962987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-676880de-2246-4a20-8fbb-6e86172ed10e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:40.963902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-676880de-2246-4a20-8fbb-6e86172ed10e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:40.970122 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-676880de-2246-4a20-8fbb-6e86172ed10e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:40.970568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-676880de-2246-4a20-8fbb-6e86172ed10e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:40.972596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-676880de-2246-4a20-8fbb-6e86172ed10e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:40.973035 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-676880de-2246-4a20-8fbb-6e86172ed10e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:41.000614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-676880de-2246-4a20-8fbb-6e86172ed10e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041472 Apr 07 13:13:41.001153 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 583/1049] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:40 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:42.012025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-09fd9835-6727-4693-b109-fff87f019536 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:42.012989 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-09fd9835-6727-4693-b109-fff87f019536 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:42.019861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-09fd9835-6727-4693-b109-fff87f019536 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:42.020354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-09fd9835-6727-4693-b109-fff87f019536 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:42.021125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-09fd9835-6727-4693-b109-fff87f019536 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:42.021567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-09fd9835-6727-4693-b109-fff87f019536 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:42.049718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-09fd9835-6727-4693-b109-fff87f019536 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041577 Apr 07 13:13:42.050255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 467/1050] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:42 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:43.061008 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9728635b-5a06-4e99-a86b-de6df6124943 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:43.061940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9728635b-5a06-4e99-a86b-de6df6124943 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:43.068806 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9728635b-5a06-4e99-a86b-de6df6124943 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:43.069292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9728635b-5a06-4e99-a86b-de6df6124943 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:43.070056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9728635b-5a06-4e99-a86b-de6df6124943 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:43.070490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9728635b-5a06-4e99-a86b-de6df6124943 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:43.098330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9728635b-5a06-4e99-a86b-de6df6124943 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041197 Apr 07 13:13:43.098882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 584/1051] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:43 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:44.109803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b9a521ac-bf78-4d68-8bb5-0722dc37e97b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:44.110727 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b9a521ac-bf78-4d68-8bb5-0722dc37e97b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:44.117079 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9a521ac-bf78-4d68-8bb5-0722dc37e97b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:44.117534 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9a521ac-bf78-4d68-8bb5-0722dc37e97b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:44.118294 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9a521ac-bf78-4d68-8bb5-0722dc37e97b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:44.118726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9a521ac-bf78-4d68-8bb5-0722dc37e97b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:44.153579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b9a521ac-bf78-4d68-8bb5-0722dc37e97b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047802 Apr 07 13:13:44.154114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 468/1052] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:44 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:45.165612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-40f5c2f3-ace7-4a14-9bd8-4779af3b84ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:45.166569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-40f5c2f3-ace7-4a14-9bd8-4779af3b84ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:45.172926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40f5c2f3-ace7-4a14-9bd8-4779af3b84ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:45.173374 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40f5c2f3-ace7-4a14-9bd8-4779af3b84ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:45.174206 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40f5c2f3-ace7-4a14-9bd8-4779af3b84ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:45.174611 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-40f5c2f3-ace7-4a14-9bd8-4779af3b84ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:45.202497 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-40f5c2f3-ace7-4a14-9bd8-4779af3b84ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040940 Apr 07 13:13:45.203044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 585/1053] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:45 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:13:46.214637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9c53447e-72cd-4c98-a6a5-2c513cc3ef4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:46.215577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9c53447e-72cd-4c98-a6a5-2c513cc3ef4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:46.222613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c53447e-72cd-4c98-a6a5-2c513cc3ef4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:46.223075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c53447e-72cd-4c98-a6a5-2c513cc3ef4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:46.223855 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c53447e-72cd-4c98-a6a5-2c513cc3ef4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:46.224338 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c53447e-72cd-4c98-a6a5-2c513cc3ef4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:46.252192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9c53447e-72cd-4c98-a6a5-2c513cc3ef4e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041586 Apr 07 13:13:46.252736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 469/1054] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:46 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:47.263574 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ae86ec5f-5191-4a69-954e-62de41e4f5e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:47.264526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ae86ec5f-5191-4a69-954e-62de41e4f5e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:47.271770 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae86ec5f-5191-4a69-954e-62de41e4f5e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:47.272246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae86ec5f-5191-4a69-954e-62de41e4f5e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:47.273012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae86ec5f-5191-4a69-954e-62de41e4f5e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:47.273448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae86ec5f-5191-4a69-954e-62de41e4f5e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:47.301459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ae86ec5f-5191-4a69-954e-62de41e4f5e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 Apr 07 13:13:47.302007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 586/1055] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:47 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:13:48.313005 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-726ae268-0aea-4704-a624-b7631d736c98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:48.313938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-726ae268-0aea-4704-a624-b7631d736c98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:48.320389 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-726ae268-0aea-4704-a624-b7631d736c98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:48.320847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-726ae268-0aea-4704-a624-b7631d736c98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:48.321658 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-726ae268-0aea-4704-a624-b7631d736c98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:48.322100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-726ae268-0aea-4704-a624-b7631d736c98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:48.350754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-726ae268-0aea-4704-a624-b7631d736c98 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041741 Apr 07 13:13:48.351299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 470/1056] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:48 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:49.362709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-aaa41752-e4f1-4e03-82c1-ad2242ec4ec6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:49.363634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-aaa41752-e4f1-4e03-82c1-ad2242ec4ec6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:49.369967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aaa41752-e4f1-4e03-82c1-ad2242ec4ec6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:49.370419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aaa41752-e4f1-4e03-82c1-ad2242ec4ec6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:49.371178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aaa41752-e4f1-4e03-82c1-ad2242ec4ec6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:49.371609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aaa41752-e4f1-4e03-82c1-ad2242ec4ec6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:49.399560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-aaa41752-e4f1-4e03-82c1-ad2242ec4ec6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041427 Apr 07 13:13:49.400099 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 587/1057] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:49 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:50.412053 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a207bd13-3ab5-47db-8a2f-3d6a22ccd455 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:50.413027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a207bd13-3ab5-47db-8a2f-3d6a22ccd455 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:50.419378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a207bd13-3ab5-47db-8a2f-3d6a22ccd455 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:50.419833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a207bd13-3ab5-47db-8a2f-3d6a22ccd455 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:50.420669 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a207bd13-3ab5-47db-8a2f-3d6a22ccd455 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:50.421110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a207bd13-3ab5-47db-8a2f-3d6a22ccd455 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:50.449637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a207bd13-3ab5-47db-8a2f-3d6a22ccd455 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042691 Apr 07 13:13:50.450191 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 471/1058] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:51.463382 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8f8c14a3-32d8-407b-a305-4a4d908b451e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:51.464770 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8f8c14a3-32d8-407b-a305-4a4d908b451e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:51.471066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8f8c14a3-32d8-407b-a305-4a4d908b451e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:51.471548 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8f8c14a3-32d8-407b-a305-4a4d908b451e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:51.472367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8f8c14a3-32d8-407b-a305-4a4d908b451e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:51.472805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8f8c14a3-32d8-407b-a305-4a4d908b451e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:51.501323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8f8c14a3-32d8-407b-a305-4a4d908b451e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044006 Apr 07 13:13:51.502538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 588/1059] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:51 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:52.513765 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-71e0ad5b-8098-484a-8ee6-bd12e39cfadb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:52.514703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-71e0ad5b-8098-484a-8ee6-bd12e39cfadb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:52.521142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71e0ad5b-8098-484a-8ee6-bd12e39cfadb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:52.521537 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71e0ad5b-8098-484a-8ee6-bd12e39cfadb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:52.522304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71e0ad5b-8098-484a-8ee6-bd12e39cfadb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:52.522745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71e0ad5b-8098-484a-8ee6-bd12e39cfadb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:52.551203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-71e0ad5b-8098-484a-8ee6-bd12e39cfadb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041399 Apr 07 13:13:52.551907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 472/1060] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:52 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:53.562555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4f26b7bd-0348-4e1f-8512-7541354f5ed5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:53.563479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4f26b7bd-0348-4e1f-8512-7541354f5ed5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:53.570287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f26b7bd-0348-4e1f-8512-7541354f5ed5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:53.570741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f26b7bd-0348-4e1f-8512-7541354f5ed5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:53.571498 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f26b7bd-0348-4e1f-8512-7541354f5ed5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:53.571935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f26b7bd-0348-4e1f-8512-7541354f5ed5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:53.600469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4f26b7bd-0348-4e1f-8512-7541354f5ed5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041678 Apr 07 13:13:53.601026 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 589/1061] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:53 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:54.610742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-778a2553-4a36-4c39-993c-c651ab3b5242 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:54.611717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-778a2553-4a36-4c39-993c-c651ab3b5242 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:54.618035 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-778a2553-4a36-4c39-993c-c651ab3b5242 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:54.618484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-778a2553-4a36-4c39-993c-c651ab3b5242 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:54.619248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-778a2553-4a36-4c39-993c-c651ab3b5242 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:54.619686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-778a2553-4a36-4c39-993c-c651ab3b5242 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:54.648478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-778a2553-4a36-4c39-993c-c651ab3b5242 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041574 Apr 07 13:13:54.649032 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 473/1062] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:54 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:55.660890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-874e3855-0f70-4f1c-81f0-4ee71de7e35e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:55.661811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-874e3855-0f70-4f1c-81f0-4ee71de7e35e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:55.668052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-874e3855-0f70-4f1c-81f0-4ee71de7e35e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:55.668536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-874e3855-0f70-4f1c-81f0-4ee71de7e35e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:55.669290 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-874e3855-0f70-4f1c-81f0-4ee71de7e35e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:55.669720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-874e3855-0f70-4f1c-81f0-4ee71de7e35e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:55.697495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-874e3855-0f70-4f1c-81f0-4ee71de7e35e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041579 Apr 07 13:13:55.698032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 590/1063] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:55 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:56.709385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-633205e5-3cc8-45bd-9d5f-731ae6d0b4cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:56.710312 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-633205e5-3cc8-45bd-9d5f-731ae6d0b4cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:56.716512 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-633205e5-3cc8-45bd-9d5f-731ae6d0b4cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:56.716962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-633205e5-3cc8-45bd-9d5f-731ae6d0b4cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:56.717717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-633205e5-3cc8-45bd-9d5f-731ae6d0b4cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:56.718147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-633205e5-3cc8-45bd-9d5f-731ae6d0b4cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:56.746189 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-633205e5-3cc8-45bd-9d5f-731ae6d0b4cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041320 Apr 07 13:13:56.746729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 474/1064] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:56 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:57.758577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-98519857-d123-4ea7-8bd9-a7b2572176ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:57.759585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-98519857-d123-4ea7-8bd9-a7b2572176ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:57.765690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98519857-d123-4ea7-8bd9-a7b2572176ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:57.766170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98519857-d123-4ea7-8bd9-a7b2572176ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:57.766940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98519857-d123-4ea7-8bd9-a7b2572176ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:57.768009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98519857-d123-4ea7-8bd9-a7b2572176ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:57.795746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-98519857-d123-4ea7-8bd9-a7b2572176ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041670 Apr 07 13:13:57.796349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 591/1065] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:58.806869 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-05989c67-bb7f-482d-8cc3-afbf7138195d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:58.807802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-05989c67-bb7f-482d-8cc3-afbf7138195d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:58.814017 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05989c67-bb7f-482d-8cc3-afbf7138195d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:58.815052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05989c67-bb7f-482d-8cc3-afbf7138195d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:58.815829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05989c67-bb7f-482d-8cc3-afbf7138195d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:58.816297 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05989c67-bb7f-482d-8cc3-afbf7138195d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:58.844798 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-05989c67-bb7f-482d-8cc3-afbf7138195d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041823 Apr 07 13:13:58.845292 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 475/1066] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:13:59.858697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5216722f-2dc7-4a37-b9e9-05ab7cb792ca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:13:59.859636 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5216722f-2dc7-4a37-b9e9-05ab7cb792ca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:13:59.866472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5216722f-2dc7-4a37-b9e9-05ab7cb792ca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:59.866957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5216722f-2dc7-4a37-b9e9-05ab7cb792ca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:59.867724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5216722f-2dc7-4a37-b9e9-05ab7cb792ca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:13:59.868189 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5216722f-2dc7-4a37-b9e9-05ab7cb792ca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:13:59.896454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5216722f-2dc7-4a37-b9e9-05ab7cb792ca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041685 Apr 07 13:13:59.897005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 592/1067] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:13:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:00.907011 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5e78f913-d825-498f-85b6-24d46cc6414a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:00.908037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5e78f913-d825-498f-85b6-24d46cc6414a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:00.914507 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e78f913-d825-498f-85b6-24d46cc6414a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:00.914968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e78f913-d825-498f-85b6-24d46cc6414a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:00.915753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e78f913-d825-498f-85b6-24d46cc6414a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:00.916221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e78f913-d825-498f-85b6-24d46cc6414a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:00.944460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5e78f913-d825-498f-85b6-24d46cc6414a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041340 Apr 07 13:14:00.945016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 476/1068] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:00 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:01.955236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-03e9e117-f944-4ecf-875d-048654767fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:01.956291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-03e9e117-f944-4ecf-875d-048654767fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:01.962218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03e9e117-f944-4ecf-875d-048654767fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:01.962662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03e9e117-f944-4ecf-875d-048654767fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:01.963416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03e9e117-f944-4ecf-875d-048654767fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:01.963846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03e9e117-f944-4ecf-875d-048654767fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:01.992568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-03e9e117-f944-4ecf-875d-048654767fb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041641 Apr 07 13:14:01.993128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 593/1069] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:01 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:03.004609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c1181ab1-f106-46a3-801a-5182ed9b7673 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:03.005554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c1181ab1-f106-46a3-801a-5182ed9b7673 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:03.011807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1181ab1-f106-46a3-801a-5182ed9b7673 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:03.012305 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1181ab1-f106-46a3-801a-5182ed9b7673 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:03.013108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1181ab1-f106-46a3-801a-5182ed9b7673 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:03.013536 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c1181ab1-f106-46a3-801a-5182ed9b7673 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:03.042401 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c1181ab1-f106-46a3-801a-5182ed9b7673 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042304 Apr 07 13:14:03.042941 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 477/1070] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:02 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:04.054173 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9f62dd09-6888-4cbe-b9b8-2ec3c1a0adc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:04.055099 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9f62dd09-6888-4cbe-b9b8-2ec3c1a0adc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:04.061427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9f62dd09-6888-4cbe-b9b8-2ec3c1a0adc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:04.061891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9f62dd09-6888-4cbe-b9b8-2ec3c1a0adc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:04.062648 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9f62dd09-6888-4cbe-b9b8-2ec3c1a0adc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:04.063084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9f62dd09-6888-4cbe-b9b8-2ec3c1a0adc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:04.091764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9f62dd09-6888-4cbe-b9b8-2ec3c1a0adc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041554 Apr 07 13:14:04.092333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 594/1071] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:04 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:14:05.104122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c8334ff2-3cd7-4252-b588-0e79a0342f55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:05.105110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c8334ff2-3cd7-4252-b588-0e79a0342f55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:05.111653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8334ff2-3cd7-4252-b588-0e79a0342f55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:05.112200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8334ff2-3cd7-4252-b588-0e79a0342f55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:05.112902 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8334ff2-3cd7-4252-b588-0e79a0342f55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:05.114012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8334ff2-3cd7-4252-b588-0e79a0342f55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:05.142626 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c8334ff2-3cd7-4252-b588-0e79a0342f55 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042553 Apr 07 13:14:05.143170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 478/1072] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:05 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:06.154032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ab3f239e-f0c8-4f39-8d0a-9dbd1f9c08fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:06.155191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ab3f239e-f0c8-4f39-8d0a-9dbd1f9c08fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:06.163119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab3f239e-f0c8-4f39-8d0a-9dbd1f9c08fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:06.163574 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab3f239e-f0c8-4f39-8d0a-9dbd1f9c08fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:06.164392 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab3f239e-f0c8-4f39-8d0a-9dbd1f9c08fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:06.164828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab3f239e-f0c8-4f39-8d0a-9dbd1f9c08fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:06.203461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ab3f239e-f0c8-4f39-8d0a-9dbd1f9c08fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053316 Apr 07 13:14:06.204021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 595/1073] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:06 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:07.214899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b07c8506-8d90-45ae-9f96-42b11a233a0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:07.215997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b07c8506-8d90-45ae-9f96-42b11a233a0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:07.222973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b07c8506-8d90-45ae-9f96-42b11a233a0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:07.223494 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b07c8506-8d90-45ae-9f96-42b11a233a0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:07.224293 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b07c8506-8d90-45ae-9f96-42b11a233a0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:07.224728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b07c8506-8d90-45ae-9f96-42b11a233a0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:07.252103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b07c8506-8d90-45ae-9f96-42b11a233a0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041140 Apr 07 13:14:07.252671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 479/1074] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:07 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:08.262804 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3c09831a-3ed7-4ac3-b9a1-b3f96e06b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:08.263755 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3c09831a-3ed7-4ac3-b9a1-b3f96e06b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:08.270274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c09831a-3ed7-4ac3-b9a1-b3f96e06b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:08.270721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c09831a-3ed7-4ac3-b9a1-b3f96e06b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:08.271628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c09831a-3ed7-4ac3-b9a1-b3f96e06b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:08.272085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c09831a-3ed7-4ac3-b9a1-b3f96e06b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:08.301921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3c09831a-3ed7-4ac3-b9a1-b3f96e06b40d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042969 Apr 07 13:14:08.302473 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 596/1075] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:08 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:09.313171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ffef6580-8484-4bbe-8a8b-fcad7de8a467 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:09.314499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ffef6580-8484-4bbe-8a8b-fcad7de8a467 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:09.320498 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ffef6580-8484-4bbe-8a8b-fcad7de8a467 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:09.320957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ffef6580-8484-4bbe-8a8b-fcad7de8a467 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:09.321732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ffef6580-8484-4bbe-8a8b-fcad7de8a467 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:09.322172 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ffef6580-8484-4bbe-8a8b-fcad7de8a467 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:09.351002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ffef6580-8484-4bbe-8a8b-fcad7de8a467 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041671 Apr 07 13:14:09.351536 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 480/1076] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:09 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:10.362736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d7ba79e6-7743-4c72-b4b8-fcc4e63e411f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:10.363703 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d7ba79e6-7743-4c72-b4b8-fcc4e63e411f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:10.369936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7ba79e6-7743-4c72-b4b8-fcc4e63e411f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:10.370383 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7ba79e6-7743-4c72-b4b8-fcc4e63e411f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:10.371156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7ba79e6-7743-4c72-b4b8-fcc4e63e411f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:10.371580 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7ba79e6-7743-4c72-b4b8-fcc4e63e411f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:10.403187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d7ba79e6-7743-4c72-b4b8-fcc4e63e411f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 Apr 07 13:14:10.403852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 597/1077] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:10 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:11.415084 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c72acc36-7dad-4bd7-baa0-d710d019b92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:11.416048 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c72acc36-7dad-4bd7-baa0-d710d019b92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:11.422363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c72acc36-7dad-4bd7-baa0-d710d019b92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:11.422820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c72acc36-7dad-4bd7-baa0-d710d019b92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:11.423596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c72acc36-7dad-4bd7-baa0-d710d019b92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:11.424067 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c72acc36-7dad-4bd7-baa0-d710d019b92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:11.453407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c72acc36-7dad-4bd7-baa0-d710d019b92b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042173 Apr 07 13:14:11.453953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 481/1078] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:11 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:12.466167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-49b7b3fc-c024-4c04-9826-68091bf38478 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:12.467096 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-49b7b3fc-c024-4c04-9826-68091bf38478 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:12.474399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-49b7b3fc-c024-4c04-9826-68091bf38478 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:12.474856 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-49b7b3fc-c024-4c04-9826-68091bf38478 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:12.475642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-49b7b3fc-c024-4c04-9826-68091bf38478 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:12.476380 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-49b7b3fc-c024-4c04-9826-68091bf38478 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:12.507127 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-49b7b3fc-c024-4c04-9826-68091bf38478 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045035 Apr 07 13:14:12.507649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 598/1079] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:12 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:13.519433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-74d425f9-9458-4e28-a6be-f145535bfef0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:13.520630 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-74d425f9-9458-4e28-a6be-f145535bfef0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:13.526883 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74d425f9-9458-4e28-a6be-f145535bfef0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:13.527332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74d425f9-9458-4e28-a6be-f145535bfef0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:13.528103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74d425f9-9458-4e28-a6be-f145535bfef0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:13.528564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74d425f9-9458-4e28-a6be-f145535bfef0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:13.556784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-74d425f9-9458-4e28-a6be-f145535bfef0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042056 Apr 07 13:14:13.557333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 482/1080] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:13 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:14.318185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:14:14.318794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:14:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:14:14.568665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5fe73408-e3f0-486c-98c2-240cb0fa83e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:14.569560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5fe73408-e3f0-486c-98c2-240cb0fa83e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:14.577598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5fe73408-e3f0-486c-98c2-240cb0fa83e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:14.578053 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5fe73408-e3f0-486c-98c2-240cb0fa83e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:14.578810 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5fe73408-e3f0-486c-98c2-240cb0fa83e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:14.579967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5fe73408-e3f0-486c-98c2-240cb0fa83e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:14.611317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5fe73408-e3f0-486c-98c2-240cb0fa83e7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045946 Apr 07 13:14:14.611873 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 599/1081] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:14 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:15.622702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-519799b4-ee7e-4c95-b1c6-e0c68ac18c95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:15.623764 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-519799b4-ee7e-4c95-b1c6-e0c68ac18c95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:15.630571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-519799b4-ee7e-4c95-b1c6-e0c68ac18c95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:15.631028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-519799b4-ee7e-4c95-b1c6-e0c68ac18c95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:15.631802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-519799b4-ee7e-4c95-b1c6-e0c68ac18c95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:15.632277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-519799b4-ee7e-4c95-b1c6-e0c68ac18c95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:15.661027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-519799b4-ee7e-4c95-b1c6-e0c68ac18c95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042181 Apr 07 13:14:15.661607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 483/1082] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:15 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:16.672496 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c9021220-4aad-4280-9a3b-9aed5fdcfb8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:16.674013 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c9021220-4aad-4280-9a3b-9aed5fdcfb8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:16.680381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9021220-4aad-4280-9a3b-9aed5fdcfb8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:16.680825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9021220-4aad-4280-9a3b-9aed5fdcfb8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:16.681587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9021220-4aad-4280-9a3b-9aed5fdcfb8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:16.682014 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9021220-4aad-4280-9a3b-9aed5fdcfb8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:16.711957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c9021220-4aad-4280-9a3b-9aed5fdcfb8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043450 Apr 07 13:14:16.712551 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 600/1083] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:16 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:17.723697 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-18f47af4-d8dc-4c95-b9a2-c8b2a9160eaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:17.724759 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-18f47af4-d8dc-4c95-b9a2-c8b2a9160eaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:17.731389 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-18f47af4-d8dc-4c95-b9a2-c8b2a9160eaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:17.731854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-18f47af4-d8dc-4c95-b9a2-c8b2a9160eaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:17.732672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-18f47af4-d8dc-4c95-b9a2-c8b2a9160eaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:17.733116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-18f47af4-d8dc-4c95-b9a2-c8b2a9160eaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:17.762438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-18f47af4-d8dc-4c95-b9a2-c8b2a9160eaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043158 Apr 07 13:14:17.762931 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 484/1084] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:17 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:18.774134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e86854ce-d12c-4221-94fe-1138514ca983 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:18.775010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e86854ce-d12c-4221-94fe-1138514ca983 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:18.781484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e86854ce-d12c-4221-94fe-1138514ca983 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:18.781973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e86854ce-d12c-4221-94fe-1138514ca983 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:18.783522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e86854ce-d12c-4221-94fe-1138514ca983 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:18.783929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e86854ce-d12c-4221-94fe-1138514ca983 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:18.812837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e86854ce-d12c-4221-94fe-1138514ca983 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042853 Apr 07 13:14:18.813386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 601/1085] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:14:19.823771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-48d34c36-b1cf-40e6-a6cc-47b1b425e1df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:19.824766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-48d34c36-b1cf-40e6-a6cc-47b1b425e1df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:19.832258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48d34c36-b1cf-40e6-a6cc-47b1b425e1df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:19.832678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48d34c36-b1cf-40e6-a6cc-47b1b425e1df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:19.833417 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48d34c36-b1cf-40e6-a6cc-47b1b425e1df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:19.833850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48d34c36-b1cf-40e6-a6cc-47b1b425e1df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:19.863634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-48d34c36-b1cf-40e6-a6cc-47b1b425e1df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Apr 07 13:14:19.864196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 485/1086] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:19 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:20.874692 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9b5a2217-f25d-49a6-8bb0-1651e1307486 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:20.875685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9b5a2217-f25d-49a6-8bb0-1651e1307486 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:20.882746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9b5a2217-f25d-49a6-8bb0-1651e1307486 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:20.883230 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9b5a2217-f25d-49a6-8bb0-1651e1307486 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:20.884005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9b5a2217-f25d-49a6-8bb0-1651e1307486 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:20.884471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9b5a2217-f25d-49a6-8bb0-1651e1307486 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:20.913760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9b5a2217-f25d-49a6-8bb0-1651e1307486 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042894 Apr 07 13:14:20.914451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 602/1087] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:20 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:21.926660 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c00bde7f-0486-4e41-bb02-460f5939918e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:21.927590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c00bde7f-0486-4e41-bb02-460f5939918e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:21.933914 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c00bde7f-0486-4e41-bb02-460f5939918e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:21.934368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c00bde7f-0486-4e41-bb02-460f5939918e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:21.935139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c00bde7f-0486-4e41-bb02-460f5939918e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:21.935570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c00bde7f-0486-4e41-bb02-460f5939918e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:21.965186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c00bde7f-0486-4e41-bb02-460f5939918e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Apr 07 13:14:21.965707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 486/1088] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:21 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:22.977156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bbdd9b65-ce3a-400c-aa76-4674a4ccae87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:22.978095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bbdd9b65-ce3a-400c-aa76-4674a4ccae87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:22.984044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbdd9b65-ce3a-400c-aa76-4674a4ccae87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:22.984533 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbdd9b65-ce3a-400c-aa76-4674a4ccae87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:22.985799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbdd9b65-ce3a-400c-aa76-4674a4ccae87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:22.986239 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbdd9b65-ce3a-400c-aa76-4674a4ccae87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:23.015311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bbdd9b65-ce3a-400c-aa76-4674a4ccae87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042405 Apr 07 13:14:23.015871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 603/1089] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:22 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:24.026700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7d5c97da-6d26-45ea-b747-25a3e50bcae4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:24.027670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7d5c97da-6d26-45ea-b747-25a3e50bcae4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:24.034860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d5c97da-6d26-45ea-b747-25a3e50bcae4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:24.035276 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d5c97da-6d26-45ea-b747-25a3e50bcae4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:24.036049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d5c97da-6d26-45ea-b747-25a3e50bcae4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:24.036518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d5c97da-6d26-45ea-b747-25a3e50bcae4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:24.065193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7d5c97da-6d26-45ea-b747-25a3e50bcae4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042364 Apr 07 13:14:24.065755 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 487/1090] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:24 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:25.077772 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bb131c54-1e60-4136-946a-835e2a9c2fad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:25.078724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bb131c54-1e60-4136-946a-835e2a9c2fad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:25.084690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb131c54-1e60-4136-946a-835e2a9c2fad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:25.085142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb131c54-1e60-4136-946a-835e2a9c2fad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:25.085914 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb131c54-1e60-4136-946a-835e2a9c2fad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:25.086353 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb131c54-1e60-4136-946a-835e2a9c2fad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:25.115246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bb131c54-1e60-4136-946a-835e2a9c2fad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043129 Apr 07 13:14:25.115889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 604/1091] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:25 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:14:26.126801 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0328dbf6-4865-4f6b-9390-36d7cc10d066 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:26.127742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0328dbf6-4865-4f6b-9390-36d7cc10d066 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:26.134231 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0328dbf6-4865-4f6b-9390-36d7cc10d066 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:26.134711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0328dbf6-4865-4f6b-9390-36d7cc10d066 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:26.135477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0328dbf6-4865-4f6b-9390-36d7cc10d066 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:26.137435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0328dbf6-4865-4f6b-9390-36d7cc10d066 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:26.170088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0328dbf6-4865-4f6b-9390-36d7cc10d066 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047372 Apr 07 13:14:26.174693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 488/1092] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:26 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:27.182269 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b150d000-5e4a-435a-83a9-0997e74e74d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:27.183212 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b150d000-5e4a-435a-83a9-0997e74e74d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:27.190559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b150d000-5e4a-435a-83a9-0997e74e74d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:27.191011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b150d000-5e4a-435a-83a9-0997e74e74d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:27.191768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b150d000-5e4a-435a-83a9-0997e74e74d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:27.192224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b150d000-5e4a-435a-83a9-0997e74e74d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:27.222985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b150d000-5e4a-435a-83a9-0997e74e74d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Apr 07 13:14:27.223820 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 605/1093] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:28.234448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-302969ce-a168-4d24-b86a-659021709b02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:28.236032 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-302969ce-a168-4d24-b86a-659021709b02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:28.242351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-302969ce-a168-4d24-b86a-659021709b02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:28.242816 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-302969ce-a168-4d24-b86a-659021709b02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:28.243618 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-302969ce-a168-4d24-b86a-659021709b02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:28.244086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-302969ce-a168-4d24-b86a-659021709b02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:28.273298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-302969ce-a168-4d24-b86a-659021709b02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042742 Apr 07 13:14:28.273858 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 489/1094] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:28 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:29.285747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a656c258-660d-4e7a-84de-adf7752e5911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:29.286662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a656c258-660d-4e7a-84de-adf7752e5911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:29.292817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a656c258-660d-4e7a-84de-adf7752e5911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:29.293267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a656c258-660d-4e7a-84de-adf7752e5911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:29.294017 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a656c258-660d-4e7a-84de-adf7752e5911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:29.294444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a656c258-660d-4e7a-84de-adf7752e5911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:29.323955 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a656c258-660d-4e7a-84de-adf7752e5911 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043204 Apr 07 13:14:29.324542 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 606/1095] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:29 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:30.334964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9b7a378d-9e57-4629-aa72-b9b22413ebbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:30.335895 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9b7a378d-9e57-4629-aa72-b9b22413ebbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:30.342175 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b7a378d-9e57-4629-aa72-b9b22413ebbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:30.342633 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b7a378d-9e57-4629-aa72-b9b22413ebbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:30.343400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b7a378d-9e57-4629-aa72-b9b22413ebbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:30.343839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b7a378d-9e57-4629-aa72-b9b22413ebbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:30.372659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9b7a378d-9e57-4629-aa72-b9b22413ebbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041547 Apr 07 13:14:30.373216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 490/1096] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:30 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:31.385399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3de587a8-747d-4432-bbb3-9d29c566805c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:31.386332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3de587a8-747d-4432-bbb3-9d29c566805c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:31.392620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3de587a8-747d-4432-bbb3-9d29c566805c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:31.393082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3de587a8-747d-4432-bbb3-9d29c566805c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:31.393844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3de587a8-747d-4432-bbb3-9d29c566805c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:31.394281 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3de587a8-747d-4432-bbb3-9d29c566805c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:31.424939 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3de587a8-747d-4432-bbb3-9d29c566805c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043385 Apr 07 13:14:31.425494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 607/1097] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:31 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:32.436530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9ecd901d-ad1b-4d9c-a7c9-601def2e9da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:32.438035 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9ecd901d-ad1b-4d9c-a7c9-601def2e9da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:32.444427 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9ecd901d-ad1b-4d9c-a7c9-601def2e9da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:32.444877 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9ecd901d-ad1b-4d9c-a7c9-601def2e9da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:32.445642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9ecd901d-ad1b-4d9c-a7c9-601def2e9da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:32.446076 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9ecd901d-ad1b-4d9c-a7c9-601def2e9da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:32.475268 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9ecd901d-ad1b-4d9c-a7c9-601def2e9da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042517 Apr 07 13:14:32.475831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 491/1098] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:32.593464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:14:32.593626 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:14:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:14:33.487834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0d1a7a0b-87c1-4914-adaa-06134f86313d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:33.488777 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0d1a7a0b-87c1-4914-adaa-06134f86313d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:33.494893 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0d1a7a0b-87c1-4914-adaa-06134f86313d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:33.495345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0d1a7a0b-87c1-4914-adaa-06134f86313d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:33.496103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0d1a7a0b-87c1-4914-adaa-06134f86313d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:33.496556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0d1a7a0b-87c1-4914-adaa-06134f86313d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:33.534715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0d1a7a0b-87c1-4914-adaa-06134f86313d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050396 Apr 07 13:14:33.535324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 608/1099] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:33 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:33.820722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:14:33.820912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:14:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:14:34.090285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:14:34.090761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:14:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:14:34.546492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6b9ecfbc-9814-4e37-bf71-4d66bf595153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:34.548057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6b9ecfbc-9814-4e37-bf71-4d66bf595153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:34.554066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b9ecfbc-9814-4e37-bf71-4d66bf595153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:34.554519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b9ecfbc-9814-4e37-bf71-4d66bf595153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:34.555291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b9ecfbc-9814-4e37-bf71-4d66bf595153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:34.555729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b9ecfbc-9814-4e37-bf71-4d66bf595153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:34.585492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6b9ecfbc-9814-4e37-bf71-4d66bf595153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 Apr 07 13:14:34.586047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 492/1100] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:34 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:35.597668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0c1b93b1-02a2-4468-a473-61ee6c20c423 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:35.598628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0c1b93b1-02a2-4468-a473-61ee6c20c423 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:35.604814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c1b93b1-02a2-4468-a473-61ee6c20c423 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:35.605264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c1b93b1-02a2-4468-a473-61ee6c20c423 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:35.606022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c1b93b1-02a2-4468-a473-61ee6c20c423 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:35.606454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c1b93b1-02a2-4468-a473-61ee6c20c423 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:35.637213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0c1b93b1-02a2-4468-a473-61ee6c20c423 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044136 Apr 07 13:14:35.637794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 609/1101] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:35 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:36.490931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:14:36.491149 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:14:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:14:36.648606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2cdb89ec-79d7-46ba-bf52-63a3f2a146fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:36.649538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2cdb89ec-79d7-46ba-bf52-63a3f2a146fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:36.655961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2cdb89ec-79d7-46ba-bf52-63a3f2a146fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:36.656468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2cdb89ec-79d7-46ba-bf52-63a3f2a146fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:36.657907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2cdb89ec-79d7-46ba-bf52-63a3f2a146fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:36.658347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2cdb89ec-79d7-46ba-bf52-63a3f2a146fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:36.688203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2cdb89ec-79d7-46ba-bf52-63a3f2a146fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043367 Apr 07 13:14:36.688869 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 493/1102] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:36 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:37.699074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-432bdd2e-2b60-40ea-a408-712aaab02171 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:37.700010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-432bdd2e-2b60-40ea-a408-712aaab02171 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:37.706414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-432bdd2e-2b60-40ea-a408-712aaab02171 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:37.706870 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-432bdd2e-2b60-40ea-a408-712aaab02171 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:37.707640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-432bdd2e-2b60-40ea-a408-712aaab02171 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:37.708077 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-432bdd2e-2b60-40ea-a408-712aaab02171 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:37.745338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-432bdd2e-2b60-40ea-a408-712aaab02171 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050421 Apr 07 13:14:37.745911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 610/1103] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:38.757020 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8a9be641-2231-4f9a-8409-1511cc43bfaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:38.757947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8a9be641-2231-4f9a-8409-1511cc43bfaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:38.764232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a9be641-2231-4f9a-8409-1511cc43bfaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:38.764687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a9be641-2231-4f9a-8409-1511cc43bfaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:38.765452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a9be641-2231-4f9a-8409-1511cc43bfaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:38.765950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a9be641-2231-4f9a-8409-1511cc43bfaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:38.794743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8a9be641-2231-4f9a-8409-1511cc43bfaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041506 Apr 07 13:14:38.795552 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 494/1104] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:39.806526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2cb1e5da-bf63-4fef-895c-ac34706ed0dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:39.807450 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2cb1e5da-bf63-4fef-895c-ac34706ed0dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:39.814271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2cb1e5da-bf63-4fef-895c-ac34706ed0dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:39.814713 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2cb1e5da-bf63-4fef-895c-ac34706ed0dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:39.815479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2cb1e5da-bf63-4fef-895c-ac34706ed0dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:39.815911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2cb1e5da-bf63-4fef-895c-ac34706ed0dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:39.844720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2cb1e5da-bf63-4fef-895c-ac34706ed0dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041988 Apr 07 13:14:39.845426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 611/1105] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:39 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:40.856178 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a356e7c0-f59c-4c89-93a3-c4fd5c47b5b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:40.857105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a356e7c0-f59c-4c89-93a3-c4fd5c47b5b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:40.863562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a356e7c0-f59c-4c89-93a3-c4fd5c47b5b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:40.864013 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a356e7c0-f59c-4c89-93a3-c4fd5c47b5b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:40.864810 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a356e7c0-f59c-4c89-93a3-c4fd5c47b5b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:40.865243 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a356e7c0-f59c-4c89-93a3-c4fd5c47b5b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:40.893711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a356e7c0-f59c-4c89-93a3-c4fd5c47b5b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041643 Apr 07 13:14:40.894409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 495/1106] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:40 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:41.904320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c11bcdbe-9ed9-44cc-8815-b9a23918091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:41.905361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c11bcdbe-9ed9-44cc-8815-b9a23918091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:41.912647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c11bcdbe-9ed9-44cc-8815-b9a23918091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:41.913673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c11bcdbe-9ed9-44cc-8815-b9a23918091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:41.913853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c11bcdbe-9ed9-44cc-8815-b9a23918091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:41.914287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c11bcdbe-9ed9-44cc-8815-b9a23918091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:41.944090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c11bcdbe-9ed9-44cc-8815-b9a23918091a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043768 Apr 07 13:14:41.944773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 612/1107] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:41 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:42.955109 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-297e99aa-ea2b-4219-a9d8-4d99550028f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:42.955962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-297e99aa-ea2b-4219-a9d8-4d99550028f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:42.962387 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-297e99aa-ea2b-4219-a9d8-4d99550028f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:42.962845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-297e99aa-ea2b-4219-a9d8-4d99550028f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:42.963615 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-297e99aa-ea2b-4219-a9d8-4d99550028f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:42.964058 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-297e99aa-ea2b-4219-a9d8-4d99550028f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:42.997950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-297e99aa-ea2b-4219-a9d8-4d99550028f0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042497 Apr 07 13:14:43.001512 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 496/1108] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:42 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:43.399737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:14:43.399971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:14:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:14:44.012397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8c0043f0-7b35-4482-9355-3701f09922a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:44.013360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8c0043f0-7b35-4482-9355-3701f09922a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:44.019663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8c0043f0-7b35-4482-9355-3701f09922a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:44.020117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8c0043f0-7b35-4482-9355-3701f09922a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:44.020912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8c0043f0-7b35-4482-9355-3701f09922a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:44.021349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8c0043f0-7b35-4482-9355-3701f09922a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:44.050389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8c0043f0-7b35-4482-9355-3701f09922a1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041928 Apr 07 13:14:44.052272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 613/1109] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:44 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:45.061961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-29b96ab5-13df-4185-bed6-cb0197bc7558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:45.063393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-29b96ab5-13df-4185-bed6-cb0197bc7558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:45.070196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-29b96ab5-13df-4185-bed6-cb0197bc7558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:45.070448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-29b96ab5-13df-4185-bed6-cb0197bc7558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:45.071217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-29b96ab5-13df-4185-bed6-cb0197bc7558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:45.071682 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-29b96ab5-13df-4185-bed6-cb0197bc7558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:45.101073 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-29b96ab5-13df-4185-bed6-cb0197bc7558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043080 Apr 07 13:14:45.104332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 497/1110] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:45 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:46.112380 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-64d4662e-bc21-4558-95eb-95a5114616bc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:46.113306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-64d4662e-bc21-4558-95eb-95a5114616bc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:46.119571 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-64d4662e-bc21-4558-95eb-95a5114616bc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:46.120054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-64d4662e-bc21-4558-95eb-95a5114616bc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:46.120843 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-64d4662e-bc21-4558-95eb-95a5114616bc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:46.121317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-64d4662e-bc21-4558-95eb-95a5114616bc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:46.149706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-64d4662e-bc21-4558-95eb-95a5114616bc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041227 Apr 07 13:14:46.150272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 614/1111] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:46 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:47.162250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-05d4c178-2af6-47cf-af77-6dc234a5c4f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:47.163199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-05d4c178-2af6-47cf-af77-6dc234a5c4f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:47.171802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05d4c178-2af6-47cf-af77-6dc234a5c4f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:47.172847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05d4c178-2af6-47cf-af77-6dc234a5c4f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:47.173639 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05d4c178-2af6-47cf-af77-6dc234a5c4f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:47.174086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05d4c178-2af6-47cf-af77-6dc234a5c4f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:47.207085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-05d4c178-2af6-47cf-af77-6dc234a5c4f9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048644 Apr 07 13:14:47.208087 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 498/1112] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:47 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:48.219873 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-60b3551a-cbf7-4b23-aef7-6b3b303109c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:48.220745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-60b3551a-cbf7-4b23-aef7-6b3b303109c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:48.226984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60b3551a-cbf7-4b23-aef7-6b3b303109c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:48.227434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60b3551a-cbf7-4b23-aef7-6b3b303109c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:48.228222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60b3551a-cbf7-4b23-aef7-6b3b303109c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:48.228663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60b3551a-cbf7-4b23-aef7-6b3b303109c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:48.258073 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-60b3551a-cbf7-4b23-aef7-6b3b303109c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042240 Apr 07 13:14:48.258640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 615/1113] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:48 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:49.269552 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-90354a5e-3c80-43fb-a7a7-3d554153d08e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:49.270486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-90354a5e-3c80-43fb-a7a7-3d554153d08e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:49.276811 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90354a5e-3c80-43fb-a7a7-3d554153d08e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:49.277269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90354a5e-3c80-43fb-a7a7-3d554153d08e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:49.278041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90354a5e-3c80-43fb-a7a7-3d554153d08e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:49.278476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90354a5e-3c80-43fb-a7a7-3d554153d08e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:49.308336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-90354a5e-3c80-43fb-a7a7-3d554153d08e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043354 Apr 07 13:14:49.308896 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 499/1114] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:49 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:50.319886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2f0ab490-de8c-4d0e-b13d-d1816d91e465 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:50.320839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2f0ab490-de8c-4d0e-b13d-d1816d91e465 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:50.327103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f0ab490-de8c-4d0e-b13d-d1816d91e465 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:50.327559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f0ab490-de8c-4d0e-b13d-d1816d91e465 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:50.328434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f0ab490-de8c-4d0e-b13d-d1816d91e465 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:50.328971 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f0ab490-de8c-4d0e-b13d-d1816d91e465 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:50.357576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2f0ab490-de8c-4d0e-b13d-d1816d91e465 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041639 Apr 07 13:14:50.358268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 616/1115] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:51.370254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c40dfe84-88b8-4805-a9af-9a4af7bd1f59 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:51.371214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c40dfe84-88b8-4805-a9af-9a4af7bd1f59 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:51.378142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c40dfe84-88b8-4805-a9af-9a4af7bd1f59 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:51.378590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c40dfe84-88b8-4805-a9af-9a4af7bd1f59 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:51.379355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c40dfe84-88b8-4805-a9af-9a4af7bd1f59 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:51.379785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c40dfe84-88b8-4805-a9af-9a4af7bd1f59 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:51.409366 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c40dfe84-88b8-4805-a9af-9a4af7bd1f59 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043153 Apr 07 13:14:51.410187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 500/1116] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:51 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:14:52.421183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8a778753-61c7-42b6-939e-87a295af9b74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:52.422145 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8a778753-61c7-42b6-939e-87a295af9b74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:52.429038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a778753-61c7-42b6-939e-87a295af9b74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:52.429489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a778753-61c7-42b6-939e-87a295af9b74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:52.430271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a778753-61c7-42b6-939e-87a295af9b74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:52.430713 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a778753-61c7-42b6-939e-87a295af9b74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:52.459869 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8a778753-61c7-42b6-939e-87a295af9b74 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042614 Apr 07 13:14:52.460444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 617/1117] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:52 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:53.471944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-14d2f5c6-4894-457b-922c-2c7962243e6c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:53.472897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-14d2f5c6-4894-457b-922c-2c7962243e6c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:53.479185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14d2f5c6-4894-457b-922c-2c7962243e6c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:53.479638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14d2f5c6-4894-457b-922c-2c7962243e6c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:53.480437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14d2f5c6-4894-457b-922c-2c7962243e6c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:53.480879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14d2f5c6-4894-457b-922c-2c7962243e6c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:53.508909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-14d2f5c6-4894-457b-922c-2c7962243e6c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041484 Apr 07 13:14:53.509470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 501/1118] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:53 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:54.520915 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-159798e6-3182-491c-b5f2-e007f2153c72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:54.521844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-159798e6-3182-491c-b5f2-e007f2153c72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:54.528202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-159798e6-3182-491c-b5f2-e007f2153c72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:54.528657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-159798e6-3182-491c-b5f2-e007f2153c72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:54.529445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-159798e6-3182-491c-b5f2-e007f2153c72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:54.529884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-159798e6-3182-491c-b5f2-e007f2153c72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:54.558118 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-159798e6-3182-491c-b5f2-e007f2153c72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041986 Apr 07 13:14:54.558674 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 618/1119] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:54 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:55.570635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a529af2d-af54-4434-8e22-a0e754d2cb63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:55.571559 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a529af2d-af54-4434-8e22-a0e754d2cb63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:55.577915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a529af2d-af54-4434-8e22-a0e754d2cb63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:55.578372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a529af2d-af54-4434-8e22-a0e754d2cb63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:55.579131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a529af2d-af54-4434-8e22-a0e754d2cb63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:55.579568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a529af2d-af54-4434-8e22-a0e754d2cb63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:55.609773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a529af2d-af54-4434-8e22-a0e754d2cb63 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043127 Apr 07 13:14:55.610525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 502/1120] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:55 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:56.622298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-74f1cb2e-e829-4755-a24d-cd2309fe8c4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:56.623216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-74f1cb2e-e829-4755-a24d-cd2309fe8c4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:56.629594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-74f1cb2e-e829-4755-a24d-cd2309fe8c4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:56.630044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-74f1cb2e-e829-4755-a24d-cd2309fe8c4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:56.630802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-74f1cb2e-e829-4755-a24d-cd2309fe8c4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:56.631236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-74f1cb2e-e829-4755-a24d-cd2309fe8c4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:56.660028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-74f1cb2e-e829-4755-a24d-cd2309fe8c4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041474 Apr 07 13:14:56.660605 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 619/1121] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:56 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:57.671595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fb76c25a-eaf3-492e-9cb5-71cc7307d317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:57.672544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fb76c25a-eaf3-492e-9cb5-71cc7307d317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:57.679827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb76c25a-eaf3-492e-9cb5-71cc7307d317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:57.680317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb76c25a-eaf3-492e-9cb5-71cc7307d317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:57.681080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb76c25a-eaf3-492e-9cb5-71cc7307d317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:57.681508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb76c25a-eaf3-492e-9cb5-71cc7307d317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:57.710884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fb76c25a-eaf3-492e-9cb5-71cc7307d317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042993 Apr 07 13:14:57.711203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 503/1122] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:58.722460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-aa91706d-6753-4674-b356-a8af2afa9dbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:58.723380 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-aa91706d-6753-4674-b356-a8af2afa9dbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:58.730748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aa91706d-6753-4674-b356-a8af2afa9dbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:58.731210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aa91706d-6753-4674-b356-a8af2afa9dbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:58.731987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aa91706d-6753-4674-b356-a8af2afa9dbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:58.732572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aa91706d-6753-4674-b356-a8af2afa9dbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:58.761842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-aa91706d-6753-4674-b356-a8af2afa9dbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043756 Apr 07 13:14:58.762425 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 620/1123] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:14:59.773549 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-871c3879-d0dc-4780-a03b-2bdfb1d21405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:14:59.774478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-871c3879-d0dc-4780-a03b-2bdfb1d21405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:14:59.780782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-871c3879-d0dc-4780-a03b-2bdfb1d21405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:59.781234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-871c3879-d0dc-4780-a03b-2bdfb1d21405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:59.782000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-871c3879-d0dc-4780-a03b-2bdfb1d21405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:14:59.782463 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-871c3879-d0dc-4780-a03b-2bdfb1d21405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:14:59.811027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-871c3879-d0dc-4780-a03b-2bdfb1d21405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041471 Apr 07 13:14:59.811558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 504/1124] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:14:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:00.823377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f09c1b6e-6cf2-43bb-8d3c-621a238c6a0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:00.824335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f09c1b6e-6cf2-43bb-8d3c-621a238c6a0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:00.830556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f09c1b6e-6cf2-43bb-8d3c-621a238c6a0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:00.831009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f09c1b6e-6cf2-43bb-8d3c-621a238c6a0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:00.832487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f09c1b6e-6cf2-43bb-8d3c-621a238c6a0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:00.832960 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f09c1b6e-6cf2-43bb-8d3c-621a238c6a0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:00.860421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f09c1b6e-6cf2-43bb-8d3c-621a238c6a0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 Apr 07 13:15:00.860958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 621/1125] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:00 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:01.872364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-34cd5ce4-a158-4046-ac62-43f037c8ba2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:01.873300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-34cd5ce4-a158-4046-ac62-43f037c8ba2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:01.880203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34cd5ce4-a158-4046-ac62-43f037c8ba2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:01.880662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34cd5ce4-a158-4046-ac62-43f037c8ba2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:01.881425 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34cd5ce4-a158-4046-ac62-43f037c8ba2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:01.881859 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34cd5ce4-a158-4046-ac62-43f037c8ba2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:01.910705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-34cd5ce4-a158-4046-ac62-43f037c8ba2d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041493 Apr 07 13:15:01.911242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 505/1126] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:01 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:02.921973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4a2c2441-94c3-49a0-89ac-ef1314e5da3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:02.922934 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4a2c2441-94c3-49a0-89ac-ef1314e5da3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:02.930105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a2c2441-94c3-49a0-89ac-ef1314e5da3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:02.930562 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a2c2441-94c3-49a0-89ac-ef1314e5da3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:02.931327 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a2c2441-94c3-49a0-89ac-ef1314e5da3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:02.931767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a2c2441-94c3-49a0-89ac-ef1314e5da3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:02.959328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4a2c2441-94c3-49a0-89ac-ef1314e5da3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041229 Apr 07 13:15:02.959809 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 622/1127] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:02 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:03.970887 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b9b551d8-c1dc-43e0-83ff-105f68a6a89c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:03.971816 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b9b551d8-c1dc-43e0-83ff-105f68a6a89c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:03.977875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9b551d8-c1dc-43e0-83ff-105f68a6a89c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:03.978322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9b551d8-c1dc-43e0-83ff-105f68a6a89c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:03.979080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9b551d8-c1dc-43e0-83ff-105f68a6a89c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:03.979517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9b551d8-c1dc-43e0-83ff-105f68a6a89c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:04.008064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b9b551d8-c1dc-43e0-83ff-105f68a6a89c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Apr 07 13:15:04.008632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 506/1128] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:03 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:05.020223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4f09e20e-579d-4129-aa10-28aeed07e45e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:05.021146 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4f09e20e-579d-4129-aa10-28aeed07e45e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:05.027394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f09e20e-579d-4129-aa10-28aeed07e45e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:05.027839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f09e20e-579d-4129-aa10-28aeed07e45e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:05.028624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f09e20e-579d-4129-aa10-28aeed07e45e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:05.029059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f09e20e-579d-4129-aa10-28aeed07e45e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:05.056616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4f09e20e-579d-4129-aa10-28aeed07e45e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041011 Apr 07 13:15:05.057160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 623/1129] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:05 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:06.068571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3829dc35-4d99-4873-be06-9ac3c4335ee4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:06.069499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3829dc35-4d99-4873-be06-9ac3c4335ee4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:06.075738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3829dc35-4d99-4873-be06-9ac3c4335ee4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:06.076204 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3829dc35-4d99-4873-be06-9ac3c4335ee4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:06.077028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3829dc35-4d99-4873-be06-9ac3c4335ee4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:06.077398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3829dc35-4d99-4873-be06-9ac3c4335ee4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:06.105824 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3829dc35-4d99-4873-be06-9ac3c4335ee4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041774 Apr 07 13:15:06.106360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 507/1130] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:06 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:07.117796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7847e032-9f12-41d5-882f-1ed9be4f605c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:07.118725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7847e032-9f12-41d5-882f-1ed9be4f605c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:07.125039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7847e032-9f12-41d5-882f-1ed9be4f605c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:07.125494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7847e032-9f12-41d5-882f-1ed9be4f605c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:07.126260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7847e032-9f12-41d5-882f-1ed9be4f605c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:07.126703 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7847e032-9f12-41d5-882f-1ed9be4f605c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:07.155152 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7847e032-9f12-41d5-882f-1ed9be4f605c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041310 Apr 07 13:15:07.155697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 624/1131] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:07 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:08.166728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-80e77d23-10a8-437a-952f-a36c02ee31c9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:08.167664 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-80e77d23-10a8-437a-952f-a36c02ee31c9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:08.173949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-80e77d23-10a8-437a-952f-a36c02ee31c9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:08.174404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-80e77d23-10a8-437a-952f-a36c02ee31c9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:08.175178 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-80e77d23-10a8-437a-952f-a36c02ee31c9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:08.175609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-80e77d23-10a8-437a-952f-a36c02ee31c9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:08.203603 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-80e77d23-10a8-437a-952f-a36c02ee31c9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040849 Apr 07 13:15:08.204159 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 508/1132] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:08 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:09.215926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9573fa23-6853-464c-a8ea-28d8a27aad99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:09.216871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9573fa23-6853-464c-a8ea-28d8a27aad99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:09.223991 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9573fa23-6853-464c-a8ea-28d8a27aad99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:09.224476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9573fa23-6853-464c-a8ea-28d8a27aad99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:09.225243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9573fa23-6853-464c-a8ea-28d8a27aad99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:09.225680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9573fa23-6853-464c-a8ea-28d8a27aad99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:09.252822 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9573fa23-6853-464c-a8ea-28d8a27aad99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040839 Apr 07 13:15:09.253441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 625/1133] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:09 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:10.264519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7802da46-7c6e-4e47-8684-4d6c39328ba8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:10.265451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7802da46-7c6e-4e47-8684-4d6c39328ba8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:10.271907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7802da46-7c6e-4e47-8684-4d6c39328ba8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:10.272398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7802da46-7c6e-4e47-8684-4d6c39328ba8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:10.273174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7802da46-7c6e-4e47-8684-4d6c39328ba8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:10.273618 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7802da46-7c6e-4e47-8684-4d6c39328ba8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:10.302051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7802da46-7c6e-4e47-8684-4d6c39328ba8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041520 Apr 07 13:15:10.302595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 509/1134] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:10 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:11.313609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-03f5dbae-d73c-4fb3-9f45-c74a8e7a3d78 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:11.314540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-03f5dbae-d73c-4fb3-9f45-c74a8e7a3d78 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:11.321362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03f5dbae-d73c-4fb3-9f45-c74a8e7a3d78 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:11.321813 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03f5dbae-d73c-4fb3-9f45-c74a8e7a3d78 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:11.322576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03f5dbae-d73c-4fb3-9f45-c74a8e7a3d78 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:11.323009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03f5dbae-d73c-4fb3-9f45-c74a8e7a3d78 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:11.350891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-03f5dbae-d73c-4fb3-9f45-c74a8e7a3d78 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041334 Apr 07 13:15:11.351428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 626/1135] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:11 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:12.362522 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-43bd2140-17d4-42fa-8b9f-0385ad7c5315 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:12.363497 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-43bd2140-17d4-42fa-8b9f-0385ad7c5315 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:12.369928 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43bd2140-17d4-42fa-8b9f-0385ad7c5315 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:12.370380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43bd2140-17d4-42fa-8b9f-0385ad7c5315 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:12.371651 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43bd2140-17d4-42fa-8b9f-0385ad7c5315 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:12.372481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43bd2140-17d4-42fa-8b9f-0385ad7c5315 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:12.406106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-43bd2140-17d4-42fa-8b9f-0385ad7c5315 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047593 Apr 07 13:15:12.406671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 510/1136] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:12 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:13.418222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8ff6b4ab-2ae4-4be8-ad09-2905ac9a9bd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:13.419152 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8ff6b4ab-2ae4-4be8-ad09-2905ac9a9bd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:13.426034 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ff6b4ab-2ae4-4be8-ad09-2905ac9a9bd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:13.426489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ff6b4ab-2ae4-4be8-ad09-2905ac9a9bd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:13.427254 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ff6b4ab-2ae4-4be8-ad09-2905ac9a9bd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:13.427695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ff6b4ab-2ae4-4be8-ad09-2905ac9a9bd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:13.461485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8ff6b4ab-2ae4-4be8-ad09-2905ac9a9bd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047033 Apr 07 13:15:13.461990 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 627/1137] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:13 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:14.472900 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-56f43f31-8cbc-4522-92d6-32bfc58283d1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:14.473869 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-56f43f31-8cbc-4522-92d6-32bfc58283d1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:14.480169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-56f43f31-8cbc-4522-92d6-32bfc58283d1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:14.480641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-56f43f31-8cbc-4522-92d6-32bfc58283d1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:14.481406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-56f43f31-8cbc-4522-92d6-32bfc58283d1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:14.481849 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-56f43f31-8cbc-4522-92d6-32bfc58283d1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:14.510556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-56f43f31-8cbc-4522-92d6-32bfc58283d1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041622 Apr 07 13:15:14.511100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 511/1138] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:14 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:15.522478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-209b11bd-1fe6-4eb5-a1b4-53a8b04ec0ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:15.523398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-209b11bd-1fe6-4eb5-a1b4-53a8b04ec0ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:15.529639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-209b11bd-1fe6-4eb5-a1b4-53a8b04ec0ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:15.530087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-209b11bd-1fe6-4eb5-a1b4-53a8b04ec0ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:15.530837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-209b11bd-1fe6-4eb5-a1b4-53a8b04ec0ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:15.531268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-209b11bd-1fe6-4eb5-a1b4-53a8b04ec0ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:15.559685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-209b11bd-1fe6-4eb5-a1b4-53a8b04ec0ce tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042097 Apr 07 13:15:15.560266 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 628/1139] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:15 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:16.570874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d04579a3-e102-46c4-ab55-14c128de226e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:16.571795 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d04579a3-e102-46c4-ab55-14c128de226e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:16.578175 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d04579a3-e102-46c4-ab55-14c128de226e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:16.578630 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d04579a3-e102-46c4-ab55-14c128de226e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:16.579395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d04579a3-e102-46c4-ab55-14c128de226e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:16.579827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d04579a3-e102-46c4-ab55-14c128de226e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:16.608248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d04579a3-e102-46c4-ab55-14c128de226e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041247 Apr 07 13:15:16.608799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 512/1140] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:16 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:17.619581 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6759345c-4abd-44ea-ae28-edb9cf6fb75f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:17.620474 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6759345c-4abd-44ea-ae28-edb9cf6fb75f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:17.626685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6759345c-4abd-44ea-ae28-edb9cf6fb75f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:17.627117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6759345c-4abd-44ea-ae28-edb9cf6fb75f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:17.628031 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6759345c-4abd-44ea-ae28-edb9cf6fb75f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:17.628990 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6759345c-4abd-44ea-ae28-edb9cf6fb75f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:17.656729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6759345c-4abd-44ea-ae28-edb9cf6fb75f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Apr 07 13:15:17.657276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 629/1141] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:17 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:18.668952 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e38f5db4-83d2-40f1-935c-94d2007e5a7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:18.669893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e38f5db4-83d2-40f1-935c-94d2007e5a7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:18.676851 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e38f5db4-83d2-40f1-935c-94d2007e5a7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:18.677305 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e38f5db4-83d2-40f1-935c-94d2007e5a7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:18.678071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e38f5db4-83d2-40f1-935c-94d2007e5a7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:18.678509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e38f5db4-83d2-40f1-935c-94d2007e5a7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:18.706583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e38f5db4-83d2-40f1-935c-94d2007e5a7e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041581 Apr 07 13:15:18.707137 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 513/1142] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:19.718294 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-afec735e-f626-48a7-9226-0523143921a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:19.719250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-afec735e-f626-48a7-9226-0523143921a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:19.726282 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afec735e-f626-48a7-9226-0523143921a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:19.726733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afec735e-f626-48a7-9226-0523143921a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:19.727500 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afec735e-f626-48a7-9226-0523143921a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:19.727935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afec735e-f626-48a7-9226-0523143921a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:19.755552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-afec735e-f626-48a7-9226-0523143921a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Apr 07 13:15:19.756092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 630/1143] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:19 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:20.766800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-38fdbc31-e0e1-4323-8712-1f2316cf08cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:20.767725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-38fdbc31-e0e1-4323-8712-1f2316cf08cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:20.774235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38fdbc31-e0e1-4323-8712-1f2316cf08cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:20.774684 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38fdbc31-e0e1-4323-8712-1f2316cf08cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:20.775448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38fdbc31-e0e1-4323-8712-1f2316cf08cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:20.775881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38fdbc31-e0e1-4323-8712-1f2316cf08cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:20.805605 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-38fdbc31-e0e1-4323-8712-1f2316cf08cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 Apr 07 13:15:20.806145 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 514/1144] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:20 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:21.817029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-592d87b4-7e87-4a75-b543-d005ddce91fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:21.817954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-592d87b4-7e87-4a75-b543-d005ddce91fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:21.824303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-592d87b4-7e87-4a75-b543-d005ddce91fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:21.824759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-592d87b4-7e87-4a75-b543-d005ddce91fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:21.825525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-592d87b4-7e87-4a75-b543-d005ddce91fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:21.825959 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-592d87b4-7e87-4a75-b543-d005ddce91fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:21.854096 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-592d87b4-7e87-4a75-b543-d005ddce91fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041010 Apr 07 13:15:21.854643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 631/1145] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:21 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:22.866209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ab86f9ef-03ac-405c-a559-51b98ef4f316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:22.867184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ab86f9ef-03ac-405c-a559-51b98ef4f316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:22.873528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ab86f9ef-03ac-405c-a559-51b98ef4f316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:22.873986 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ab86f9ef-03ac-405c-a559-51b98ef4f316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:22.874757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ab86f9ef-03ac-405c-a559-51b98ef4f316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:22.875204 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ab86f9ef-03ac-405c-a559-51b98ef4f316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:22.904179 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ab86f9ef-03ac-405c-a559-51b98ef4f316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042390 Apr 07 13:15:22.904728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 515/1146] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:22 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:23.916464 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a6988980-2b1b-4e02-a6e3-845e88711e7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:23.917390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a6988980-2b1b-4e02-a6e3-845e88711e7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:23.923635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a6988980-2b1b-4e02-a6e3-845e88711e7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:23.924107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a6988980-2b1b-4e02-a6e3-845e88711e7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:23.924886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a6988980-2b1b-4e02-a6e3-845e88711e7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:23.925318 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a6988980-2b1b-4e02-a6e3-845e88711e7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:23.953155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a6988980-2b1b-4e02-a6e3-845e88711e7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040642 Apr 07 13:15:23.953695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 632/1147] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:23 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:24.965433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-be5dbb87-9aac-4226-bc0d-2d50b456ed62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:24.966366 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-be5dbb87-9aac-4226-bc0d-2d50b456ed62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:24.973235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-be5dbb87-9aac-4226-bc0d-2d50b456ed62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:24.973688 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-be5dbb87-9aac-4226-bc0d-2d50b456ed62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:24.974458 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-be5dbb87-9aac-4226-bc0d-2d50b456ed62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:24.974897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-be5dbb87-9aac-4226-bc0d-2d50b456ed62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:25.002073 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-be5dbb87-9aac-4226-bc0d-2d50b456ed62 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040629 Apr 07 13:15:25.002701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 516/1148] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:24 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:26.012862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5c4f0be6-9b86-417f-aee8-ee375f0af9fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:26.013798 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5c4f0be6-9b86-417f-aee8-ee375f0af9fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:26.019993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c4f0be6-9b86-417f-aee8-ee375f0af9fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:26.020487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c4f0be6-9b86-417f-aee8-ee375f0af9fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:26.021249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c4f0be6-9b86-417f-aee8-ee375f0af9fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:26.021690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c4f0be6-9b86-417f-aee8-ee375f0af9fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:26.050538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5c4f0be6-9b86-417f-aee8-ee375f0af9fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040976 Apr 07 13:15:26.051088 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 633/1149] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:26 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:27.061544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2814e238-d596-4c8b-aa9d-bd74f424eff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:27.062508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2814e238-d596-4c8b-aa9d-bd74f424eff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:27.069080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2814e238-d596-4c8b-aa9d-bd74f424eff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:27.069545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2814e238-d596-4c8b-aa9d-bd74f424eff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:27.070315 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2814e238-d596-4c8b-aa9d-bd74f424eff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:27.070761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2814e238-d596-4c8b-aa9d-bd74f424eff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:27.098756 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2814e238-d596-4c8b-aa9d-bd74f424eff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041220 Apr 07 13:15:27.099307 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 517/1150] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:28.110399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9a21ad8f-e8ce-45b3-974c-7b263f02d510 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:28.111325 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9a21ad8f-e8ce-45b3-974c-7b263f02d510 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:28.117735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a21ad8f-e8ce-45b3-974c-7b263f02d510 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:28.118185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a21ad8f-e8ce-45b3-974c-7b263f02d510 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:28.118940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a21ad8f-e8ce-45b3-974c-7b263f02d510 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:28.119401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a21ad8f-e8ce-45b3-974c-7b263f02d510 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:28.148039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9a21ad8f-e8ce-45b3-974c-7b263f02d510 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041569 Apr 07 13:15:28.148627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 634/1151] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:28 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:29.159406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3818d212-5658-4bf8-aa57-5f02a448288b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:29.160673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3818d212-5658-4bf8-aa57-5f02a448288b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:29.166946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3818d212-5658-4bf8-aa57-5f02a448288b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:29.167392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3818d212-5658-4bf8-aa57-5f02a448288b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:29.168221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3818d212-5658-4bf8-aa57-5f02a448288b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:29.168607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3818d212-5658-4bf8-aa57-5f02a448288b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:29.197496 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3818d212-5658-4bf8-aa57-5f02a448288b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042350 Apr 07 13:15:29.198041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 518/1152] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:29 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:30.209711 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d963c478-3e39-4ce5-bdc1-45fd3c0890fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:30.210704 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d963c478-3e39-4ce5-bdc1-45fd3c0890fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:30.217040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d963c478-3e39-4ce5-bdc1-45fd3c0890fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:30.217495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d963c478-3e39-4ce5-bdc1-45fd3c0890fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:30.218261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d963c478-3e39-4ce5-bdc1-45fd3c0890fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:30.218697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d963c478-3e39-4ce5-bdc1-45fd3c0890fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:30.246575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d963c478-3e39-4ce5-bdc1-45fd3c0890fc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041337 Apr 07 13:15:30.247124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 635/1153] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:30 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:31.258713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b52adde4-6322-423f-a1d8-c12d9ae32162 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:31.259672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b52adde4-6322-423f-a1d8-c12d9ae32162 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:31.265902 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b52adde4-6322-423f-a1d8-c12d9ae32162 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:31.266350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b52adde4-6322-423f-a1d8-c12d9ae32162 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:31.267109 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b52adde4-6322-423f-a1d8-c12d9ae32162 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:31.267546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b52adde4-6322-423f-a1d8-c12d9ae32162 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:31.295532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b52adde4-6322-423f-a1d8-c12d9ae32162 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040824 Apr 07 13:15:31.296063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 519/1154] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:31 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:32.306929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-684177b4-7a23-450d-ac2b-74d92ec1bc3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:32.307852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-684177b4-7a23-450d-ac2b-74d92ec1bc3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:32.314138 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-684177b4-7a23-450d-ac2b-74d92ec1bc3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:32.314587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-684177b4-7a23-450d-ac2b-74d92ec1bc3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:32.315341 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-684177b4-7a23-450d-ac2b-74d92ec1bc3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:32.315857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-684177b4-7a23-450d-ac2b-74d92ec1bc3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:32.342920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-684177b4-7a23-450d-ac2b-74d92ec1bc3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039912 Apr 07 13:15:32.343458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 636/1155] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:15:33.355066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b676c5ec-f6c0-4c1b-a7f7-8a518bb37198 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:33.356002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b676c5ec-f6c0-4c1b-a7f7-8a518bb37198 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:33.363319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b676c5ec-f6c0-4c1b-a7f7-8a518bb37198 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:33.363768 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b676c5ec-f6c0-4c1b-a7f7-8a518bb37198 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:33.364562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b676c5ec-f6c0-4c1b-a7f7-8a518bb37198 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:33.364995 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b676c5ec-f6c0-4c1b-a7f7-8a518bb37198 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:33.393106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b676c5ec-f6c0-4c1b-a7f7-8a518bb37198 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041984 Apr 07 13:15:33.393643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 520/1156] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:33 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:34.404669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-768feccf-f002-4643-8ce2-ecad05542c8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:34.405590 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-768feccf-f002-4643-8ce2-ecad05542c8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:34.412640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-768feccf-f002-4643-8ce2-ecad05542c8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:34.413084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-768feccf-f002-4643-8ce2-ecad05542c8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:34.413835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-768feccf-f002-4643-8ce2-ecad05542c8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:34.414268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-768feccf-f002-4643-8ce2-ecad05542c8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:34.452091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-768feccf-f002-4643-8ce2-ecad05542c8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051420 Apr 07 13:15:34.452672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 637/1157] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:34 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:35.463579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-53216f76-046a-4b50-a3ea-12bd7305e07a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:35.464528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-53216f76-046a-4b50-a3ea-12bd7305e07a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:35.470499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-53216f76-046a-4b50-a3ea-12bd7305e07a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:35.470949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-53216f76-046a-4b50-a3ea-12bd7305e07a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:35.471806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-53216f76-046a-4b50-a3ea-12bd7305e07a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:35.472273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-53216f76-046a-4b50-a3ea-12bd7305e07a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:35.499803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-53216f76-046a-4b50-a3ea-12bd7305e07a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040187 Apr 07 13:15:35.500378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 521/1158] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:35 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:36.512235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-75db4e63-adc6-4548-bb28-3335270ee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:36.513070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-75db4e63-adc6-4548-bb28-3335270ee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:36.519962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-75db4e63-adc6-4548-bb28-3335270ee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:36.520431 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-75db4e63-adc6-4548-bb28-3335270ee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:36.521185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-75db4e63-adc6-4548-bb28-3335270ee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:36.521616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-75db4e63-adc6-4548-bb28-3335270ee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:36.549330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-75db4e63-adc6-4548-bb28-3335270ee460 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041112 Apr 07 13:15:36.549866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 638/1159] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:36 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:37.560866 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-15806bba-4cb5-4750-9945-f764d53c3240 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:37.561711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-15806bba-4cb5-4750-9945-f764d53c3240 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:37.568195 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-15806bba-4cb5-4750-9945-f764d53c3240 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:37.568658 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-15806bba-4cb5-4750-9945-f764d53c3240 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:37.569437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-15806bba-4cb5-4750-9945-f764d53c3240 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:37.569880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-15806bba-4cb5-4750-9945-f764d53c3240 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:37.598573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-15806bba-4cb5-4750-9945-f764d53c3240 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041714 Apr 07 13:15:37.599125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 522/1160] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:38.609420 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9690d980-5c45-4131-af7b-2eec431c9e42 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:38.610337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9690d980-5c45-4131-af7b-2eec431c9e42 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:38.617136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9690d980-5c45-4131-af7b-2eec431c9e42 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:38.617584 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9690d980-5c45-4131-af7b-2eec431c9e42 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:38.618336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9690d980-5c45-4131-af7b-2eec431c9e42 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:38.618768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9690d980-5c45-4131-af7b-2eec431c9e42 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:38.646710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9690d980-5c45-4131-af7b-2eec431c9e42 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041279 Apr 07 13:15:38.647244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 639/1161] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:39.658178 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-45340249-a9f6-4483-b6a4-d75fe27eca47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:39.659376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-45340249-a9f6-4483-b6a4-d75fe27eca47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:39.666643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-45340249-a9f6-4483-b6a4-d75fe27eca47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:39.666919 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-45340249-a9f6-4483-b6a4-d75fe27eca47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:39.667693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-45340249-a9f6-4483-b6a4-d75fe27eca47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:39.668135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-45340249-a9f6-4483-b6a4-d75fe27eca47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:39.696063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-45340249-a9f6-4483-b6a4-d75fe27eca47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041776 Apr 07 13:15:39.696638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 523/1162] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:39 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:40.708530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9e20c4a0-207d-4791-a439-1870e8adf28a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:40.709451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9e20c4a0-207d-4791-a439-1870e8adf28a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:40.715640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e20c4a0-207d-4791-a439-1870e8adf28a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:40.716091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e20c4a0-207d-4791-a439-1870e8adf28a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:40.716882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e20c4a0-207d-4791-a439-1870e8adf28a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:40.717313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e20c4a0-207d-4791-a439-1870e8adf28a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:40.745576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9e20c4a0-207d-4791-a439-1870e8adf28a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041559 Apr 07 13:15:40.746121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 640/1163] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:40 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:41.757622 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0c52898a-c60b-475f-b04e-3908f9800d57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:41.758555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0c52898a-c60b-475f-b04e-3908f9800d57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:41.764868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0c52898a-c60b-475f-b04e-3908f9800d57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:41.765323 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0c52898a-c60b-475f-b04e-3908f9800d57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:41.766086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0c52898a-c60b-475f-b04e-3908f9800d57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:41.766527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0c52898a-c60b-475f-b04e-3908f9800d57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:41.794887 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0c52898a-c60b-475f-b04e-3908f9800d57 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041129 Apr 07 13:15:41.795460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 524/1164] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:41 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:42.806337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-771f5344-e123-466a-a1fd-c42733961d68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:42.807288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-771f5344-e123-466a-a1fd-c42733961d68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:42.813558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-771f5344-e123-466a-a1fd-c42733961d68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:42.814015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-771f5344-e123-466a-a1fd-c42733961d68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:42.815204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-771f5344-e123-466a-a1fd-c42733961d68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:42.815405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-771f5344-e123-466a-a1fd-c42733961d68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:42.843399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-771f5344-e123-466a-a1fd-c42733961d68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041059 Apr 07 13:15:42.843945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 641/1165] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:42 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:43.854964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7d282190-8211-46c0-bfda-47100a22a02f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:43.855893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7d282190-8211-46c0-bfda-47100a22a02f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:43.862745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d282190-8211-46c0-bfda-47100a22a02f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:43.863196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d282190-8211-46c0-bfda-47100a22a02f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:43.863966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d282190-8211-46c0-bfda-47100a22a02f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:43.864437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d282190-8211-46c0-bfda-47100a22a02f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:43.892111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7d282190-8211-46c0-bfda-47100a22a02f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 Apr 07 13:15:43.892882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 525/1166] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:43 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:44.902911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-53bc7b1d-0578-4138-98cd-66d7c83004a9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:44.903848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-53bc7b1d-0578-4138-98cd-66d7c83004a9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:44.910665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53bc7b1d-0578-4138-98cd-66d7c83004a9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:44.911115 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53bc7b1d-0578-4138-98cd-66d7c83004a9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:44.911877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53bc7b1d-0578-4138-98cd-66d7c83004a9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:44.912357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53bc7b1d-0578-4138-98cd-66d7c83004a9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:44.940219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-53bc7b1d-0578-4138-98cd-66d7c83004a9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040711 Apr 07 13:15:44.940784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 642/1167] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:44 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:45.951839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d265d101-3ef8-4262-aa15-125418a23405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:45.952799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d265d101-3ef8-4262-aa15-125418a23405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:45.959702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d265d101-3ef8-4262-aa15-125418a23405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:45.960166 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d265d101-3ef8-4262-aa15-125418a23405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:45.960980 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d265d101-3ef8-4262-aa15-125418a23405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:45.961423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d265d101-3ef8-4262-aa15-125418a23405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:45.990279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d265d101-3ef8-4262-aa15-125418a23405 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042352 Apr 07 13:15:45.990843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 526/1168] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:45 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:47.002487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8ae3fcb5-df8d-4276-92e5-9bc715750e25 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:47.003548 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8ae3fcb5-df8d-4276-92e5-9bc715750e25 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:47.009737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ae3fcb5-df8d-4276-92e5-9bc715750e25 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:47.010184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ae3fcb5-df8d-4276-92e5-9bc715750e25 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:47.010930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ae3fcb5-df8d-4276-92e5-9bc715750e25 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:47.011357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8ae3fcb5-df8d-4276-92e5-9bc715750e25 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:47.039634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8ae3fcb5-df8d-4276-92e5-9bc715750e25 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041689 Apr 07 13:15:47.040190 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 643/1169] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:46 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:48.050714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0b64c69f-b601-45bd-a8cd-a58fa60ce76a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:48.051650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0b64c69f-b601-45bd-a8cd-a58fa60ce76a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:48.058088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0b64c69f-b601-45bd-a8cd-a58fa60ce76a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:48.058582 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0b64c69f-b601-45bd-a8cd-a58fa60ce76a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:48.059354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0b64c69f-b601-45bd-a8cd-a58fa60ce76a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:48.059828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0b64c69f-b601-45bd-a8cd-a58fa60ce76a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:48.089336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0b64c69f-b601-45bd-a8cd-a58fa60ce76a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042616 Apr 07 13:15:48.089889 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 527/1170] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:48 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:49.101682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a30f15f0-dba8-4b56-a0b2-f5d10a00ed6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:49.102617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a30f15f0-dba8-4b56-a0b2-f5d10a00ed6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:49.108982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a30f15f0-dba8-4b56-a0b2-f5d10a00ed6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:49.109436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a30f15f0-dba8-4b56-a0b2-f5d10a00ed6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:49.110200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a30f15f0-dba8-4b56-a0b2-f5d10a00ed6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:49.110638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a30f15f0-dba8-4b56-a0b2-f5d10a00ed6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:49.138070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a30f15f0-dba8-4b56-a0b2-f5d10a00ed6a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040332 Apr 07 13:15:49.138613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 644/1171] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:49 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:15:50.149744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c085e6d0-d95d-451b-a007-96ad46f3863f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:50.150677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c085e6d0-d95d-451b-a007-96ad46f3863f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:50.157122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c085e6d0-d95d-451b-a007-96ad46f3863f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:50.157574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c085e6d0-d95d-451b-a007-96ad46f3863f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:50.159474 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c085e6d0-d95d-451b-a007-96ad46f3863f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:50.160261 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c085e6d0-d95d-451b-a007-96ad46f3863f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:50.193277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c085e6d0-d95d-451b-a007-96ad46f3863f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047562 Apr 07 13:15:50.193827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 528/1172] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:51.205506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b274a859-4e8b-425a-b954-7da17a90bc12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:51.206428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b274a859-4e8b-425a-b954-7da17a90bc12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:51.212761 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b274a859-4e8b-425a-b954-7da17a90bc12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:51.213214 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b274a859-4e8b-425a-b954-7da17a90bc12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:51.213973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b274a859-4e8b-425a-b954-7da17a90bc12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:51.214408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b274a859-4e8b-425a-b954-7da17a90bc12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:51.243158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b274a859-4e8b-425a-b954-7da17a90bc12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042140 Apr 07 13:15:51.243704 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 645/1173] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:51 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:52.255420 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ac09be0a-1a84-43c1-be6f-8c7ee081ad72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:52.256306 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ac09be0a-1a84-43c1-be6f-8c7ee081ad72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:52.262602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac09be0a-1a84-43c1-be6f-8c7ee081ad72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:52.263061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac09be0a-1a84-43c1-be6f-8c7ee081ad72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:52.263841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac09be0a-1a84-43c1-be6f-8c7ee081ad72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:52.264320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac09be0a-1a84-43c1-be6f-8c7ee081ad72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:52.294010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ac09be0a-1a84-43c1-be6f-8c7ee081ad72 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043273 Apr 07 13:15:52.294571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 529/1174] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:52 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:53.305814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3a9afa41-1f4a-4776-801a-16c5fdc45ec2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:53.306688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3a9afa41-1f4a-4776-801a-16c5fdc45ec2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:53.312608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3a9afa41-1f4a-4776-801a-16c5fdc45ec2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:53.313053 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3a9afa41-1f4a-4776-801a-16c5fdc45ec2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:53.313811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3a9afa41-1f4a-4776-801a-16c5fdc45ec2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:53.314810 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3a9afa41-1f4a-4776-801a-16c5fdc45ec2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:53.343047 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3a9afa41-1f4a-4776-801a-16c5fdc45ec2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041274 Apr 07 13:15:53.343579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 646/1175] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:53 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:54.354544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-82c4339a-e2b8-4fd2-8b54-2abe68066b9d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:54.355472 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-82c4339a-e2b8-4fd2-8b54-2abe68066b9d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:54.362329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-82c4339a-e2b8-4fd2-8b54-2abe68066b9d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:54.362782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-82c4339a-e2b8-4fd2-8b54-2abe68066b9d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:54.363542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-82c4339a-e2b8-4fd2-8b54-2abe68066b9d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:54.363979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-82c4339a-e2b8-4fd2-8b54-2abe68066b9d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:54.392120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-82c4339a-e2b8-4fd2-8b54-2abe68066b9d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041544 Apr 07 13:15:54.393702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 530/1176] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:54 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:55.404018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-17b91ea4-2ea7-4b04-8d8f-e1c5e352ce92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:55.404972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-17b91ea4-2ea7-4b04-8d8f-e1c5e352ce92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:55.411760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-17b91ea4-2ea7-4b04-8d8f-e1c5e352ce92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:55.412263 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-17b91ea4-2ea7-4b04-8d8f-e1c5e352ce92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:55.413070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-17b91ea4-2ea7-4b04-8d8f-e1c5e352ce92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:55.413512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-17b91ea4-2ea7-4b04-8d8f-e1c5e352ce92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:55.441787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-17b91ea4-2ea7-4b04-8d8f-e1c5e352ce92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041660 Apr 07 13:15:55.442373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 647/1177] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:55 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:56.453289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-64fef183-e2ae-4414-bc9c-48a1d9819f61 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:56.454217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-64fef183-e2ae-4414-bc9c-48a1d9819f61 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:56.461202 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-64fef183-e2ae-4414-bc9c-48a1d9819f61 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:56.461653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-64fef183-e2ae-4414-bc9c-48a1d9819f61 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:56.462410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-64fef183-e2ae-4414-bc9c-48a1d9819f61 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:56.462843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-64fef183-e2ae-4414-bc9c-48a1d9819f61 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:56.491207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-64fef183-e2ae-4414-bc9c-48a1d9819f61 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041893 Apr 07 13:15:56.491739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 531/1178] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:56 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:57.503856 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-14686137-a164-48d6-a1b9-0feeaff5413b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:57.504724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-14686137-a164-48d6-a1b9-0feeaff5413b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:57.511009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14686137-a164-48d6-a1b9-0feeaff5413b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:57.511455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14686137-a164-48d6-a1b9-0feeaff5413b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:57.512242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14686137-a164-48d6-a1b9-0feeaff5413b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:57.512673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14686137-a164-48d6-a1b9-0feeaff5413b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:57.541278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-14686137-a164-48d6-a1b9-0feeaff5413b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042577 Apr 07 13:15:57.541815 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 648/1179] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:58.552953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eb5a19ed-a5e7-4b96-97ad-4f5769dc15b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:58.553791 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-eb5a19ed-a5e7-4b96-97ad-4f5769dc15b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:58.560070 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb5a19ed-a5e7-4b96-97ad-4f5769dc15b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:58.560557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb5a19ed-a5e7-4b96-97ad-4f5769dc15b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:58.561320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb5a19ed-a5e7-4b96-97ad-4f5769dc15b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:58.561757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb5a19ed-a5e7-4b96-97ad-4f5769dc15b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:58.590706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eb5a19ed-a5e7-4b96-97ad-4f5769dc15b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041914 Apr 07 13:15:58.591270 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 532/1180] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:15:59.602728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f7219db9-c395-4531-a7aa-d9212c93efc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:15:59.603643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f7219db9-c395-4531-a7aa-d9212c93efc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:15:59.609963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7219db9-c395-4531-a7aa-d9212c93efc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:59.610409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7219db9-c395-4531-a7aa-d9212c93efc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:59.611159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7219db9-c395-4531-a7aa-d9212c93efc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:15:59.611589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7219db9-c395-4531-a7aa-d9212c93efc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:15:59.638666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f7219db9-c395-4531-a7aa-d9212c93efc0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039920 Apr 07 13:15:59.639203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 649/1181] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:15:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:00.650987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bfd30410-a0f9-42d1-9f78-0f364b4eecc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:00.651911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bfd30410-a0f9-42d1-9f78-0f364b4eecc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:00.658411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bfd30410-a0f9-42d1-9f78-0f364b4eecc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:00.658865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bfd30410-a0f9-42d1-9f78-0f364b4eecc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:00.659632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bfd30410-a0f9-42d1-9f78-0f364b4eecc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:00.660358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bfd30410-a0f9-42d1-9f78-0f364b4eecc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:00.687718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bfd30410-a0f9-42d1-9f78-0f364b4eecc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040731 Apr 07 13:16:00.688280 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 533/1182] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:00 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:01.699359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6e9441b8-94a3-49ca-9f26-c6b1f48e3b47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:01.700360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6e9441b8-94a3-49ca-9f26-c6b1f48e3b47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:01.707251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e9441b8-94a3-49ca-9f26-c6b1f48e3b47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:01.707704 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e9441b8-94a3-49ca-9f26-c6b1f48e3b47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:01.708509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e9441b8-94a3-49ca-9f26-c6b1f48e3b47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:01.708941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e9441b8-94a3-49ca-9f26-c6b1f48e3b47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:01.737048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6e9441b8-94a3-49ca-9f26-c6b1f48e3b47 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041569 Apr 07 13:16:01.737589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 650/1183] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:01 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:16:02.748905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ff0d13f3-c0c3-4bb8-9e68-523ef07fef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:02.749845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ff0d13f3-c0c3-4bb8-9e68-523ef07fef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:02.758326 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff0d13f3-c0c3-4bb8-9e68-523ef07fef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:02.759138 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff0d13f3-c0c3-4bb8-9e68-523ef07fef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:02.760378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff0d13f3-c0c3-4bb8-9e68-523ef07fef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:02.760835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff0d13f3-c0c3-4bb8-9e68-523ef07fef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:02.794136 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ff0d13f3-c0c3-4bb8-9e68-523ef07fef09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049169 Apr 07 13:16:02.794701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 534/1184] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:02 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:03.806027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b9274e1a-6271-4a8f-b93b-0fbcef8c058e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:03.806873 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b9274e1a-6271-4a8f-b93b-0fbcef8c058e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:03.813202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b9274e1a-6271-4a8f-b93b-0fbcef8c058e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:03.813657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b9274e1a-6271-4a8f-b93b-0fbcef8c058e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:03.814531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b9274e1a-6271-4a8f-b93b-0fbcef8c058e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:03.814968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b9274e1a-6271-4a8f-b93b-0fbcef8c058e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:03.842643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b9274e1a-6271-4a8f-b93b-0fbcef8c058e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040687 Apr 07 13:16:03.843188 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 651/1185] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:03 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:04.854694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-213c50cd-525f-4c80-8a2e-84709943bdaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:04.855619 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-213c50cd-525f-4c80-8a2e-84709943bdaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:04.862442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-213c50cd-525f-4c80-8a2e-84709943bdaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:04.863065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-213c50cd-525f-4c80-8a2e-84709943bdaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:04.865026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-213c50cd-525f-4c80-8a2e-84709943bdaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:04.866643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-213c50cd-525f-4c80-8a2e-84709943bdaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:04.903604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-213c50cd-525f-4c80-8a2e-84709943bdaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052826 Apr 07 13:16:04.904197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 535/1186] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:04 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:05.915324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2ba7a186-04f8-4377-9b6c-d65b87ea8606 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:05.916295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2ba7a186-04f8-4377-9b6c-d65b87ea8606 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:05.922494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2ba7a186-04f8-4377-9b6c-d65b87ea8606 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:05.922952 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2ba7a186-04f8-4377-9b6c-d65b87ea8606 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:05.924505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2ba7a186-04f8-4377-9b6c-d65b87ea8606 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:05.924948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2ba7a186-04f8-4377-9b6c-d65b87ea8606 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:05.953232 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2ba7a186-04f8-4377-9b6c-d65b87ea8606 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041821 Apr 07 13:16:05.953790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 652/1187] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:05 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:06.965414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-11032ad6-e85f-4474-a122-f8bd13ddb84e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:06.966372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-11032ad6-e85f-4474-a122-f8bd13ddb84e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:06.973272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11032ad6-e85f-4474-a122-f8bd13ddb84e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:06.973728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11032ad6-e85f-4474-a122-f8bd13ddb84e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:06.974535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11032ad6-e85f-4474-a122-f8bd13ddb84e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:06.974975 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11032ad6-e85f-4474-a122-f8bd13ddb84e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:07.002319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-11032ad6-e85f-4474-a122-f8bd13ddb84e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040887 Apr 07 13:16:07.002890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 536/1188] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:06 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:08.014075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-73e8fbed-4486-4f16-978d-d5883d84a59b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:08.014923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-73e8fbed-4486-4f16-978d-d5883d84a59b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:08.021251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-73e8fbed-4486-4f16-978d-d5883d84a59b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:08.021701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-73e8fbed-4486-4f16-978d-d5883d84a59b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:08.022462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-73e8fbed-4486-4f16-978d-d5883d84a59b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:08.022899 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-73e8fbed-4486-4f16-978d-d5883d84a59b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:08.052036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-73e8fbed-4486-4f16-978d-d5883d84a59b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041966 Apr 07 13:16:08.052624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 653/1189] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:08 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:09.063509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-13325216-bf27-4a1c-b138-680204d0d217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:09.065048 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-13325216-bf27-4a1c-b138-680204d0d217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:09.071322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-13325216-bf27-4a1c-b138-680204d0d217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:09.071779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-13325216-bf27-4a1c-b138-680204d0d217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:09.072578 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-13325216-bf27-4a1c-b138-680204d0d217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:09.073018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-13325216-bf27-4a1c-b138-680204d0d217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:09.100982 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-13325216-bf27-4a1c-b138-680204d0d217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041487 Apr 07 13:16:09.101519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 537/1190] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:09 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:10.112768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-df43b8d9-8cac-4467-9c8f-9144c8b8803a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:10.113734 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-df43b8d9-8cac-4467-9c8f-9144c8b8803a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:10.119952 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-df43b8d9-8cac-4467-9c8f-9144c8b8803a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:10.120431 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-df43b8d9-8cac-4467-9c8f-9144c8b8803a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:10.121195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-df43b8d9-8cac-4467-9c8f-9144c8b8803a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:10.121632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-df43b8d9-8cac-4467-9c8f-9144c8b8803a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:10.149833 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-df43b8d9-8cac-4467-9c8f-9144c8b8803a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041239 Apr 07 13:16:10.150372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 654/1191] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:10 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:11.162637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3d8907f4-a9ba-4b4a-85d1-2bbb8a55d4ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:11.163569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3d8907f4-a9ba-4b4a-85d1-2bbb8a55d4ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:11.169492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d8907f4-a9ba-4b4a-85d1-2bbb8a55d4ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:11.169948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d8907f4-a9ba-4b4a-85d1-2bbb8a55d4ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:11.170720 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d8907f4-a9ba-4b4a-85d1-2bbb8a55d4ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:11.171160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d8907f4-a9ba-4b4a-85d1-2bbb8a55d4ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:11.199369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3d8907f4-a9ba-4b4a-85d1-2bbb8a55d4ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042066 Apr 07 13:16:11.199914 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 538/1192] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:11 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:12.211046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6071c12a-2cc2-4881-9554-b4720c10e9d4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:12.211889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6071c12a-2cc2-4881-9554-b4720c10e9d4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:12.218478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6071c12a-2cc2-4881-9554-b4720c10e9d4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:12.218934 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6071c12a-2cc2-4881-9554-b4720c10e9d4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:12.219717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6071c12a-2cc2-4881-9554-b4720c10e9d4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:12.220175 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6071c12a-2cc2-4881-9554-b4720c10e9d4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:12.250720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6071c12a-2cc2-4881-9554-b4720c10e9d4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043678 Apr 07 13:16:12.251886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 655/1193] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:12 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:13.264621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3413a641-8a77-4f58-b477-0b3d8b667fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:13.265489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3413a641-8a77-4f58-b477-0b3d8b667fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:13.272636 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3413a641-8a77-4f58-b477-0b3d8b667fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:13.273096 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3413a641-8a77-4f58-b477-0b3d8b667fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:13.273870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3413a641-8a77-4f58-b477-0b3d8b667fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:13.274309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3413a641-8a77-4f58-b477-0b3d8b667fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:13.302684 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3413a641-8a77-4f58-b477-0b3d8b667fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042192 Apr 07 13:16:13.303418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 539/1194] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:13 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:14.315064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f1224a4c-1afc-4eb4-acc8-f3af00b46c38 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:14.315912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f1224a4c-1afc-4eb4-acc8-f3af00b46c38 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:14.322278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1224a4c-1afc-4eb4-acc8-f3af00b46c38 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:14.322723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1224a4c-1afc-4eb4-acc8-f3af00b46c38 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:14.323489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1224a4c-1afc-4eb4-acc8-f3af00b46c38 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:14.323961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1224a4c-1afc-4eb4-acc8-f3af00b46c38 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:14.354253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f1224a4c-1afc-4eb4-acc8-f3af00b46c38 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Apr 07 13:16:14.354811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 656/1195] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:14 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:15.365050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-34a9b62a-01b8-4060-a6ca-3b8117cd0dd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:15.366022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-34a9b62a-01b8-4060-a6ca-3b8117cd0dd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:15.372353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34a9b62a-01b8-4060-a6ca-3b8117cd0dd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:15.372810 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34a9b62a-01b8-4060-a6ca-3b8117cd0dd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:15.373580 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34a9b62a-01b8-4060-a6ca-3b8117cd0dd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:15.374022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34a9b62a-01b8-4060-a6ca-3b8117cd0dd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:15.402299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-34a9b62a-01b8-4060-a6ca-3b8117cd0dd1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041183 Apr 07 13:16:15.402853 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 540/1196] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:15 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:16.414633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fd793e7a-8025-4fcb-a4a9-5723743dd30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:16.415559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fd793e7a-8025-4fcb-a4a9-5723743dd30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:16.422058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd793e7a-8025-4fcb-a4a9-5723743dd30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:16.422515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd793e7a-8025-4fcb-a4a9-5723743dd30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:16.423886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd793e7a-8025-4fcb-a4a9-5723743dd30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:16.424367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd793e7a-8025-4fcb-a4a9-5723743dd30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:16.452269 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fd793e7a-8025-4fcb-a4a9-5723743dd30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041521 Apr 07 13:16:16.452828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 657/1197] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:16 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:17.463981 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2f113c7c-eedf-4354-9f85-562e62300626 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:17.464936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2f113c7c-eedf-4354-9f85-562e62300626 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:17.471360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f113c7c-eedf-4354-9f85-562e62300626 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:17.471812 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f113c7c-eedf-4354-9f85-562e62300626 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:17.472608 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f113c7c-eedf-4354-9f85-562e62300626 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:17.473042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f113c7c-eedf-4354-9f85-562e62300626 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:17.502520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2f113c7c-eedf-4354-9f85-562e62300626 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042193 Apr 07 13:16:17.503091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 541/1198] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:17 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:18.514395 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-46ca5c95-83a7-44c5-8d8f-17a494ae86f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:18.515235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-46ca5c95-83a7-44c5-8d8f-17a494ae86f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:18.522599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46ca5c95-83a7-44c5-8d8f-17a494ae86f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:18.523042 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46ca5c95-83a7-44c5-8d8f-17a494ae86f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:18.523798 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46ca5c95-83a7-44c5-8d8f-17a494ae86f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:18.524254 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46ca5c95-83a7-44c5-8d8f-17a494ae86f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:18.553415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-46ca5c95-83a7-44c5-8d8f-17a494ae86f6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043030 Apr 07 13:16:18.554297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 658/1199] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:19.564980 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-032e343e-1f07-40d6-a224-1b4939748866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:19.565842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-032e343e-1f07-40d6-a224-1b4939748866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:19.572091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-032e343e-1f07-40d6-a224-1b4939748866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:19.572582 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-032e343e-1f07-40d6-a224-1b4939748866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:19.573350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-032e343e-1f07-40d6-a224-1b4939748866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:19.573787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-032e343e-1f07-40d6-a224-1b4939748866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:19.603210 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-032e343e-1f07-40d6-a224-1b4939748866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042203 Apr 07 13:16:19.603778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 542/1200] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:19 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:20.614776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e24ffd88-f7a9-4e57-973a-7ab68c9e8fee tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:20.615745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e24ffd88-f7a9-4e57-973a-7ab68c9e8fee tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:20.622102 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e24ffd88-f7a9-4e57-973a-7ab68c9e8fee tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:20.622553 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e24ffd88-f7a9-4e57-973a-7ab68c9e8fee tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:20.623320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e24ffd88-f7a9-4e57-973a-7ab68c9e8fee tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:20.623757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e24ffd88-f7a9-4e57-973a-7ab68c9e8fee tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:20.661104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e24ffd88-f7a9-4e57-973a-7ab68c9e8fee tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050814 Apr 07 13:16:20.661659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 659/1201] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:20 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:21.672684 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ccebacff-5704-4f49-bb45-31885ed9ce0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:21.673655 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ccebacff-5704-4f49-bb45-31885ed9ce0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:21.680108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ccebacff-5704-4f49-bb45-31885ed9ce0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:21.680599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ccebacff-5704-4f49-bb45-31885ed9ce0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:21.681382 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ccebacff-5704-4f49-bb45-31885ed9ce0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:21.681825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ccebacff-5704-4f49-bb45-31885ed9ce0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:21.711108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ccebacff-5704-4f49-bb45-31885ed9ce0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042345 Apr 07 13:16:21.711673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 543/1202] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:21 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:22.723555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4f80c8e4-2f49-4c0a-828e-0e38844188d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:22.724461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4f80c8e4-2f49-4c0a-828e-0e38844188d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:22.730643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f80c8e4-2f49-4c0a-828e-0e38844188d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:22.731091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f80c8e4-2f49-4c0a-828e-0e38844188d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:22.731855 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f80c8e4-2f49-4c0a-828e-0e38844188d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:22.732322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f80c8e4-2f49-4c0a-828e-0e38844188d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:22.760286 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4f80c8e4-2f49-4c0a-828e-0e38844188d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041419 Apr 07 13:16:22.760843 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 660/1203] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:22 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:23.771859 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e6e3012f-e53b-4985-8e7f-4ee1bfe2f7b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:23.772763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e6e3012f-e53b-4985-8e7f-4ee1bfe2f7b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:23.779127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6e3012f-e53b-4985-8e7f-4ee1bfe2f7b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:23.779561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6e3012f-e53b-4985-8e7f-4ee1bfe2f7b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:23.780367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6e3012f-e53b-4985-8e7f-4ee1bfe2f7b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:23.780814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6e3012f-e53b-4985-8e7f-4ee1bfe2f7b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:23.810165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e6e3012f-e53b-4985-8e7f-4ee1bfe2f7b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042261 Apr 07 13:16:23.810709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 544/1204] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:23 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:24.821313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ede092d3-175b-4a91-b832-efe22c984600 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:24.822319 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ede092d3-175b-4a91-b832-efe22c984600 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:24.828478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ede092d3-175b-4a91-b832-efe22c984600 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:24.829563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ede092d3-175b-4a91-b832-efe22c984600 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:24.830593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ede092d3-175b-4a91-b832-efe22c984600 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:24.831025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ede092d3-175b-4a91-b832-efe22c984600 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:24.860059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ede092d3-175b-4a91-b832-efe22c984600 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042719 Apr 07 13:16:24.860750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 661/1205] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:24 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:25.871082 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c65a4b64-1fb2-4d81-a0e7-70eee3aaed53 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:25.872046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c65a4b64-1fb2-4d81-a0e7-70eee3aaed53 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:25.879159 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c65a4b64-1fb2-4d81-a0e7-70eee3aaed53 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:25.879620 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c65a4b64-1fb2-4d81-a0e7-70eee3aaed53 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:25.880419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c65a4b64-1fb2-4d81-a0e7-70eee3aaed53 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:25.880864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c65a4b64-1fb2-4d81-a0e7-70eee3aaed53 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:25.908962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c65a4b64-1fb2-4d81-a0e7-70eee3aaed53 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041882 Apr 07 13:16:25.909505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 545/1206] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:25 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:26.920566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8cc61e1f-4b73-471b-a026-953a56f358aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:26.921491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8cc61e1f-4b73-471b-a026-953a56f358aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:26.927798 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8cc61e1f-4b73-471b-a026-953a56f358aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:26.928273 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8cc61e1f-4b73-471b-a026-953a56f358aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:26.929631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8cc61e1f-4b73-471b-a026-953a56f358aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:26.930066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8cc61e1f-4b73-471b-a026-953a56f358aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:26.958147 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8cc61e1f-4b73-471b-a026-953a56f358aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041692 Apr 07 13:16:26.958688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 662/1207] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:26 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:27.970407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ce772d85-768c-4e69-9c07-7cfed5d72bbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:27.971347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ce772d85-768c-4e69-9c07-7cfed5d72bbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:27.977703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ce772d85-768c-4e69-9c07-7cfed5d72bbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:27.978162 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ce772d85-768c-4e69-9c07-7cfed5d72bbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:27.978933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ce772d85-768c-4e69-9c07-7cfed5d72bbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:27.979381 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ce772d85-768c-4e69-9c07-7cfed5d72bbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:28.007355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ce772d85-768c-4e69-9c07-7cfed5d72bbf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041408 Apr 07 13:16:28.007905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 546/1208] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:29.018778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6da18111-ddfe-4a98-bfd0-3c7bcae7858f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:29.019716 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6da18111-ddfe-4a98-bfd0-3c7bcae7858f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:29.026328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6da18111-ddfe-4a98-bfd0-3c7bcae7858f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:29.026830 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6da18111-ddfe-4a98-bfd0-3c7bcae7858f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:29.027606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6da18111-ddfe-4a98-bfd0-3c7bcae7858f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:29.028036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6da18111-ddfe-4a98-bfd0-3c7bcae7858f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:29.057374 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6da18111-ddfe-4a98-bfd0-3c7bcae7858f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042703 Apr 07 13:16:29.057913 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 663/1209] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:29 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:30.070313 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5c609760-20cb-487d-b05d-9b88b07be345 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:30.071240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5c609760-20cb-487d-b05d-9b88b07be345 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:30.077550 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5c609760-20cb-487d-b05d-9b88b07be345 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:30.078002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5c609760-20cb-487d-b05d-9b88b07be345 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:30.079489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5c609760-20cb-487d-b05d-9b88b07be345 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:30.080078 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5c609760-20cb-487d-b05d-9b88b07be345 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:30.107984 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5c609760-20cb-487d-b05d-9b88b07be345 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042554 Apr 07 13:16:30.108561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 547/1210] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:30 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:31.118872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ab1ce8d6-7bc2-43ee-9dfd-9f448fc671df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:31.119808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ab1ce8d6-7bc2-43ee-9dfd-9f448fc671df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:31.126208 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab1ce8d6-7bc2-43ee-9dfd-9f448fc671df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:31.126806 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab1ce8d6-7bc2-43ee-9dfd-9f448fc671df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:31.127444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab1ce8d6-7bc2-43ee-9dfd-9f448fc671df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:31.127886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab1ce8d6-7bc2-43ee-9dfd-9f448fc671df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:31.156543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ab1ce8d6-7bc2-43ee-9dfd-9f448fc671df tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041625 Apr 07 13:16:31.157660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 664/1211] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:31 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:32.168612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a07bdf9e-7ed7-4938-a9f1-a1b697bfd219 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:32.169544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a07bdf9e-7ed7-4938-a9f1-a1b697bfd219 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:32.176724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a07bdf9e-7ed7-4938-a9f1-a1b697bfd219 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:32.177175 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a07bdf9e-7ed7-4938-a9f1-a1b697bfd219 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:32.177943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a07bdf9e-7ed7-4938-a9f1-a1b697bfd219 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:32.178380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a07bdf9e-7ed7-4938-a9f1-a1b697bfd219 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:32.206195 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a07bdf9e-7ed7-4938-a9f1-a1b697bfd219 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 Apr 07 13:16:32.206733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 548/1212] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:33.217415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-152de5ca-4871-4c58-9341-57d97e44fc92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:33.218398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-152de5ca-4871-4c58-9341-57d97e44fc92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:33.224679 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-152de5ca-4871-4c58-9341-57d97e44fc92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:33.225126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-152de5ca-4871-4c58-9341-57d97e44fc92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:33.225877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-152de5ca-4871-4c58-9341-57d97e44fc92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:33.226324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-152de5ca-4871-4c58-9341-57d97e44fc92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:33.255609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-152de5ca-4871-4c58-9341-57d97e44fc92 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042079 Apr 07 13:16:33.256170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 665/1213] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:33 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:34.267044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ed92c03e-e096-4e88-9bf3-0fbe5341dfd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:34.267975 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ed92c03e-e096-4e88-9bf3-0fbe5341dfd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:34.273884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ed92c03e-e096-4e88-9bf3-0fbe5341dfd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:34.274339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ed92c03e-e096-4e88-9bf3-0fbe5341dfd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:34.275107 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ed92c03e-e096-4e88-9bf3-0fbe5341dfd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:34.275612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ed92c03e-e096-4e88-9bf3-0fbe5341dfd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:34.307144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ed92c03e-e096-4e88-9bf3-0fbe5341dfd4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Apr 07 13:16:34.307711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 549/1214] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:34 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:35.318568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e354305e-463b-4e24-afcd-bc44daaf33ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:35.319502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e354305e-463b-4e24-afcd-bc44daaf33ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:35.325756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e354305e-463b-4e24-afcd-bc44daaf33ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:35.326213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e354305e-463b-4e24-afcd-bc44daaf33ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:35.326982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e354305e-463b-4e24-afcd-bc44daaf33ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:35.327419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e354305e-463b-4e24-afcd-bc44daaf33ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:35.356051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e354305e-463b-4e24-afcd-bc44daaf33ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041324 Apr 07 13:16:35.356638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 666/1215] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:35 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:36.367223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ea24060d-fb08-470f-8c55-389eb2be6df4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:36.368221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ea24060d-fb08-470f-8c55-389eb2be6df4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:36.374388 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea24060d-fb08-470f-8c55-389eb2be6df4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:36.374797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea24060d-fb08-470f-8c55-389eb2be6df4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:36.375782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea24060d-fb08-470f-8c55-389eb2be6df4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:36.376051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ea24060d-fb08-470f-8c55-389eb2be6df4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:36.404290 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ea24060d-fb08-470f-8c55-389eb2be6df4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040908 Apr 07 13:16:36.404841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 550/1216] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:36 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:37.416570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ee4dfcb1-d32b-4de2-b8dd-7f85ef489cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:37.417422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ee4dfcb1-d32b-4de2-b8dd-7f85ef489cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:37.424739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ee4dfcb1-d32b-4de2-b8dd-7f85ef489cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:37.425181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ee4dfcb1-d32b-4de2-b8dd-7f85ef489cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:37.425934 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ee4dfcb1-d32b-4de2-b8dd-7f85ef489cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:37.426364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ee4dfcb1-d32b-4de2-b8dd-7f85ef489cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:37.454373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ee4dfcb1-d32b-4de2-b8dd-7f85ef489cdc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041747 Apr 07 13:16:37.454925 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 667/1217] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:38.465721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-74f69a3a-21a9-48bc-b50c-a99ee94cd153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:38.466586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-74f69a3a-21a9-48bc-b50c-a99ee94cd153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:38.473086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74f69a3a-21a9-48bc-b50c-a99ee94cd153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:38.473543 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74f69a3a-21a9-48bc-b50c-a99ee94cd153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:38.474312 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74f69a3a-21a9-48bc-b50c-a99ee94cd153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:38.474751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74f69a3a-21a9-48bc-b50c-a99ee94cd153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:38.503913 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-74f69a3a-21a9-48bc-b50c-a99ee94cd153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042145 Apr 07 13:16:38.504504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 551/1218] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:39.515125 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8e359755-77f7-454a-b653-cd4fdf8ecfaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:39.517090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8e359755-77f7-454a-b653-cd4fdf8ecfaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:39.523328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8e359755-77f7-454a-b653-cd4fdf8ecfaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:39.523771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8e359755-77f7-454a-b653-cd4fdf8ecfaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:39.524545 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8e359755-77f7-454a-b653-cd4fdf8ecfaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:39.524975 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8e359755-77f7-454a-b653-cd4fdf8ecfaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:39.553858 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8e359755-77f7-454a-b653-cd4fdf8ecfaa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042615 Apr 07 13:16:39.554417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 668/1219] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:39 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:40.565989 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9f531867-a382-4eab-9842-438ba694b1f8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:40.566842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9f531867-a382-4eab-9842-438ba694b1f8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:40.573446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9f531867-a382-4eab-9842-438ba694b1f8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:40.573896 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9f531867-a382-4eab-9842-438ba694b1f8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:40.574664 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9f531867-a382-4eab-9842-438ba694b1f8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:40.575101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9f531867-a382-4eab-9842-438ba694b1f8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:40.604775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9f531867-a382-4eab-9842-438ba694b1f8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043388 Apr 07 13:16:40.605334 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 552/1220] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:40 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:41.616682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-77242ca0-3b4b-4396-8e90-e3726ec45714 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:41.617615 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-77242ca0-3b4b-4396-8e90-e3726ec45714 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:41.623915 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-77242ca0-3b4b-4396-8e90-e3726ec45714 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:41.624395 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-77242ca0-3b4b-4396-8e90-e3726ec45714 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:41.625164 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-77242ca0-3b4b-4396-8e90-e3726ec45714 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:41.625603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-77242ca0-3b4b-4396-8e90-e3726ec45714 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:41.655439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-77242ca0-3b4b-4396-8e90-e3726ec45714 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042864 Apr 07 13:16:41.656316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 669/1221] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:41 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:42.668072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8c4b355d-41cf-454c-98a7-856edb8298ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:42.668964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8c4b355d-41cf-454c-98a7-856edb8298ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:42.675779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c4b355d-41cf-454c-98a7-856edb8298ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:42.676271 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c4b355d-41cf-454c-98a7-856edb8298ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:42.677035 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c4b355d-41cf-454c-98a7-856edb8298ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:42.677474 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c4b355d-41cf-454c-98a7-856edb8298ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:42.705995 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8c4b355d-41cf-454c-98a7-856edb8298ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041836 Apr 07 13:16:42.706544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 553/1222] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:42 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:43.717522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-138a14a0-3c85-4a04-8b8c-fac21c832e0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:43.718383 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-138a14a0-3c85-4a04-8b8c-fac21c832e0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:43.725198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-138a14a0-3c85-4a04-8b8c-fac21c832e0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:43.725636 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-138a14a0-3c85-4a04-8b8c-fac21c832e0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:43.726390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-138a14a0-3c85-4a04-8b8c-fac21c832e0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:43.726824 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-138a14a0-3c85-4a04-8b8c-fac21c832e0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:43.756920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-138a14a0-3c85-4a04-8b8c-fac21c832e0b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043317 Apr 07 13:16:43.757477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 670/1223] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:43 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:44.768667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-57c184ea-6c2d-447e-9db0-f5f570c84e56 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:44.769593 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-57c184ea-6c2d-447e-9db0-f5f570c84e56 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:44.775887 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57c184ea-6c2d-447e-9db0-f5f570c84e56 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:44.776379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57c184ea-6c2d-447e-9db0-f5f570c84e56 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:44.777320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57c184ea-6c2d-447e-9db0-f5f570c84e56 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:44.777572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57c184ea-6c2d-447e-9db0-f5f570c84e56 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:44.807556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-57c184ea-6c2d-447e-9db0-f5f570c84e56 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043184 Apr 07 13:16:44.808120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 554/1224] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:44 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:45.819528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2275f5f1-120b-4aa2-a84a-e00f8ca591b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:45.820409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2275f5f1-120b-4aa2-a84a-e00f8ca591b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:45.826854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2275f5f1-120b-4aa2-a84a-e00f8ca591b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:45.827393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2275f5f1-120b-4aa2-a84a-e00f8ca591b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:45.828689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2275f5f1-120b-4aa2-a84a-e00f8ca591b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:45.829223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2275f5f1-120b-4aa2-a84a-e00f8ca591b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:45.857279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2275f5f1-120b-4aa2-a84a-e00f8ca591b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041706 Apr 07 13:16:45.857840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 671/1225] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:45 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:46.869287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-73bae9d7-57e8-4f66-9ddd-7bde0bfad094 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:46.870335 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-73bae9d7-57e8-4f66-9ddd-7bde0bfad094 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:46.876702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-73bae9d7-57e8-4f66-9ddd-7bde0bfad094 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:46.877163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-73bae9d7-57e8-4f66-9ddd-7bde0bfad094 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:46.877941 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-73bae9d7-57e8-4f66-9ddd-7bde0bfad094 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:46.878386 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-73bae9d7-57e8-4f66-9ddd-7bde0bfad094 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:46.907492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-73bae9d7-57e8-4f66-9ddd-7bde0bfad094 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042105 Apr 07 13:16:46.908043 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 555/1226] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:46 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:47.919830 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-88742ea7-dae0-4c59-b327-3ba9f50fae2b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:47.920809 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-88742ea7-dae0-4c59-b327-3ba9f50fae2b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:47.927546 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-88742ea7-dae0-4c59-b327-3ba9f50fae2b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:47.927996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-88742ea7-dae0-4c59-b327-3ba9f50fae2b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:47.928777 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-88742ea7-dae0-4c59-b327-3ba9f50fae2b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:47.929211 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-88742ea7-dae0-4c59-b327-3ba9f50fae2b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:47.960023 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-88742ea7-dae0-4c59-b327-3ba9f50fae2b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044065 Apr 07 13:16:47.960604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 672/1227] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:47 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:48.971448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1f4b2657-2abb-4f4b-81b7-db3a0ad49dc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:48.972404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1f4b2657-2abb-4f4b-81b7-db3a0ad49dc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:48.978577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f4b2657-2abb-4f4b-81b7-db3a0ad49dc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:48.979020 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f4b2657-2abb-4f4b-81b7-db3a0ad49dc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:48.979787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f4b2657-2abb-4f4b-81b7-db3a0ad49dc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:48.980242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f4b2657-2abb-4f4b-81b7-db3a0ad49dc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:49.007952 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1f4b2657-2abb-4f4b-81b7-db3a0ad49dc1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041113 Apr 07 13:16:49.008523 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 556/1228] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:48 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:50.019256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-36d48cfd-fc90-408d-8360-ea49b722e108 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:50.020199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-36d48cfd-fc90-408d-8360-ea49b722e108 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:50.026345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36d48cfd-fc90-408d-8360-ea49b722e108 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:50.026795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36d48cfd-fc90-408d-8360-ea49b722e108 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:50.027558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36d48cfd-fc90-408d-8360-ea49b722e108 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:50.027996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36d48cfd-fc90-408d-8360-ea49b722e108 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:50.055858 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-36d48cfd-fc90-408d-8360-ea49b722e108 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041095 Apr 07 13:16:50.056449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 673/1229] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:51.068452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f034f02a-79f5-4e8f-b54f-8067394b1473 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:51.070110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f034f02a-79f5-4e8f-b54f-8067394b1473 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:51.076487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f034f02a-79f5-4e8f-b54f-8067394b1473 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:51.076947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f034f02a-79f5-4e8f-b54f-8067394b1473 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:51.077731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f034f02a-79f5-4e8f-b54f-8067394b1473 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:51.078516 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f034f02a-79f5-4e8f-b54f-8067394b1473 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:51.107178 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f034f02a-79f5-4e8f-b54f-8067394b1473 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044137 Apr 07 13:16:51.107721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 557/1230] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:51 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:52.118882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9142c021-6565-4a7a-ae65-15b637289dfb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:52.119741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9142c021-6565-4a7a-ae65-15b637289dfb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:52.126759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9142c021-6565-4a7a-ae65-15b637289dfb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:52.127211 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9142c021-6565-4a7a-ae65-15b637289dfb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:52.127971 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9142c021-6565-4a7a-ae65-15b637289dfb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:52.128434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9142c021-6565-4a7a-ae65-15b637289dfb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:52.157222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9142c021-6565-4a7a-ae65-15b637289dfb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042379 Apr 07 13:16:52.157778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 674/1231] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:52 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:53.169251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1bed8447-7774-4c7b-809e-c54478f0e87d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:53.170187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1bed8447-7774-4c7b-809e-c54478f0e87d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:53.176385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1bed8447-7774-4c7b-809e-c54478f0e87d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:53.176837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1bed8447-7774-4c7b-809e-c54478f0e87d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:53.177718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1bed8447-7774-4c7b-809e-c54478f0e87d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:53.178156 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1bed8447-7774-4c7b-809e-c54478f0e87d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:53.207932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1bed8447-7774-4c7b-809e-c54478f0e87d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042566 Apr 07 13:16:53.208501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 558/1232] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:53 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:54.219320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8a3aa336-b181-416b-8190-5db2a6ee53fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:54.220406 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8a3aa336-b181-416b-8190-5db2a6ee53fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:54.226923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a3aa336-b181-416b-8190-5db2a6ee53fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:54.227368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a3aa336-b181-416b-8190-5db2a6ee53fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:54.228165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a3aa336-b181-416b-8190-5db2a6ee53fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:54.228652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a3aa336-b181-416b-8190-5db2a6ee53fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:54.258614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8a3aa336-b181-416b-8190-5db2a6ee53fd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043274 Apr 07 13:16:54.259168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 675/1233] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:54 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:55.270603 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8af5c1ab-7cdf-4d00-9ab1-6bc3c93fb7ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:55.271470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8af5c1ab-7cdf-4d00-9ab1-6bc3c93fb7ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:55.277761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8af5c1ab-7cdf-4d00-9ab1-6bc3c93fb7ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:55.278461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8af5c1ab-7cdf-4d00-9ab1-6bc3c93fb7ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:55.278978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8af5c1ab-7cdf-4d00-9ab1-6bc3c93fb7ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:55.279415 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8af5c1ab-7cdf-4d00-9ab1-6bc3c93fb7ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:55.307591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8af5c1ab-7cdf-4d00-9ab1-6bc3c93fb7ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040903 Apr 07 13:16:55.308129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 559/1234] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:55 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:56.318847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4963602e-8055-446d-a68c-1787c318b14b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:56.319807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4963602e-8055-446d-a68c-1787c318b14b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:56.326200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4963602e-8055-446d-a68c-1787c318b14b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:56.326670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4963602e-8055-446d-a68c-1787c318b14b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:56.327428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4963602e-8055-446d-a68c-1787c318b14b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:56.328386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4963602e-8055-446d-a68c-1787c318b14b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:56.358328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4963602e-8055-446d-a68c-1787c318b14b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043319 Apr 07 13:16:56.359886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 676/1235] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:56 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:57.370304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-129c329f-b805-4012-b284-96304b69c45f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:57.371227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-129c329f-b805-4012-b284-96304b69c45f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:57.378189 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-129c329f-b805-4012-b284-96304b69c45f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:57.378645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-129c329f-b805-4012-b284-96304b69c45f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:57.379411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-129c329f-b805-4012-b284-96304b69c45f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:57.379847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-129c329f-b805-4012-b284-96304b69c45f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:57.407174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-129c329f-b805-4012-b284-96304b69c45f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040696 Apr 07 13:16:57.407716 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 560/1236] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:58.418657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-81c99e37-cd82-4eab-9f4a-541a378e7518 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:58.419635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-81c99e37-cd82-4eab-9f4a-541a378e7518 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:58.425901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-81c99e37-cd82-4eab-9f4a-541a378e7518 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:58.426290 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-81c99e37-cd82-4eab-9f4a-541a378e7518 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:58.427046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-81c99e37-cd82-4eab-9f4a-541a378e7518 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:58.427477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-81c99e37-cd82-4eab-9f4a-541a378e7518 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:58.456346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-81c99e37-cd82-4eab-9f4a-541a378e7518 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041528 Apr 07 13:16:58.456888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 677/1237] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:16:59.467658 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-59250556-8393-4596-a9ca-500310d30bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:16:59.469257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-59250556-8393-4596-a9ca-500310d30bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:16:59.475546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59250556-8393-4596-a9ca-500310d30bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:59.476004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59250556-8393-4596-a9ca-500310d30bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:59.476817 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59250556-8393-4596-a9ca-500310d30bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:16:59.477263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59250556-8393-4596-a9ca-500310d30bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:16:59.504552 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-59250556-8393-4596-a9ca-500310d30bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040741 Apr 07 13:16:59.505040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 561/1238] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:16:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:00.516314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7dfda726-6117-4d2e-b45c-eed976773218 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:00.517264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7dfda726-6117-4d2e-b45c-eed976773218 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:00.523688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7dfda726-6117-4d2e-b45c-eed976773218 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:00.524134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7dfda726-6117-4d2e-b45c-eed976773218 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:00.524915 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7dfda726-6117-4d2e-b45c-eed976773218 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:00.525345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7dfda726-6117-4d2e-b45c-eed976773218 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:00.552861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7dfda726-6117-4d2e-b45c-eed976773218 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040918 Apr 07 13:17:00.553333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 678/1239] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:00 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:01.564643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-00cdcc70-d209-40da-bec9-5d573672c6a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:01.565698 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-00cdcc70-d209-40da-bec9-5d573672c6a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:01.572014 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-00cdcc70-d209-40da-bec9-5d573672c6a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:01.572508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-00cdcc70-d209-40da-bec9-5d573672c6a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:01.573277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-00cdcc70-d209-40da-bec9-5d573672c6a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:01.573719 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-00cdcc70-d209-40da-bec9-5d573672c6a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:01.602717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-00cdcc70-d209-40da-bec9-5d573672c6a3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 Apr 07 13:17:01.603275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 562/1240] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:01 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:17:02.614481 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1461f0c1-ad91-4e70-b6b6-ff4908123b0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:02.615407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1461f0c1-ad91-4e70-b6b6-ff4908123b0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:02.621920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1461f0c1-ad91-4e70-b6b6-ff4908123b0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:02.622377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1461f0c1-ad91-4e70-b6b6-ff4908123b0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:02.623149 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1461f0c1-ad91-4e70-b6b6-ff4908123b0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:02.623579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1461f0c1-ad91-4e70-b6b6-ff4908123b0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:02.652364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1461f0c1-ad91-4e70-b6b6-ff4908123b0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041662 Apr 07 13:17:02.652863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 679/1241] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:02 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:03.664063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7259c1b9-bedb-43f2-913b-b8edd7553184 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:03.665025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7259c1b9-bedb-43f2-913b-b8edd7553184 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:03.671284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7259c1b9-bedb-43f2-913b-b8edd7553184 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:03.671769 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7259c1b9-bedb-43f2-913b-b8edd7553184 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:03.672686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7259c1b9-bedb-43f2-913b-b8edd7553184 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:03.673127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7259c1b9-bedb-43f2-913b-b8edd7553184 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:03.701610 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7259c1b9-bedb-43f2-913b-b8edd7553184 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041605 Apr 07 13:17:03.702103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 563/1242] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:03 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:17:04.713464 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a884eb46-7b3c-407d-bd64-345b814f11ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:04.714396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a884eb46-7b3c-407d-bd64-345b814f11ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:04.721546 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a884eb46-7b3c-407d-bd64-345b814f11ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:04.722003 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a884eb46-7b3c-407d-bd64-345b814f11ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:04.722799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a884eb46-7b3c-407d-bd64-345b814f11ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:04.723236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a884eb46-7b3c-407d-bd64-345b814f11ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:04.750781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a884eb46-7b3c-407d-bd64-345b814f11ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041146 Apr 07 13:17:04.751340 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 680/1243] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:04 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:05.762071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-87e1da9e-204e-4d13-9c18-1fbe1736b9e9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:05.762997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-87e1da9e-204e-4d13-9c18-1fbe1736b9e9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:05.769439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-87e1da9e-204e-4d13-9c18-1fbe1736b9e9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:05.769886 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-87e1da9e-204e-4d13-9c18-1fbe1736b9e9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:05.770646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-87e1da9e-204e-4d13-9c18-1fbe1736b9e9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:05.771111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-87e1da9e-204e-4d13-9c18-1fbe1736b9e9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:05.799014 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-87e1da9e-204e-4d13-9c18-1fbe1736b9e9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040930 Apr 07 13:17:05.799489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 564/1244] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:05 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:06.810391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d1992b75-6b13-4770-82cc-544cd1e4bd5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:06.811335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d1992b75-6b13-4770-82cc-544cd1e4bd5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:06.818061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d1992b75-6b13-4770-82cc-544cd1e4bd5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:06.818511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d1992b75-6b13-4770-82cc-544cd1e4bd5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:06.819263 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d1992b75-6b13-4770-82cc-544cd1e4bd5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:06.819694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d1992b75-6b13-4770-82cc-544cd1e4bd5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:06.848193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d1992b75-6b13-4770-82cc-544cd1e4bd5c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041573 Apr 07 13:17:06.848673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 681/1245] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:06 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:07.860212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5b4ea37f-6030-40ca-abb5-ecd72645b5f3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:07.861637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5b4ea37f-6030-40ca-abb5-ecd72645b5f3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:07.868209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b4ea37f-6030-40ca-abb5-ecd72645b5f3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:07.868840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b4ea37f-6030-40ca-abb5-ecd72645b5f3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:07.869618 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b4ea37f-6030-40ca-abb5-ecd72645b5f3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:07.870058 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b4ea37f-6030-40ca-abb5-ecd72645b5f3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:07.899950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5b4ea37f-6030-40ca-abb5-ecd72645b5f3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Apr 07 13:17:07.900556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 565/1246] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:07 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:08.911510 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f0884f19-3e4a-43a7-b084-445ecbe8d316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:08.912469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f0884f19-3e4a-43a7-b084-445ecbe8d316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:08.918731 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f0884f19-3e4a-43a7-b084-445ecbe8d316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:08.919179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f0884f19-3e4a-43a7-b084-445ecbe8d316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:08.919935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f0884f19-3e4a-43a7-b084-445ecbe8d316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:08.920404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f0884f19-3e4a-43a7-b084-445ecbe8d316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:08.948393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f0884f19-3e4a-43a7-b084-445ecbe8d316 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041022 Apr 07 13:17:08.948941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 682/1247] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:08 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:09.959297 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-48c3a570-9d07-4338-acb1-67348eaab586 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:09.960285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-48c3a570-9d07-4338-acb1-67348eaab586 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:09.966621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48c3a570-9d07-4338-acb1-67348eaab586 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:09.967085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48c3a570-9d07-4338-acb1-67348eaab586 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:09.967872 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48c3a570-9d07-4338-acb1-67348eaab586 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:09.968962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48c3a570-9d07-4338-acb1-67348eaab586 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:09.996593 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-48c3a570-9d07-4338-acb1-67348eaab586 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041000 Apr 07 13:17:09.997164 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 566/1248] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:09 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:11.008271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-65fdb9c5-721d-4670-bae0-e000e0d704c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:11.009201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-65fdb9c5-721d-4670-bae0-e000e0d704c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:11.016018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65fdb9c5-721d-4670-bae0-e000e0d704c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:11.016495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65fdb9c5-721d-4670-bae0-e000e0d704c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:11.017260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65fdb9c5-721d-4670-bae0-e000e0d704c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:11.017698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65fdb9c5-721d-4670-bae0-e000e0d704c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:11.045784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-65fdb9c5-721d-4670-bae0-e000e0d704c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041390 Apr 07 13:17:11.046469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 683/1249] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:11 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:12.056934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0bd469c5-a676-4f49-830a-228912a1eac3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:12.057901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0bd469c5-a676-4f49-830a-228912a1eac3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:12.064777 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0bd469c5-a676-4f49-830a-228912a1eac3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:12.065236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0bd469c5-a676-4f49-830a-228912a1eac3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:12.066005 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0bd469c5-a676-4f49-830a-228912a1eac3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:12.066450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0bd469c5-a676-4f49-830a-228912a1eac3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:12.094621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0bd469c5-a676-4f49-830a-228912a1eac3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041587 Apr 07 13:17:12.095164 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 567/1250] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:12 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:13.105932 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-557fa7f8-f845-4ac8-b025-7a76173454c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:13.106847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-557fa7f8-f845-4ac8-b025-7a76173454c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:13.113619 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-557fa7f8-f845-4ac8-b025-7a76173454c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:13.114062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-557fa7f8-f845-4ac8-b025-7a76173454c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:13.114814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-557fa7f8-f845-4ac8-b025-7a76173454c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:13.115246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-557fa7f8-f845-4ac8-b025-7a76173454c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:13.144195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-557fa7f8-f845-4ac8-b025-7a76173454c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042030 Apr 07 13:17:13.144754 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 684/1251] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:13 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:14.157289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ba6aaea6-ac83-4f8a-9701-f59af25b5030 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:14.158222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ba6aaea6-ac83-4f8a-9701-f59af25b5030 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:14.165044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ba6aaea6-ac83-4f8a-9701-f59af25b5030 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:14.165498 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ba6aaea6-ac83-4f8a-9701-f59af25b5030 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:14.166274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ba6aaea6-ac83-4f8a-9701-f59af25b5030 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:14.166713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ba6aaea6-ac83-4f8a-9701-f59af25b5030 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:14.202027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ba6aaea6-ac83-4f8a-9701-f59af25b5030 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050506 Apr 07 13:17:14.203316 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 568/1252] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:14 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:15.214240 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8100b4fb-181d-4a00-b29c-c5bfab1235f5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:15.215156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8100b4fb-181d-4a00-b29c-c5bfab1235f5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:15.221340 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8100b4fb-181d-4a00-b29c-c5bfab1235f5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:15.221785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8100b4fb-181d-4a00-b29c-c5bfab1235f5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:15.222539 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8100b4fb-181d-4a00-b29c-c5bfab1235f5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:15.222969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8100b4fb-181d-4a00-b29c-c5bfab1235f5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:15.253496 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8100b4fb-181d-4a00-b29c-c5bfab1235f5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043062 Apr 07 13:17:15.253970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 685/1253] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:15 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:16.265800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-220b305d-77bf-4e29-90e7-446f18f56e34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:16.266732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-220b305d-77bf-4e29-90e7-446f18f56e34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:16.272979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-220b305d-77bf-4e29-90e7-446f18f56e34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:16.273423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-220b305d-77bf-4e29-90e7-446f18f56e34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:16.274176 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-220b305d-77bf-4e29-90e7-446f18f56e34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:16.274610 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-220b305d-77bf-4e29-90e7-446f18f56e34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:16.303480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-220b305d-77bf-4e29-90e7-446f18f56e34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042591 Apr 07 13:17:16.304023 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 569/1254] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:16 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:17.314926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-36083df2-5ffe-4d73-8b05-6c7c3aa914e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:17.315885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-36083df2-5ffe-4d73-8b05-6c7c3aa914e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:17.322261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36083df2-5ffe-4d73-8b05-6c7c3aa914e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:17.322717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36083df2-5ffe-4d73-8b05-6c7c3aa914e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:17.323485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36083df2-5ffe-4d73-8b05-6c7c3aa914e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:17.323927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36083df2-5ffe-4d73-8b05-6c7c3aa914e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:17.351736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-36083df2-5ffe-4d73-8b05-6c7c3aa914e3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040886 Apr 07 13:17:17.352472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 686/1255] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:17 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:18.362735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e6691c1a-25a8-4d9f-ad1e-edeeebdbe85f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:18.363663 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e6691c1a-25a8-4d9f-ad1e-edeeebdbe85f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:18.369896 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6691c1a-25a8-4d9f-ad1e-edeeebdbe85f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:18.370346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6691c1a-25a8-4d9f-ad1e-edeeebdbe85f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:18.371110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6691c1a-25a8-4d9f-ad1e-edeeebdbe85f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:18.371546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6691c1a-25a8-4d9f-ad1e-edeeebdbe85f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:18.400298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e6691c1a-25a8-4d9f-ad1e-edeeebdbe85f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 Apr 07 13:17:18.400848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 570/1256] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:19.411513 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-235ccf7e-c5c4-4f42-8575-5b500f554a8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:19.412477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-235ccf7e-c5c4-4f42-8575-5b500f554a8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:19.418967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-235ccf7e-c5c4-4f42-8575-5b500f554a8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:19.419556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-235ccf7e-c5c4-4f42-8575-5b500f554a8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:19.420405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-235ccf7e-c5c4-4f42-8575-5b500f554a8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:19.421461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-235ccf7e-c5c4-4f42-8575-5b500f554a8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:19.448963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-235ccf7e-c5c4-4f42-8575-5b500f554a8f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041557 Apr 07 13:17:19.449512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 687/1257] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:19 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:20.460961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-adeda662-e8ac-4317-a617-ae3c509eb32a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:20.461961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-adeda662-e8ac-4317-a617-ae3c509eb32a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:20.472558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-adeda662-e8ac-4317-a617-ae3c509eb32a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:20.473204 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-adeda662-e8ac-4317-a617-ae3c509eb32a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:20.474463 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-adeda662-e8ac-4317-a617-ae3c509eb32a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:20.475685 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-adeda662-e8ac-4317-a617-ae3c509eb32a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:20.504480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-adeda662-e8ac-4317-a617-ae3c509eb32a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047660 Apr 07 13:17:20.505032 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 571/1258] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:20 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:21.516738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a222df8c-820c-4676-8850-0b1683669273 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:21.517849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a222df8c-820c-4676-8850-0b1683669273 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:21.524197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a222df8c-820c-4676-8850-0b1683669273 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:21.524674 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a222df8c-820c-4676-8850-0b1683669273 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:21.525457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a222df8c-820c-4676-8850-0b1683669273 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:21.525896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a222df8c-820c-4676-8850-0b1683669273 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:21.553543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a222df8c-820c-4676-8850-0b1683669273 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041532 Apr 07 13:17:21.554090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 688/1259] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:21 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:22.565422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-16041700-abed-42c9-938e-00131927220e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:22.566343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-16041700-abed-42c9-938e-00131927220e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:22.572631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-16041700-abed-42c9-938e-00131927220e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:22.573081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-16041700-abed-42c9-938e-00131927220e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:22.573841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-16041700-abed-42c9-938e-00131927220e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:22.574278 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-16041700-abed-42c9-938e-00131927220e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:22.602416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-16041700-abed-42c9-938e-00131927220e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041377 Apr 07 13:17:22.602957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 572/1260] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:17:22 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:23.225170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ee40ab10-55e0-4c6a-b6f6-5ae5e1a167b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:23.225698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ee40ab10-55e0-4c6a-b6f6-5ae5e1a167b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:23.231586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ee40ab10-55e0-4c6a-b6f6-5ae5e1a167b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:23.232025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ee40ab10-55e0-4c6a-b6f6-5ae5e1a167b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:23.232805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ee40ab10-55e0-4c6a-b6f6-5ae5e1a167b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:23.234352 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ee40ab10-55e0-4c6a-b6f6-5ae5e1a167b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:23.257836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ee40ab10-55e0-4c6a-b6f6-5ae5e1a167b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:17:23.332717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ee40ab10-55e0-4c6a-b6f6-5ae5e1a167b3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 204 len: 0 microversion: 2.1 time: 0.111025 Apr 07 13:17:23.333349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 689/1261] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:17:23 2022] DELETE /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:17:23.342110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3840466a-9aca-4a3f-ba9d-23c21fa494ed tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:23.343349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3840466a-9aca-4a3f-ba9d-23c21fa494ed tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:23.349356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3840466a-9aca-4a3f-ba9d-23c21fa494ed tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:23.349814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3840466a-9aca-4a3f-ba9d-23c21fa494ed tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:23.350586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3840466a-9aca-4a3f-ba9d-23c21fa494ed tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:23.351028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3840466a-9aca-4a3f-ba9d-23c21fa494ed tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:23.547466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3840466a-9aca-4a3f-ba9d-23c21fa494ed tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:23.555371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3840466a-9aca-4a3f-ba9d-23c21fa494ed tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.217102 Apr 07 13:17:23.555939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 573/1262] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:23 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:23.614741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2a296840-9580-4f7e-b66b-8beaf1e1db87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:17:23.615747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2a296840-9580-4f7e-b66b-8beaf1e1db87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:23.621562 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2a296840-9580-4f7e-b66b-8beaf1e1db87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:23.622006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2a296840-9580-4f7e-b66b-8beaf1e1db87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:23.622757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2a296840-9580-4f7e-b66b-8beaf1e1db87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:23.623187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2a296840-9580-4f7e-b66b-8beaf1e1db87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:23.699298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2a296840-9580-4f7e-b66b-8beaf1e1db87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "POST /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/action" status: 200 len: 77142 microversion: 2.1 time: 0.088650 Apr 07 13:17:23.699879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 690/1263] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 13:17:23 2022] POST /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189/action => generated 77142 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:17:24.572441 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b3713c74-683f-42d5-83b5-3b54b9b2c18e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:24.573087 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b3713c74-683f-42d5-83b5-3b54b9b2c18e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:24.579715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3713c74-683f-42d5-83b5-3b54b9b2c18e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:24.580443 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3713c74-683f-42d5-83b5-3b54b9b2c18e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:24.581748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3713c74-683f-42d5-83b5-3b54b9b2c18e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:24.582234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3713c74-683f-42d5-83b5-3b54b9b2c18e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:24.598746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0f900767-9f83-4b14-a079-d973c04185d4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:24.599324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0f900767-9f83-4b14-a079-d973c04185d4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:24.606334 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0f900767-9f83-4b14-a079-d973c04185d4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:24.607007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0f900767-9f83-4b14-a079-d973c04185d4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:24.607773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0f900767-9f83-4b14-a079-d973c04185d4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:24.608778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0f900767-9f83-4b14-a079-d973c04185d4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:24.633686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0f900767-9f83-4b14-a079-d973c04185d4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:17:24.730489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0f900767-9f83-4b14-a079-d973c04185d4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 204 len: 0 microversion: 2.1 time: 0.135456 Apr 07 13:17:24.731257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 691/1264] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:17:24 2022] DELETE /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 07 13:17:24.736700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b3713c74-683f-42d5-83b5-3b54b9b2c18e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:24.740583 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3c3e237a-0b88-4e0f-9ef5-bb78b430bf3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:24.741275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3c3e237a-0b88-4e0f-9ef5-bb78b430bf3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:24.745148 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b3713c74-683f-42d5-83b5-3b54b9b2c18e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.176556 Apr 07 13:17:24.745717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 574/1265] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:24 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:24.747198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c3e237a-0b88-4e0f-9ef5-bb78b430bf3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:24.747657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c3e237a-0b88-4e0f-9ef5-bb78b430bf3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:24.748457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c3e237a-0b88-4e0f-9ef5-bb78b430bf3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:24.748926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c3e237a-0b88-4e0f-9ef5-bb78b430bf3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:24.932492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3c3e237a-0b88-4e0f-9ef5-bb78b430bf3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:24.940870 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3c3e237a-0b88-4e0f-9ef5-bb78b430bf3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.204211 Apr 07 13:17:24.941432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 692/1266] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:24 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:25.698451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-654b2057-dae4-452a-ab5e-c08822622bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:25.699596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-654b2057-dae4-452a-ab5e-c08822622bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:25.715306 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-654b2057-dae4-452a-ab5e-c08822622bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:25.715863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-654b2057-dae4-452a-ab5e-c08822622bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:25.716760 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-654b2057-dae4-452a-ab5e-c08822622bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:25.717416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-654b2057-dae4-452a-ab5e-c08822622bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:25.742031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-654b2057-dae4-452a-ab5e-c08822622bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Going to try to terminate instance {{(pid=116892) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:17:25.762516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7bf4eec7-9a9a-4a88-aeaa-42b8eecc706f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:25.763134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7bf4eec7-9a9a-4a88-aeaa-42b8eecc706f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:25.770076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7bf4eec7-9a9a-4a88-aeaa-42b8eecc706f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:25.770525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7bf4eec7-9a9a-4a88-aeaa-42b8eecc706f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:25.771287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7bf4eec7-9a9a-4a88-aeaa-42b8eecc706f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:25.771726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7bf4eec7-9a9a-4a88-aeaa-42b8eecc706f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:25.827729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-654b2057-dae4-452a-ab5e-c08822622bdb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "DELETE /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 204 len: 0 microversion: 2.20 time: 0.131953 Apr 07 13:17:25.828852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 575/1267] 10.222.0.15 () {60 vars in 1279 bytes} [Thu Apr 7 13:17:25 2022] DELETE /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 07 13:17:25.837038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-93a78e0d-57ce-40a8-b1cc-7c0c8271ad57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:25.837866 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-93a78e0d-57ce-40a8-b1cc-7c0c8271ad57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:25.845485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93a78e0d-57ce-40a8-b1cc-7c0c8271ad57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:25.846058 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93a78e0d-57ce-40a8-b1cc-7c0c8271ad57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:25.846936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93a78e0d-57ce-40a8-b1cc-7c0c8271ad57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:25.847500 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93a78e0d-57ce-40a8-b1cc-7c0c8271ad57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:25.917670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7bf4eec7-9a9a-4a88-aeaa-42b8eecc706f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:25.926437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7bf4eec7-9a9a-4a88-aeaa-42b8eecc706f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.167664 Apr 07 13:17:25.927014 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 693/1268] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:25 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:25.958056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-49fe58dc-b474-441e-8b98-2e64d41607ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:25.958849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-49fe58dc-b474-441e-8b98-2e64d41607ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:25.964799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-49fe58dc-b474-441e-8b98-2e64d41607ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:25.965249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-49fe58dc-b474-441e-8b98-2e64d41607ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:25.966021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-49fe58dc-b474-441e-8b98-2e64d41607ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:25.966456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-49fe58dc-b474-441e-8b98-2e64d41607ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:25.989069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-93a78e0d-57ce-40a8-b1cc-7c0c8271ad57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:25.999740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-93a78e0d-57ce-40a8-b1cc-7c0c8271ad57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:26.001315 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-93a78e0d-57ce-40a8-b1cc-7c0c8271ad57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:26.002646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-93a78e0d-57ce-40a8-b1cc-7c0c8271ad57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1801 microversion: 2.20 time: 0.169739 Apr 07 13:17:26.003214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 576/1269] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:25 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:17:26.096513 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-49fe58dc-b474-441e-8b98-2e64d41607ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:26.104317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-49fe58dc-b474-441e-8b98-2e64d41607ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150080 Apr 07 13:17:26.104887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 694/1270] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:25 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:26.942792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-65b72970-8111-4e8f-ba3f-d33168792261 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:26.943776 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-65b72970-8111-4e8f-ba3f-d33168792261 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:26.950293 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-65b72970-8111-4e8f-ba3f-d33168792261 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:26.950749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-65b72970-8111-4e8f-ba3f-d33168792261 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:26.951532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-65b72970-8111-4e8f-ba3f-d33168792261 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:26.952197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-65b72970-8111-4e8f-ba3f-d33168792261 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:26.997576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-80a0f382-87ea-4b92-8967-99ce8510eea8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] Calling method '.version_select at 0x7fde583c6670>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:27.022259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-80a0f382-87ea-4b92-8967-99ce8510eea8 tempest-TestVolumeBootPattern-255880304 tempest-TestVolumeBootPattern-255880304-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1816777936" status: 202 len: 0 microversion: 2.1 time: 0.029083 Apr 07 13:17:27.022837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 695/1271] 10.222.0.15 () {58 vars in 1262 bytes} [Thu Apr 7 13:17:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1816777936 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 07 13:17:27.034741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c7e19aaa-1034-4587-a534-dc635509cdb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:27.035883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c7e19aaa-1034-4587-a534-dc635509cdb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:27.045453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c7e19aaa-1034-4587-a534-dc635509cdb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:27.052385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c7e19aaa-1034-4587-a534-dc635509cdb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:27.053596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c7e19aaa-1034-4587-a534-dc635509cdb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:27.054278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c7e19aaa-1034-4587-a534-dc635509cdb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:27.140942 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-65b72970-8111-4e8f-ba3f-d33168792261 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:27.150880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-65b72970-8111-4e8f-ba3f-d33168792261 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.211765 Apr 07 13:17:27.158426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c7e19aaa-1034-4587-a534-dc635509cdb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:27.173985 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 577/1272] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:26 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:27.182455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cb76375c-6142-4700-bd18-f6cc9fb4ae08 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:27.183519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cb76375c-6142-4700-bd18-f6cc9fb4ae08 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:27.189572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c7e19aaa-1034-4587-a534-dc635509cdb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:27.193620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c7e19aaa-1034-4587-a534-dc635509cdb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:27.194006 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb76375c-6142-4700-bd18-f6cc9fb4ae08 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:27.194639 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb76375c-6142-4700-bd18-f6cc9fb4ae08 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:27.195440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb76375c-6142-4700-bd18-f6cc9fb4ae08 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:27.195882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb76375c-6142-4700-bd18-f6cc9fb4ae08 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:27.196359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c7e19aaa-1034-4587-a534-dc635509cdb8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1733 microversion: 2.20 time: 0.171874 Apr 07 13:17:27.205787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 696/1273] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:27 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:27.348239 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cb76375c-6142-4700-bd18-f6cc9fb4ae08 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:27.356424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cb76375c-6142-4700-bd18-f6cc9fb4ae08 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.181205 Apr 07 13:17:27.356995 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 578/1274] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:27 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:27.525495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-bd012d6c-2103-4eda-ab54-274ebcac6e25 req-aa936933-a4bf-457b-a006-d50690cd4cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c9a464-496a-4aa9-80dd-f9ec66f515ae", "name": "network-vif-deleted", "tag": "b25fac27-5301-4311-8e84-5721b8cac04c"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:17:27.535903 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-bd012d6c-2103-4eda-ab54-274ebcac6e25 req-aa936933-a4bf-457b-a006-d50690cd4cae service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:27.536371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-bd012d6c-2103-4eda-ab54-274ebcac6e25 req-aa936933-a4bf-457b-a006-d50690cd4cae service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:27.549033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-bd012d6c-2103-4eda-ab54-274ebcac6e25 req-aa936933-a4bf-457b-a006-d50690cd4cae service nova] Creating event network-vif-deleted:b25fac27-5301-4311-8e84-5721b8cac04c for instance 58c9a464-496a-4aa9-80dd-f9ec66f515ae on hv-cinder-83694 Apr 07 13:17:27.556476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-bd012d6c-2103-4eda-ab54-274ebcac6e25 req-aa936933-a4bf-457b-a006-d50690cd4cae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090995 Apr 07 13:17:27.557926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 697/1275] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:17:28.177090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0a837dde-146a-4c07-b4fa-118cbc08ab4a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:28.178287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0a837dde-146a-4c07-b4fa-118cbc08ab4a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:28.185913 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a837dde-146a-4c07-b4fa-118cbc08ab4a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:28.187145 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a837dde-146a-4c07-b4fa-118cbc08ab4a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:28.187998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a837dde-146a-4c07-b4fa-118cbc08ab4a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:28.188547 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a837dde-146a-4c07-b4fa-118cbc08ab4a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:28.222246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bb6c1411-12ac-4d65-bcb5-910ccc447e79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:28.222945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bb6c1411-12ac-4d65-bcb5-910ccc447e79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:28.229523 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb6c1411-12ac-4d65-bcb5-910ccc447e79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:28.230187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb6c1411-12ac-4d65-bcb5-910ccc447e79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:28.231121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb6c1411-12ac-4d65-bcb5-910ccc447e79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:28.231729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb6c1411-12ac-4d65-bcb5-910ccc447e79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:28.294643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bb6c1411-12ac-4d65-bcb5-910ccc447e79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:28.303950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bb6c1411-12ac-4d65-bcb5-910ccc447e79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:28.305428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bb6c1411-12ac-4d65-bcb5-910ccc447e79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:28.307175 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bb6c1411-12ac-4d65-bcb5-910ccc447e79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088900 Apr 07 13:17:28.308176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 698/1276] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:28 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:28.374915 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-683dd1d4-af3c-44a3-af67-12c427eca0d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:28.375539 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-683dd1d4-af3c-44a3-af67-12c427eca0d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:28.382327 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-683dd1d4-af3c-44a3-af67-12c427eca0d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:28.383276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-683dd1d4-af3c-44a3-af67-12c427eca0d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:28.383699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-683dd1d4-af3c-44a3-af67-12c427eca0d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:28.384152 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-683dd1d4-af3c-44a3-af67-12c427eca0d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:28.399541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0a837dde-146a-4c07-b4fa-118cbc08ab4a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:28.411206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0a837dde-146a-4c07-b4fa-118cbc08ab4a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.238153 Apr 07 13:17:28.412764 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 579/1277] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:28 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:28.523660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-683dd1d4-af3c-44a3-af67-12c427eca0d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:28.532959 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-683dd1d4-af3c-44a3-af67-12c427eca0d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.162428 Apr 07 13:17:28.533525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 699/1278] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:28 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:29.326025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1b5602c3-e4ac-4fb5-94f5-f29f9df9b327 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:29.326753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1b5602c3-e4ac-4fb5-94f5-f29f9df9b327 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:29.334736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b5602c3-e4ac-4fb5-94f5-f29f9df9b327 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:29.335172 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b5602c3-e4ac-4fb5-94f5-f29f9df9b327 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:29.336210 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b5602c3-e4ac-4fb5-94f5-f29f9df9b327 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:29.336653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b5602c3-e4ac-4fb5-94f5-f29f9df9b327 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:29.430260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-be849f52-2eb8-4df0-92c6-dbb79c23e544 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:29.431080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-be849f52-2eb8-4df0-92c6-dbb79c23e544 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:29.439659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-be849f52-2eb8-4df0-92c6-dbb79c23e544 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:29.440254 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-be849f52-2eb8-4df0-92c6-dbb79c23e544 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:29.441115 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-be849f52-2eb8-4df0-92c6-dbb79c23e544 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:29.441619 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-be849f52-2eb8-4df0-92c6-dbb79c23e544 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:29.587973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-be849f52-2eb8-4df0-92c6-dbb79c23e544 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:29.597078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-be849f52-2eb8-4df0-92c6-dbb79c23e544 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.170941 Apr 07 13:17:29.597823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 700/1279] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:29 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:29.602671 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6253b456-a2fc-453b-9a8c-103203c4e432 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:29.603395 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6253b456-a2fc-453b-9a8c-103203c4e432 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:29.610488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6253b456-a2fc-453b-9a8c-103203c4e432 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:29.611057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6253b456-a2fc-453b-9a8c-103203c4e432 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:29.612188 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6253b456-a2fc-453b-9a8c-103203c4e432 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:29.612638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6253b456-a2fc-453b-9a8c-103203c4e432 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:29.628388 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1b5602c3-e4ac-4fb5-94f5-f29f9df9b327 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:29.637068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1b5602c3-e4ac-4fb5-94f5-f29f9df9b327 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:29.638917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1b5602c3-e4ac-4fb5-94f5-f29f9df9b327 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:29.641238 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1b5602c3-e4ac-4fb5-94f5-f29f9df9b327 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.319162 Apr 07 13:17:29.642671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 580/1280] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:29 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:29.753911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6253b456-a2fc-453b-9a8c-103203c4e432 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:29.762230 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6253b456-a2fc-453b-9a8c-103203c4e432 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.163202 Apr 07 13:17:29.763117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 701/1281] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:29 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:30.616559 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a89b7c18-2d44-424c-8c5c-94e94a41e3af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:30.617367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a89b7c18-2d44-424c-8c5c-94e94a41e3af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:30.624358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a89b7c18-2d44-424c-8c5c-94e94a41e3af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:30.624817 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a89b7c18-2d44-424c-8c5c-94e94a41e3af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:30.625885 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a89b7c18-2d44-424c-8c5c-94e94a41e3af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:30.626330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a89b7c18-2d44-424c-8c5c-94e94a41e3af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:30.661157 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f42484d2-5962-48db-97a0-d71812293dcc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:30.661785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f42484d2-5962-48db-97a0-d71812293dcc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:30.679172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f42484d2-5962-48db-97a0-d71812293dcc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:30.679866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f42484d2-5962-48db-97a0-d71812293dcc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:30.680894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f42484d2-5962-48db-97a0-d71812293dcc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:30.681625 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f42484d2-5962-48db-97a0-d71812293dcc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:30.776991 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f42484d2-5962-48db-97a0-d71812293dcc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:30.788466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f42484d2-5962-48db-97a0-d71812293dcc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:30.790270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f42484d2-5962-48db-97a0-d71812293dcc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:30.791679 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f42484d2-5962-48db-97a0-d71812293dcc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.134806 Apr 07 13:17:30.792803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 702/1282] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:30 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:30.798446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4bb19d52-bffe-450e-9098-0e19768991bf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:30.799130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4bb19d52-bffe-450e-9098-0e19768991bf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:30.809315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4bb19d52-bffe-450e-9098-0e19768991bf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:30.809872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4bb19d52-bffe-450e-9098-0e19768991bf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:30.810752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4bb19d52-bffe-450e-9098-0e19768991bf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:30.811586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4bb19d52-bffe-450e-9098-0e19768991bf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:30.895499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a89b7c18-2d44-424c-8c5c-94e94a41e3af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:30.912726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a89b7c18-2d44-424c-8c5c-94e94a41e3af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.301452 Apr 07 13:17:30.923246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 581/1283] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:30 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:31.020578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4bb19d52-bffe-450e-9098-0e19768991bf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:31.049931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4bb19d52-bffe-450e-9098-0e19768991bf tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.255769 Apr 07 13:17:31.061522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 703/1284] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:30 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:31.810520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-64e2f592-8e1b-4402-985a-f95937beba5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:31.811709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-64e2f592-8e1b-4402-985a-f95937beba5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:31.818331 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-64e2f592-8e1b-4402-985a-f95937beba5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:31.818785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-64e2f592-8e1b-4402-985a-f95937beba5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:31.819563 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-64e2f592-8e1b-4402-985a-f95937beba5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:31.820002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-64e2f592-8e1b-4402-985a-f95937beba5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:31.878973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-64e2f592-8e1b-4402-985a-f95937beba5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:31.887333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-64e2f592-8e1b-4402-985a-f95937beba5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:31.888870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-64e2f592-8e1b-4402-985a-f95937beba5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:31.890033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-64e2f592-8e1b-4402-985a-f95937beba5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083483 Apr 07 13:17:31.890591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 582/1285] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:31 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:31.930713 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c8d7c38b-5cb7-45df-9e2e-204973c2530b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:31.931457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c8d7c38b-5cb7-45df-9e2e-204973c2530b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:31.938272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8d7c38b-5cb7-45df-9e2e-204973c2530b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:31.938810 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8d7c38b-5cb7-45df-9e2e-204973c2530b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:31.939639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8d7c38b-5cb7-45df-9e2e-204973c2530b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:31.940164 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8d7c38b-5cb7-45df-9e2e-204973c2530b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:32.069001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4ef1346a-5377-4eb4-b92f-38bacbe8a812 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:32.069621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4ef1346a-5377-4eb4-b92f-38bacbe8a812 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:32.075506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ef1346a-5377-4eb4-b92f-38bacbe8a812 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:32.075951 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ef1346a-5377-4eb4-b92f-38bacbe8a812 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:32.076841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ef1346a-5377-4eb4-b92f-38bacbe8a812 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:32.077279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ef1346a-5377-4eb4-b92f-38bacbe8a812 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:32.208479 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4ef1346a-5377-4eb4-b92f-38bacbe8a812 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:32.216274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4ef1346a-5377-4eb4-b92f-38bacbe8a812 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151099 Apr 07 13:17:32.216839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 583/1286] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:32 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:32.263606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c8d7c38b-5cb7-45df-9e2e-204973c2530b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:32.271276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c8d7c38b-5cb7-45df-9e2e-204973c2530b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.344368 Apr 07 13:17:32.271840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 704/1287] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:31 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:32.906892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-00b1682f-a03e-498c-bc4f-ca1358750e53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:32.907710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-00b1682f-a03e-498c-bc4f-ca1358750e53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:32.914387 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-00b1682f-a03e-498c-bc4f-ca1358750e53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:32.914939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-00b1682f-a03e-498c-bc4f-ca1358750e53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:32.915784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-00b1682f-a03e-498c-bc4f-ca1358750e53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:32.916333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-00b1682f-a03e-498c-bc4f-ca1358750e53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:32.978499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-00b1682f-a03e-498c-bc4f-ca1358750e53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:32.989250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-00b1682f-a03e-498c-bc4f-ca1358750e53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:32.990747 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-00b1682f-a03e-498c-bc4f-ca1358750e53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:32.991903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-00b1682f-a03e-498c-bc4f-ca1358750e53 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088990 Apr 07 13:17:32.992483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 584/1288] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:32 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:33.235201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-65966d68-a339-46a9-9159-aaf0fdb3607a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:33.236561 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-65966d68-a339-46a9-9159-aaf0fdb3607a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:33.242824 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65966d68-a339-46a9-9159-aaf0fdb3607a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:33.243267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65966d68-a339-46a9-9159-aaf0fdb3607a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:33.244033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65966d68-a339-46a9-9159-aaf0fdb3607a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:33.244508 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65966d68-a339-46a9-9159-aaf0fdb3607a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:33.288980 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-81f5719c-5dff-4732-ae46-fed90cb431b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:33.289596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-81f5719c-5dff-4732-ae46-fed90cb431b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:33.295905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81f5719c-5dff-4732-ae46-fed90cb431b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:33.296393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81f5719c-5dff-4732-ae46-fed90cb431b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:33.297173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81f5719c-5dff-4732-ae46-fed90cb431b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:33.297606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81f5719c-5dff-4732-ae46-fed90cb431b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:33.437172 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-81f5719c-5dff-4732-ae46-fed90cb431b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:33.445366 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-81f5719c-5dff-4732-ae46-fed90cb431b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.160289 Apr 07 13:17:33.453226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 585/1289] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:33 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:33.488132 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-65966d68-a339-46a9-9159-aaf0fdb3607a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:33.496547 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-65966d68-a339-46a9-9159-aaf0fdb3607a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.266356 Apr 07 13:17:33.497247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 705/1290] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:33 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:34.010881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fdd8274a-e8ef-4415-9a4c-04fcdeb69bea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:34.011461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fdd8274a-e8ef-4415-9a4c-04fcdeb69bea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:34.018190 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdd8274a-e8ef-4415-9a4c-04fcdeb69bea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:34.018643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdd8274a-e8ef-4415-9a4c-04fcdeb69bea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:34.019427 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdd8274a-e8ef-4415-9a4c-04fcdeb69bea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:34.019873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdd8274a-e8ef-4415-9a4c-04fcdeb69bea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:34.082060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fdd8274a-e8ef-4415-9a4c-04fcdeb69bea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:34.091792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fdd8274a-e8ef-4415-9a4c-04fcdeb69bea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:34.094134 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fdd8274a-e8ef-4415-9a4c-04fcdeb69bea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:34.095299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fdd8274a-e8ef-4415-9a4c-04fcdeb69bea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088693 Apr 07 13:17:34.095863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 586/1291] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:34 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:34.326634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:17:34.327136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:17:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:17:34.463883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a48c1d8f-b3e8-453d-998f-6bcd14f9c57a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:34.464532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a48c1d8f-b3e8-453d-998f-6bcd14f9c57a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:34.471637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a48c1d8f-b3e8-453d-998f-6bcd14f9c57a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:34.472375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a48c1d8f-b3e8-453d-998f-6bcd14f9c57a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:34.473354 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a48c1d8f-b3e8-453d-998f-6bcd14f9c57a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:34.473795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a48c1d8f-b3e8-453d-998f-6bcd14f9c57a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:34.516160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0bee49cb-9a5b-4e2f-817b-6365a3bed786 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:34.517010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0bee49cb-9a5b-4e2f-817b-6365a3bed786 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:34.523173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0bee49cb-9a5b-4e2f-817b-6365a3bed786 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:34.523857 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0bee49cb-9a5b-4e2f-817b-6365a3bed786 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:34.524823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0bee49cb-9a5b-4e2f-817b-6365a3bed786 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:34.525433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0bee49cb-9a5b-4e2f-817b-6365a3bed786 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:34.633324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a48c1d8f-b3e8-453d-998f-6bcd14f9c57a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:34.643796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a48c1d8f-b3e8-453d-998f-6bcd14f9c57a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.184733 Apr 07 13:17:34.654292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 706/1292] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:34 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:34.794438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0bee49cb-9a5b-4e2f-817b-6365a3bed786 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:34.829579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0bee49cb-9a5b-4e2f-817b-6365a3bed786 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.295354 Apr 07 13:17:34.836292 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 587/1293] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:34 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:35.114076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fd5b6817-93fe-4635-adb5-342f7e5151c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:35.114739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fd5b6817-93fe-4635-adb5-342f7e5151c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:35.121503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd5b6817-93fe-4635-adb5-342f7e5151c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:35.121749 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd5b6817-93fe-4635-adb5-342f7e5151c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:35.123450 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd5b6817-93fe-4635-adb5-342f7e5151c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:35.123976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd5b6817-93fe-4635-adb5-342f7e5151c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:35.184530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fd5b6817-93fe-4635-adb5-342f7e5151c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:35.193848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fd5b6817-93fe-4635-adb5-342f7e5151c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:35.195357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fd5b6817-93fe-4635-adb5-342f7e5151c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:35.196544 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fd5b6817-93fe-4635-adb5-342f7e5151c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086985 Apr 07 13:17:35.197106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 707/1294] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:35 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:35.661398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ccdac276-0ec5-41b8-a139-e818d974b3bc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:35.662026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ccdac276-0ec5-41b8-a139-e818d974b3bc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:35.668335 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ccdac276-0ec5-41b8-a139-e818d974b3bc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:35.668794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ccdac276-0ec5-41b8-a139-e818d974b3bc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:35.669566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ccdac276-0ec5-41b8-a139-e818d974b3bc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:35.670007 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ccdac276-0ec5-41b8-a139-e818d974b3bc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:35.822993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ccdac276-0ec5-41b8-a139-e818d974b3bc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:35.831248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ccdac276-0ec5-41b8-a139-e818d974b3bc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.173801 Apr 07 13:17:35.831757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 588/1295] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:35 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:35.843081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-db4fdfa2-effd-4427-a98e-b2df04677a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:35.843796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-db4fdfa2-effd-4427-a98e-b2df04677a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:35.850174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-db4fdfa2-effd-4427-a98e-b2df04677a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:35.850617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-db4fdfa2-effd-4427-a98e-b2df04677a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:35.851377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-db4fdfa2-effd-4427-a98e-b2df04677a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:35.851804 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-db4fdfa2-effd-4427-a98e-b2df04677a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:35.990752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-db4fdfa2-effd-4427-a98e-b2df04677a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:36.008465 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-db4fdfa2-effd-4427-a98e-b2df04677a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.169559 Apr 07 13:17:36.019004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 708/1296] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:35 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:36.214865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-81f4e0dd-909d-4c8c-b163-11dd31432952 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:36.215530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-81f4e0dd-909d-4c8c-b163-11dd31432952 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:36.222402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81f4e0dd-909d-4c8c-b163-11dd31432952 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:36.222864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81f4e0dd-909d-4c8c-b163-11dd31432952 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:36.223663 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81f4e0dd-909d-4c8c-b163-11dd31432952 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:36.224106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81f4e0dd-909d-4c8c-b163-11dd31432952 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:36.290912 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-81f4e0dd-909d-4c8c-b163-11dd31432952 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:36.299772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-81f4e0dd-909d-4c8c-b163-11dd31432952 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:36.301315 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-81f4e0dd-909d-4c8c-b163-11dd31432952 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:36.302513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-81f4e0dd-909d-4c8c-b163-11dd31432952 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.091730 Apr 07 13:17:36.303081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 589/1297] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:36 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:36.848886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e3dccea7-8629-4644-b1bc-d88c936804dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:36.849497 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e3dccea7-8629-4644-b1bc-d88c936804dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:36.855992 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e3dccea7-8629-4644-b1bc-d88c936804dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:36.856475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e3dccea7-8629-4644-b1bc-d88c936804dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:36.857239 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e3dccea7-8629-4644-b1bc-d88c936804dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:36.857670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e3dccea7-8629-4644-b1bc-d88c936804dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:36.994593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e3dccea7-8629-4644-b1bc-d88c936804dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:37.003584 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e3dccea7-8629-4644-b1bc-d88c936804dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158510 Apr 07 13:17:37.004200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 709/1298] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:36 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:37.026338 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-59827733-34e6-46f4-9783-79d8439faa6f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:37.026971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-59827733-34e6-46f4-9783-79d8439faa6f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:37.033422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59827733-34e6-46f4-9783-79d8439faa6f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:37.033876 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59827733-34e6-46f4-9783-79d8439faa6f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:37.034681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59827733-34e6-46f4-9783-79d8439faa6f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:37.035370 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59827733-34e6-46f4-9783-79d8439faa6f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:37.164214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-59827733-34e6-46f4-9783-79d8439faa6f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:37.172825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-59827733-34e6-46f4-9783-79d8439faa6f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150317 Apr 07 13:17:37.173398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 590/1299] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:37 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:37.322312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-75fa7689-e385-4ba5-bb62-a628a2214579 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:37.322841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-75fa7689-e385-4ba5-bb62-a628a2214579 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:37.330357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-75fa7689-e385-4ba5-bb62-a628a2214579 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:37.330804 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-75fa7689-e385-4ba5-bb62-a628a2214579 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:37.331570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-75fa7689-e385-4ba5-bb62-a628a2214579 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:37.332301 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-75fa7689-e385-4ba5-bb62-a628a2214579 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:37.394320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-75fa7689-e385-4ba5-bb62-a628a2214579 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:37.402454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-75fa7689-e385-4ba5-bb62-a628a2214579 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:37.403942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-75fa7689-e385-4ba5-bb62-a628a2214579 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:37.405706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-75fa7689-e385-4ba5-bb62-a628a2214579 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088633 Apr 07 13:17:37.406268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 710/1300] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:37 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:38.022745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d7215250-f3ef-47b1-83a9-fdfcc4bb22b4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:38.023356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d7215250-f3ef-47b1-83a9-fdfcc4bb22b4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:38.029275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d7215250-f3ef-47b1-83a9-fdfcc4bb22b4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:38.030368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d7215250-f3ef-47b1-83a9-fdfcc4bb22b4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:38.031548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d7215250-f3ef-47b1-83a9-fdfcc4bb22b4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:38.031986 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d7215250-f3ef-47b1-83a9-fdfcc4bb22b4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:38.162277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d7215250-f3ef-47b1-83a9-fdfcc4bb22b4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:38.170016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d7215250-f3ef-47b1-83a9-fdfcc4bb22b4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151263 Apr 07 13:17:38.171373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 591/1301] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:38 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:38.189593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-375d4537-f792-4665-a4f8-c910f7e3a23a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:38.190210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-375d4537-f792-4665-a4f8-c910f7e3a23a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:38.196529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-375d4537-f792-4665-a4f8-c910f7e3a23a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:38.196978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-375d4537-f792-4665-a4f8-c910f7e3a23a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:38.197738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-375d4537-f792-4665-a4f8-c910f7e3a23a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:38.198170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-375d4537-f792-4665-a4f8-c910f7e3a23a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:38.329337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-375d4537-f792-4665-a4f8-c910f7e3a23a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:38.337112 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-375d4537-f792-4665-a4f8-c910f7e3a23a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151274 Apr 07 13:17:38.337677 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 711/1302] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:38 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:38.424894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3c972bb8-bedf-4506-a4b3-2f77a515c462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:38.425508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3c972bb8-bedf-4506-a4b3-2f77a515c462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:38.431331 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c972bb8-bedf-4506-a4b3-2f77a515c462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:38.431790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c972bb8-bedf-4506-a4b3-2f77a515c462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:38.432589 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c972bb8-bedf-4506-a4b3-2f77a515c462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:38.433028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c972bb8-bedf-4506-a4b3-2f77a515c462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:38.493174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3c972bb8-bedf-4506-a4b3-2f77a515c462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:38.501470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3c972bb8-bedf-4506-a4b3-2f77a515c462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:38.502967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3c972bb8-bedf-4506-a4b3-2f77a515c462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:38.504162 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3c972bb8-bedf-4506-a4b3-2f77a515c462 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083904 Apr 07 13:17:38.504724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 592/1303] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:38 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:39.188202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-990cd4cf-29bf-4b97-9b82-9f1473eb4f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:39.188814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-990cd4cf-29bf-4b97-9b82-9f1473eb4f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:39.195154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-990cd4cf-29bf-4b97-9b82-9f1473eb4f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:39.195710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-990cd4cf-29bf-4b97-9b82-9f1473eb4f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:39.196370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-990cd4cf-29bf-4b97-9b82-9f1473eb4f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:39.196802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-990cd4cf-29bf-4b97-9b82-9f1473eb4f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:39.327698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-990cd4cf-29bf-4b97-9b82-9f1473eb4f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:39.335429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-990cd4cf-29bf-4b97-9b82-9f1473eb4f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151521 Apr 07 13:17:39.335985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 712/1304] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:39 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:39.354568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eba32a80-828f-4d96-84a4-b7112c64b2a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:39.355194 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-eba32a80-828f-4d96-84a4-b7112c64b2a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:39.361745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eba32a80-828f-4d96-84a4-b7112c64b2a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:39.362196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eba32a80-828f-4d96-84a4-b7112c64b2a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:39.362957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eba32a80-828f-4d96-84a4-b7112c64b2a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:39.363421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eba32a80-828f-4d96-84a4-b7112c64b2a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:39.491073 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eba32a80-828f-4d96-84a4-b7112c64b2a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:39.499380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eba32a80-828f-4d96-84a4-b7112c64b2a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148489 Apr 07 13:17:39.500025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 593/1305] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:39 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:39.522678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cb47565f-bcd6-4b10-b032-9f90142a9a49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:39.523294 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cb47565f-bcd6-4b10-b032-9f90142a9a49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:39.529231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cb47565f-bcd6-4b10-b032-9f90142a9a49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:39.529766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cb47565f-bcd6-4b10-b032-9f90142a9a49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:39.530559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cb47565f-bcd6-4b10-b032-9f90142a9a49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:39.531000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cb47565f-bcd6-4b10-b032-9f90142a9a49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:39.590496 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cb47565f-bcd6-4b10-b032-9f90142a9a49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:39.599054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cb47565f-bcd6-4b10-b032-9f90142a9a49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:39.600585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cb47565f-bcd6-4b10-b032-9f90142a9a49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:39.601724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cb47565f-bcd6-4b10-b032-9f90142a9a49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082894 Apr 07 13:17:39.602277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 713/1306] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:39 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:40.352371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-68201fc3-2123-40ce-8314-541077b24875 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:40.352995 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-68201fc3-2123-40ce-8314-541077b24875 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:40.359512 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68201fc3-2123-40ce-8314-541077b24875 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:40.360072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68201fc3-2123-40ce-8314-541077b24875 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:40.360752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68201fc3-2123-40ce-8314-541077b24875 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:40.361193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68201fc3-2123-40ce-8314-541077b24875 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:40.488999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-68201fc3-2123-40ce-8314-541077b24875 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:40.496781 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-68201fc3-2123-40ce-8314-541077b24875 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.148270 Apr 07 13:17:40.497344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 594/1307] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:40 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:40.516915 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-079170c0-d072-4a64-abbd-1ad009035aee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:40.517532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-079170c0-d072-4a64-abbd-1ad009035aee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:40.523769 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-079170c0-d072-4a64-abbd-1ad009035aee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:40.524261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-079170c0-d072-4a64-abbd-1ad009035aee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:40.525032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-079170c0-d072-4a64-abbd-1ad009035aee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:40.525472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-079170c0-d072-4a64-abbd-1ad009035aee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:40.619492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d9856ff7-f33d-498a-9b23-3fff1bceb0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:40.620108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d9856ff7-f33d-498a-9b23-3fff1bceb0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:40.627916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d9856ff7-f33d-498a-9b23-3fff1bceb0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:40.628466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d9856ff7-f33d-498a-9b23-3fff1bceb0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:40.629251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d9856ff7-f33d-498a-9b23-3fff1bceb0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:40.629696 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d9856ff7-f33d-498a-9b23-3fff1bceb0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:40.658840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-079170c0-d072-4a64-abbd-1ad009035aee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:40.666921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-079170c0-d072-4a64-abbd-1ad009035aee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154298 Apr 07 13:17:40.667493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 714/1308] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:40 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:40.692897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d9856ff7-f33d-498a-9b23-3fff1bceb0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:40.701255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d9856ff7-f33d-498a-9b23-3fff1bceb0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:40.702890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d9856ff7-f33d-498a-9b23-3fff1bceb0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:40.704045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d9856ff7-f33d-498a-9b23-3fff1bceb0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088355 Apr 07 13:17:40.704989 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 595/1309] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:40 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:17:41.513677 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2b85c35a-3e53-4975-9773-383cdfe43ef0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:41.514890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2b85c35a-3e53-4975-9773-383cdfe43ef0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:41.521174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2b85c35a-3e53-4975-9773-383cdfe43ef0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:41.521764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2b85c35a-3e53-4975-9773-383cdfe43ef0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:41.522370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2b85c35a-3e53-4975-9773-383cdfe43ef0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:41.522805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2b85c35a-3e53-4975-9773-383cdfe43ef0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:41.653431 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2b85c35a-3e53-4975-9773-383cdfe43ef0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:41.661911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2b85c35a-3e53-4975-9773-383cdfe43ef0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152140 Apr 07 13:17:41.662474 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 715/1310] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:41 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:41.684739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a84a4881-e093-4611-84d7-3ff8ebe77ce2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:41.685360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a84a4881-e093-4611-84d7-3ff8ebe77ce2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:41.692314 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a84a4881-e093-4611-84d7-3ff8ebe77ce2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:41.692771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a84a4881-e093-4611-84d7-3ff8ebe77ce2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:41.693534 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a84a4881-e093-4611-84d7-3ff8ebe77ce2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:41.694003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a84a4881-e093-4611-84d7-3ff8ebe77ce2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:41.723083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1df364d6-df46-411f-8eb0-709a42dec637 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:41.723776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1df364d6-df46-411f-8eb0-709a42dec637 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:41.729797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1df364d6-df46-411f-8eb0-709a42dec637 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:41.730247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1df364d6-df46-411f-8eb0-709a42dec637 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:41.731023 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1df364d6-df46-411f-8eb0-709a42dec637 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:41.731452 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1df364d6-df46-411f-8eb0-709a42dec637 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:41.791256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1df364d6-df46-411f-8eb0-709a42dec637 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:41.799624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1df364d6-df46-411f-8eb0-709a42dec637 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:41.801139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1df364d6-df46-411f-8eb0-709a42dec637 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:41.802309 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1df364d6-df46-411f-8eb0-709a42dec637 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083351 Apr 07 13:17:41.802859 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 716/1311] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:41 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:17:41.830740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a84a4881-e093-4611-84d7-3ff8ebe77ce2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:41.838433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a84a4881-e093-4611-84d7-3ff8ebe77ce2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.157489 Apr 07 13:17:41.838986 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 596/1312] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:41 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:42.679182 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a0eaf36d-9a47-45be-9a34-b6bde8dddb82 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:42.679818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a0eaf36d-9a47-45be-9a34-b6bde8dddb82 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:42.687312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0eaf36d-9a47-45be-9a34-b6bde8dddb82 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:42.687758 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0eaf36d-9a47-45be-9a34-b6bde8dddb82 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:42.688549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0eaf36d-9a47-45be-9a34-b6bde8dddb82 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:42.688978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0eaf36d-9a47-45be-9a34-b6bde8dddb82 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:42.820370 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4fc7eaad-8ce5-4942-8df2-d1ddd95a0809 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:42.820840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a0eaf36d-9a47-45be-9a34-b6bde8dddb82 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:42.820993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4fc7eaad-8ce5-4942-8df2-d1ddd95a0809 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:42.827823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fc7eaad-8ce5-4942-8df2-d1ddd95a0809 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:42.828302 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fc7eaad-8ce5-4942-8df2-d1ddd95a0809 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:42.828808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a0eaf36d-9a47-45be-9a34-b6bde8dddb82 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153463 Apr 07 13:17:42.829081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fc7eaad-8ce5-4942-8df2-d1ddd95a0809 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:42.829567 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 717/1313] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:42 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:42.829696 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fc7eaad-8ce5-4942-8df2-d1ddd95a0809 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:42.855824 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bf3905e9-3d3f-417f-b236-b425a53499c1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:42.856570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bf3905e9-3d3f-417f-b236-b425a53499c1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:42.862505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bf3905e9-3d3f-417f-b236-b425a53499c1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:42.862965 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bf3905e9-3d3f-417f-b236-b425a53499c1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:42.863737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bf3905e9-3d3f-417f-b236-b425a53499c1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:42.864259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bf3905e9-3d3f-417f-b236-b425a53499c1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:42.887865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4fc7eaad-8ce5-4942-8df2-d1ddd95a0809 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:42.897090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4fc7eaad-8ce5-4942-8df2-d1ddd95a0809 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:42.898574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4fc7eaad-8ce5-4942-8df2-d1ddd95a0809 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:42.899780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4fc7eaad-8ce5-4942-8df2-d1ddd95a0809 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083304 Apr 07 13:17:42.900358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 597/1314] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:42 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:17:42.992821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bf3905e9-3d3f-417f-b236-b425a53499c1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:43.001066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bf3905e9-3d3f-417f-b236-b425a53499c1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148998 Apr 07 13:17:43.001631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 718/1315] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:42 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:43.845045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-355d5106-4643-4590-b66c-4755f6724172 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:43.845577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-355d5106-4643-4590-b66c-4755f6724172 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:43.851915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-355d5106-4643-4590-b66c-4755f6724172 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:43.852398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-355d5106-4643-4590-b66c-4755f6724172 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:43.853166 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-355d5106-4643-4590-b66c-4755f6724172 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:43.853600 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-355d5106-4643-4590-b66c-4755f6724172 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:43.917890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-792b31d6-1a89-44b0-a5a8-b2601bb64434 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:43.918493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-792b31d6-1a89-44b0-a5a8-b2601bb64434 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:43.924738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-792b31d6-1a89-44b0-a5a8-b2601bb64434 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:43.925190 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-792b31d6-1a89-44b0-a5a8-b2601bb64434 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:43.925957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-792b31d6-1a89-44b0-a5a8-b2601bb64434 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:43.926398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-792b31d6-1a89-44b0-a5a8-b2601bb64434 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:43.986303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-792b31d6-1a89-44b0-a5a8-b2601bb64434 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:43.994996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-792b31d6-1a89-44b0-a5a8-b2601bb64434 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:43.996530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-792b31d6-1a89-44b0-a5a8-b2601bb64434 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:43.997706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-792b31d6-1a89-44b0-a5a8-b2601bb64434 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083674 Apr 07 13:17:43.999323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 719/1316] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:43 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:17:44.018550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f98a7473-1ec1-433e-892b-b6708ea68fee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:44.019177 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f98a7473-1ec1-433e-892b-b6708ea68fee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:44.025353 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f98a7473-1ec1-433e-892b-b6708ea68fee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:44.025806 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f98a7473-1ec1-433e-892b-b6708ea68fee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:44.026589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f98a7473-1ec1-433e-892b-b6708ea68fee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:44.027027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f98a7473-1ec1-433e-892b-b6708ea68fee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:44.165197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f98a7473-1ec1-433e-892b-b6708ea68fee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:44.173583 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f98a7473-1ec1-433e-892b-b6708ea68fee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.159403 Apr 07 13:17:44.174152 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 720/1317] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:44 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:44.199793 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-355d5106-4643-4590-b66c-4755f6724172 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:44.207728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-355d5106-4643-4590-b66c-4755f6724172 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.366667 Apr 07 13:17:44.208383 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 598/1318] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:43 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:45.016512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ae8682e2-4a5d-41fe-90a8-422c013ac588 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:45.017125 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ae8682e2-4a5d-41fe-90a8-422c013ac588 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:45.023453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae8682e2-4a5d-41fe-90a8-422c013ac588 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:45.023904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae8682e2-4a5d-41fe-90a8-422c013ac588 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:45.024685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae8682e2-4a5d-41fe-90a8-422c013ac588 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:45.025121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae8682e2-4a5d-41fe-90a8-422c013ac588 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:45.085132 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ae8682e2-4a5d-41fe-90a8-422c013ac588 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:45.093997 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ae8682e2-4a5d-41fe-90a8-422c013ac588 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:45.095469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ae8682e2-4a5d-41fe-90a8-422c013ac588 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:45.096643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ae8682e2-4a5d-41fe-90a8-422c013ac588 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084651 Apr 07 13:17:45.097198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 721/1319] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:45 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:45.190812 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3882e446-a9cb-4b97-b2c7-68b30cb213d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:45.191426 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3882e446-a9cb-4b97-b2c7-68b30cb213d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:45.197841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3882e446-a9cb-4b97-b2c7-68b30cb213d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:45.198297 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3882e446-a9cb-4b97-b2c7-68b30cb213d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:45.199066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3882e446-a9cb-4b97-b2c7-68b30cb213d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:45.199501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3882e446-a9cb-4b97-b2c7-68b30cb213d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:45.224288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5b4bf06c-0b30-40c6-b2cd-4f384e578417 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:45.224901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5b4bf06c-0b30-40c6-b2cd-4f384e578417 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:45.230730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b4bf06c-0b30-40c6-b2cd-4f384e578417 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:45.231171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b4bf06c-0b30-40c6-b2cd-4f384e578417 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:45.231924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b4bf06c-0b30-40c6-b2cd-4f384e578417 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:45.232455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b4bf06c-0b30-40c6-b2cd-4f384e578417 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:45.334165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3882e446-a9cb-4b97-b2c7-68b30cb213d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:45.341967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3882e446-a9cb-4b97-b2c7-68b30cb213d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154948 Apr 07 13:17:45.342605 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 599/1320] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:45 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:45.366676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5b4bf06c-0b30-40c6-b2cd-4f384e578417 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:45.375040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5b4bf06c-0b30-40c6-b2cd-4f384e578417 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154475 Apr 07 13:17:45.375596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 722/1321] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:45 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:46.114634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-279f17da-e133-4d7e-a9ca-a6de511926ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:46.115248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-279f17da-e133-4d7e-a9ca-a6de511926ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:46.121218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-279f17da-e133-4d7e-a9ca-a6de511926ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:46.121671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-279f17da-e133-4d7e-a9ca-a6de511926ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:46.122431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-279f17da-e133-4d7e-a9ca-a6de511926ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:46.122868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-279f17da-e133-4d7e-a9ca-a6de511926ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:46.181855 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-279f17da-e133-4d7e-a9ca-a6de511926ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:46.190614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-279f17da-e133-4d7e-a9ca-a6de511926ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:46.192090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-279f17da-e133-4d7e-a9ca-a6de511926ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:46.193347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-279f17da-e133-4d7e-a9ca-a6de511926ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082719 Apr 07 13:17:46.193897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 600/1322] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:46 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:46.360302 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d038f59e-add3-4e56-b604-9de568b7d94d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:46.360913 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d038f59e-add3-4e56-b604-9de568b7d94d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:46.367117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d038f59e-add3-4e56-b604-9de568b7d94d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:46.367508 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d038f59e-add3-4e56-b604-9de568b7d94d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:46.368287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d038f59e-add3-4e56-b604-9de568b7d94d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:46.368715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d038f59e-add3-4e56-b604-9de568b7d94d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:46.392572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-100e0e2d-6844-4f7a-a8dd-fc0cf07cb288 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:46.393197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-100e0e2d-6844-4f7a-a8dd-fc0cf07cb288 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:46.400048 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-100e0e2d-6844-4f7a-a8dd-fc0cf07cb288 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:46.400555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-100e0e2d-6844-4f7a-a8dd-fc0cf07cb288 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:46.401354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-100e0e2d-6844-4f7a-a8dd-fc0cf07cb288 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:46.401797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-100e0e2d-6844-4f7a-a8dd-fc0cf07cb288 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:46.504695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d038f59e-add3-4e56-b604-9de568b7d94d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:46.512409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d038f59e-add3-4e56-b604-9de568b7d94d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.157084 Apr 07 13:17:46.512974 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 723/1323] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:46 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:46.539839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-100e0e2d-6844-4f7a-a8dd-fc0cf07cb288 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:46.548382 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-100e0e2d-6844-4f7a-a8dd-fc0cf07cb288 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.160017 Apr 07 13:17:46.549055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 601/1324] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:46 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:47.212104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1cf00da6-804a-4d13-abd5-de0f8a1f72d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:47.212771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1cf00da6-804a-4d13-abd5-de0f8a1f72d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:47.218721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1cf00da6-804a-4d13-abd5-de0f8a1f72d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:47.219173 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1cf00da6-804a-4d13-abd5-de0f8a1f72d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:47.219935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1cf00da6-804a-4d13-abd5-de0f8a1f72d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:47.220401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1cf00da6-804a-4d13-abd5-de0f8a1f72d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:47.277864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1cf00da6-804a-4d13-abd5-de0f8a1f72d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:47.289178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1cf00da6-804a-4d13-abd5-de0f8a1f72d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:47.290674 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1cf00da6-804a-4d13-abd5-de0f8a1f72d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:47.291828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1cf00da6-804a-4d13-abd5-de0f8a1f72d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083611 Apr 07 13:17:47.292532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 724/1325] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:47 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:47.528847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-49eb11c1-d358-4cb0-ba89-e5f29c89c689 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:47.530408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-49eb11c1-d358-4cb0-ba89-e5f29c89c689 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:47.536943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-49eb11c1-d358-4cb0-ba89-e5f29c89c689 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:47.537387 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-49eb11c1-d358-4cb0-ba89-e5f29c89c689 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:47.538146 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-49eb11c1-d358-4cb0-ba89-e5f29c89c689 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:47.538576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-49eb11c1-d358-4cb0-ba89-e5f29c89c689 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:47.570390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b49950a2-efb4-47f2-b100-c4b864442df3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:47.571113 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b49950a2-efb4-47f2-b100-c4b864442df3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:47.580202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b49950a2-efb4-47f2-b100-c4b864442df3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:47.580202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b49950a2-efb4-47f2-b100-c4b864442df3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:47.580202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b49950a2-efb4-47f2-b100-c4b864442df3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:47.580202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b49950a2-efb4-47f2-b100-c4b864442df3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:47.667889 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-49eb11c1-d358-4cb0-ba89-e5f29c89c689 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:47.676016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-49eb11c1-d358-4cb0-ba89-e5f29c89c689 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151062 Apr 07 13:17:47.676623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 602/1326] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:47 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:47.716639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b49950a2-efb4-47f2-b100-c4b864442df3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:47.725810 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b49950a2-efb4-47f2-b100-c4b864442df3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.159190 Apr 07 13:17:47.726375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 725/1327] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:47 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:48.310365 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4197ec00-8ba7-42e7-9e56-428d714d1a99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:48.310909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4197ec00-8ba7-42e7-9e56-428d714d1a99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:48.316842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4197ec00-8ba7-42e7-9e56-428d714d1a99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:48.317322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4197ec00-8ba7-42e7-9e56-428d714d1a99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:48.318089 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4197ec00-8ba7-42e7-9e56-428d714d1a99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:48.318554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4197ec00-8ba7-42e7-9e56-428d714d1a99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:48.376614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4197ec00-8ba7-42e7-9e56-428d714d1a99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:48.384680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4197ec00-8ba7-42e7-9e56-428d714d1a99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:48.386163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4197ec00-8ba7-42e7-9e56-428d714d1a99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:48.387298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4197ec00-8ba7-42e7-9e56-428d714d1a99 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.080943 Apr 07 13:17:48.387853 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 603/1328] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:48 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:48.692892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2e6af367-7983-42a6-9a2e-b69969df71a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:48.693734 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2e6af367-7983-42a6-9a2e-b69969df71a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:48.699550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2e6af367-7983-42a6-9a2e-b69969df71a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:48.700000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2e6af367-7983-42a6-9a2e-b69969df71a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:48.700793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2e6af367-7983-42a6-9a2e-b69969df71a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:48.701950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2e6af367-7983-42a6-9a2e-b69969df71a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:48.743839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-63bb9d0a-2c40-4f5d-b633-c44d5b6729fb tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:48.744478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-63bb9d0a-2c40-4f5d-b633-c44d5b6729fb tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:48.751465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-63bb9d0a-2c40-4f5d-b633-c44d5b6729fb tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:48.751917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-63bb9d0a-2c40-4f5d-b633-c44d5b6729fb tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:48.752727 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-63bb9d0a-2c40-4f5d-b633-c44d5b6729fb tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:48.753167 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-63bb9d0a-2c40-4f5d-b633-c44d5b6729fb tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:48.831764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2e6af367-7983-42a6-9a2e-b69969df71a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:48.839630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2e6af367-7983-42a6-9a2e-b69969df71a7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150699 Apr 07 13:17:48.840229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 726/1329] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:48 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:48.887872 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-63bb9d0a-2c40-4f5d-b633-c44d5b6729fb tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:48.896272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-63bb9d0a-2c40-4f5d-b633-c44d5b6729fb tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156276 Apr 07 13:17:48.896844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 604/1330] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:48 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:49.405650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8d9add7c-b278-463a-bcef-d2e298f4088b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:49.406292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8d9add7c-b278-463a-bcef-d2e298f4088b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:49.412476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d9add7c-b278-463a-bcef-d2e298f4088b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:49.412928 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d9add7c-b278-463a-bcef-d2e298f4088b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:49.413680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d9add7c-b278-463a-bcef-d2e298f4088b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:49.414111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d9add7c-b278-463a-bcef-d2e298f4088b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:49.473691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8d9add7c-b278-463a-bcef-d2e298f4088b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:49.481892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8d9add7c-b278-463a-bcef-d2e298f4088b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:49.483434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8d9add7c-b278-463a-bcef-d2e298f4088b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:49.484600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8d9add7c-b278-463a-bcef-d2e298f4088b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082808 Apr 07 13:17:49.485154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 727/1331] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:49 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:49.856634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a217a59a-24a7-47bc-ac60-514d783c3674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:49.857255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a217a59a-24a7-47bc-ac60-514d783c3674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:49.863611 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a217a59a-24a7-47bc-ac60-514d783c3674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:49.864065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a217a59a-24a7-47bc-ac60-514d783c3674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:49.864864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a217a59a-24a7-47bc-ac60-514d783c3674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:49.865304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a217a59a-24a7-47bc-ac60-514d783c3674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:49.913437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-26b8638f-4a1e-4f4a-bb92-fe4a78db8d81 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:49.914052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-26b8638f-4a1e-4f4a-bb92-fe4a78db8d81 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:49.920269 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-26b8638f-4a1e-4f4a-bb92-fe4a78db8d81 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:49.920724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-26b8638f-4a1e-4f4a-bb92-fe4a78db8d81 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:49.921497 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-26b8638f-4a1e-4f4a-bb92-fe4a78db8d81 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:49.921931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-26b8638f-4a1e-4f4a-bb92-fe4a78db8d81 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:49.996726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a217a59a-24a7-47bc-ac60-514d783c3674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:50.005722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a217a59a-24a7-47bc-ac60-514d783c3674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152868 Apr 07 13:17:50.006296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 605/1332] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:49 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:50.063464 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-26b8638f-4a1e-4f4a-bb92-fe4a78db8d81 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:50.071181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-26b8638f-4a1e-4f4a-bb92-fe4a78db8d81 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.161805 Apr 07 13:17:50.071747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 728/1333] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:49 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:50.503090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3248dd64-1183-40e6-afd6-634e6a955fd7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:50.503710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3248dd64-1183-40e6-afd6-634e6a955fd7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:50.509625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3248dd64-1183-40e6-afd6-634e6a955fd7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:50.510072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3248dd64-1183-40e6-afd6-634e6a955fd7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:50.510837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3248dd64-1183-40e6-afd6-634e6a955fd7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:50.511307 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3248dd64-1183-40e6-afd6-634e6a955fd7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:50.573275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3248dd64-1183-40e6-afd6-634e6a955fd7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:50.582178 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3248dd64-1183-40e6-afd6-634e6a955fd7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:50.583671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3248dd64-1183-40e6-afd6-634e6a955fd7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:50.584848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3248dd64-1183-40e6-afd6-634e6a955fd7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085691 Apr 07 13:17:50.585405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 606/1334] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:50 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:51.023424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b2ac45ef-4c01-4a54-afdd-97b5d536add2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:51.023945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b2ac45ef-4c01-4a54-afdd-97b5d536add2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:51.030845 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b2ac45ef-4c01-4a54-afdd-97b5d536add2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:51.031293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b2ac45ef-4c01-4a54-afdd-97b5d536add2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:51.032048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b2ac45ef-4c01-4a54-afdd-97b5d536add2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:51.032513 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b2ac45ef-4c01-4a54-afdd-97b5d536add2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:51.088102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e8597a1c-de20-4c90-a32b-162580297557 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:51.088752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e8597a1c-de20-4c90-a32b-162580297557 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:51.095732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e8597a1c-de20-4c90-a32b-162580297557 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:51.096213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e8597a1c-de20-4c90-a32b-162580297557 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:51.096990 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e8597a1c-de20-4c90-a32b-162580297557 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:51.097435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e8597a1c-de20-4c90-a32b-162580297557 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:51.165423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b2ac45ef-4c01-4a54-afdd-97b5d536add2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:51.175802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b2ac45ef-4c01-4a54-afdd-97b5d536add2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.156174 Apr 07 13:17:51.176409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 729/1335] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:51 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:51.232905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e8597a1c-de20-4c90-a32b-162580297557 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:51.240678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e8597a1c-de20-4c90-a32b-162580297557 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156457 Apr 07 13:17:51.241230 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 607/1336] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:51 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:51.603049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-26387250-95d0-451e-be22-dbaf32082f47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:51.603672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-26387250-95d0-451e-be22-dbaf32082f47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:51.610264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-26387250-95d0-451e-be22-dbaf32082f47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:51.610722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-26387250-95d0-451e-be22-dbaf32082f47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:51.611487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-26387250-95d0-451e-be22-dbaf32082f47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:51.611931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-26387250-95d0-451e-be22-dbaf32082f47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:51.669567 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-26387250-95d0-451e-be22-dbaf32082f47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:51.678590 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-26387250-95d0-451e-be22-dbaf32082f47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:51.680093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-26387250-95d0-451e-be22-dbaf32082f47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:51.681252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-26387250-95d0-451e-be22-dbaf32082f47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082267 Apr 07 13:17:51.681816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 730/1337] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:51 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:52.194920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0427290e-9c7c-4ae8-8d54-34391272946b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:52.195476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0427290e-9c7c-4ae8-8d54-34391272946b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:52.202877 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0427290e-9c7c-4ae8-8d54-34391272946b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:52.203317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0427290e-9c7c-4ae8-8d54-34391272946b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:52.204109 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0427290e-9c7c-4ae8-8d54-34391272946b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:52.204566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0427290e-9c7c-4ae8-8d54-34391272946b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:52.258418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-01cbb42e-6625-43ba-bd60-62dd059d17bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:52.259027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-01cbb42e-6625-43ba-bd60-62dd059d17bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:52.265944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-01cbb42e-6625-43ba-bd60-62dd059d17bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:52.266397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-01cbb42e-6625-43ba-bd60-62dd059d17bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:52.267174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-01cbb42e-6625-43ba-bd60-62dd059d17bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:52.267613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-01cbb42e-6625-43ba-bd60-62dd059d17bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:52.337787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0427290e-9c7c-4ae8-8d54-34391272946b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:52.345425 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0427290e-9c7c-4ae8-8d54-34391272946b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154355 Apr 07 13:17:52.346196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 608/1338] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:52 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:52.402650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-01cbb42e-6625-43ba-bd60-62dd059d17bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:52.414747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-01cbb42e-6625-43ba-bd60-62dd059d17bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.159776 Apr 07 13:17:52.415753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 731/1339] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:52 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:52.601950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:17:52.602118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:17:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:17:52.698632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2c76eda7-9c45-48c1-81ca-259613d41d1b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:52.699244 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2c76eda7-9c45-48c1-81ca-259613d41d1b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:52.705809 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2c76eda7-9c45-48c1-81ca-259613d41d1b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:52.706256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2c76eda7-9c45-48c1-81ca-259613d41d1b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:52.707016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2c76eda7-9c45-48c1-81ca-259613d41d1b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:52.707445 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2c76eda7-9c45-48c1-81ca-259613d41d1b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:52.774537 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2c76eda7-9c45-48c1-81ca-259613d41d1b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:52.789958 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2c76eda7-9c45-48c1-81ca-259613d41d1b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:52.791497 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2c76eda7-9c45-48c1-81ca-259613d41d1b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:52.792675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2c76eda7-9c45-48c1-81ca-259613d41d1b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.097900 Apr 07 13:17:52.793216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 609/1340] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:52 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:17:53.361591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-84f617b3-3042-418a-b7a7-1210e080a8dd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:53.362211 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-84f617b3-3042-418a-b7a7-1210e080a8dd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:53.368531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-84f617b3-3042-418a-b7a7-1210e080a8dd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:53.368985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-84f617b3-3042-418a-b7a7-1210e080a8dd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:53.369753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-84f617b3-3042-418a-b7a7-1210e080a8dd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:53.370194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-84f617b3-3042-418a-b7a7-1210e080a8dd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:53.433789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-169b6b84-4b77-4fd1-9dcc-5c38c7fc87e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:53.434418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-169b6b84-4b77-4fd1-9dcc-5c38c7fc87e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:53.441233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-169b6b84-4b77-4fd1-9dcc-5c38c7fc87e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:53.441687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-169b6b84-4b77-4fd1-9dcc-5c38c7fc87e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:53.442470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-169b6b84-4b77-4fd1-9dcc-5c38c7fc87e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:53.442915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-169b6b84-4b77-4fd1-9dcc-5c38c7fc87e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:53.502364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-84f617b3-3042-418a-b7a7-1210e080a8dd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:53.510197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-84f617b3-3042-418a-b7a7-1210e080a8dd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152338 Apr 07 13:17:53.510768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 732/1341] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:53 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:53.574355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-169b6b84-4b77-4fd1-9dcc-5c38c7fc87e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:53.583803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-169b6b84-4b77-4fd1-9dcc-5c38c7fc87e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153809 Apr 07 13:17:53.584414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 610/1342] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:53 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:53.811325 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-62e95e80-6c0e-4bc7-ba86-95c39ef08255 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:53.811849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-62e95e80-6c0e-4bc7-ba86-95c39ef08255 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:53.817796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62e95e80-6c0e-4bc7-ba86-95c39ef08255 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:53.818234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62e95e80-6c0e-4bc7-ba86-95c39ef08255 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:53.818981 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62e95e80-6c0e-4bc7-ba86-95c39ef08255 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:53.819410 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62e95e80-6c0e-4bc7-ba86-95c39ef08255 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:53.877159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-62e95e80-6c0e-4bc7-ba86-95c39ef08255 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:53.885247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-62e95e80-6c0e-4bc7-ba86-95c39ef08255 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:53.886729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-62e95e80-6c0e-4bc7-ba86-95c39ef08255 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:53.887863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-62e95e80-6c0e-4bc7-ba86-95c39ef08255 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081007 Apr 07 13:17:53.888468 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 733/1343] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:53 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:54.098522 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:17:54.098697 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:17:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:17:54.527790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4de3dac6-7278-4f8a-a35e-3db7e47dab28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:54.528470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4de3dac6-7278-4f8a-a35e-3db7e47dab28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:54.535550 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4de3dac6-7278-4f8a-a35e-3db7e47dab28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:54.536000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4de3dac6-7278-4f8a-a35e-3db7e47dab28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:54.536804 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4de3dac6-7278-4f8a-a35e-3db7e47dab28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:54.537239 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4de3dac6-7278-4f8a-a35e-3db7e47dab28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:54.601104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-12357fc8-9822-4749-946e-b17db8f78d6c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:54.601708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-12357fc8-9822-4749-946e-b17db8f78d6c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:54.608020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-12357fc8-9822-4749-946e-b17db8f78d6c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:54.608502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-12357fc8-9822-4749-946e-b17db8f78d6c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:54.609262 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-12357fc8-9822-4749-946e-b17db8f78d6c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:54.609694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-12357fc8-9822-4749-946e-b17db8f78d6c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:54.668665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4de3dac6-7278-4f8a-a35e-3db7e47dab28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:54.677159 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4de3dac6-7278-4f8a-a35e-3db7e47dab28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153216 Apr 07 13:17:54.677722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 611/1344] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:54 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:54.744189 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-12357fc8-9822-4749-946e-b17db8f78d6c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:54.752750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-12357fc8-9822-4749-946e-b17db8f78d6c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155511 Apr 07 13:17:54.753305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 734/1345] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:54 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:54.906129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e471719b-7f74-43c6-b543-3bfd9f587e68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:54.906743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e471719b-7f74-43c6-b543-3bfd9f587e68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:54.912831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e471719b-7f74-43c6-b543-3bfd9f587e68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:54.913276 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e471719b-7f74-43c6-b543-3bfd9f587e68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:54.914030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e471719b-7f74-43c6-b543-3bfd9f587e68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:54.914460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e471719b-7f74-43c6-b543-3bfd9f587e68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:54.976303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e471719b-7f74-43c6-b543-3bfd9f587e68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:54.985007 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e471719b-7f74-43c6-b543-3bfd9f587e68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:54.986504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e471719b-7f74-43c6-b543-3bfd9f587e68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:54.987646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e471719b-7f74-43c6-b543-3bfd9f587e68 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085471 Apr 07 13:17:54.988213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 612/1346] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:54 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:55.694862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ff2fcffa-7d82-4e6a-ac0b-a002d8a93fb8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:55.695478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ff2fcffa-7d82-4e6a-ac0b-a002d8a93fb8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:55.702484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff2fcffa-7d82-4e6a-ac0b-a002d8a93fb8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:55.702923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff2fcffa-7d82-4e6a-ac0b-a002d8a93fb8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:55.703911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff2fcffa-7d82-4e6a-ac0b-a002d8a93fb8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:55.704377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff2fcffa-7d82-4e6a-ac0b-a002d8a93fb8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:55.770191 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f7d36b73-4480-43a4-ad5f-0eebc7886b25 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:55.770787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f7d36b73-4480-43a4-ad5f-0eebc7886b25 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:55.777062 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f7d36b73-4480-43a4-ad5f-0eebc7886b25 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:55.777514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f7d36b73-4480-43a4-ad5f-0eebc7886b25 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:55.778285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f7d36b73-4480-43a4-ad5f-0eebc7886b25 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:55.778721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f7d36b73-4480-43a4-ad5f-0eebc7886b25 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:55.836536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ff2fcffa-7d82-4e6a-ac0b-a002d8a93fb8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:55.844995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ff2fcffa-7d82-4e6a-ac0b-a002d8a93fb8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153995 Apr 07 13:17:55.845647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 735/1347] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:55 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:55.909693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f7d36b73-4480-43a4-ad5f-0eebc7886b25 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:55.917672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f7d36b73-4480-43a4-ad5f-0eebc7886b25 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151378 Apr 07 13:17:55.918245 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 613/1348] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:55 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:56.006118 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4e26daef-93d1-487b-9ff1-7d8e84ec6535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:56.006722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4e26daef-93d1-487b-9ff1-7d8e84ec6535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:56.012537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4e26daef-93d1-487b-9ff1-7d8e84ec6535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:56.012959 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4e26daef-93d1-487b-9ff1-7d8e84ec6535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:56.014230 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4e26daef-93d1-487b-9ff1-7d8e84ec6535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:56.014659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4e26daef-93d1-487b-9ff1-7d8e84ec6535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:56.071856 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4e26daef-93d1-487b-9ff1-7d8e84ec6535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:56.080693 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4e26daef-93d1-487b-9ff1-7d8e84ec6535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:56.082186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4e26daef-93d1-487b-9ff1-7d8e84ec6535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:56.083308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4e26daef-93d1-487b-9ff1-7d8e84ec6535 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081131 Apr 07 13:17:56.083922 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 736/1349] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:56 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:56.862678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-84c7d3b6-489d-473f-a127-8589fabf2ea0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:56.863299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-84c7d3b6-489d-473f-a127-8589fabf2ea0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:56.869596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-84c7d3b6-489d-473f-a127-8589fabf2ea0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:56.870045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-84c7d3b6-489d-473f-a127-8589fabf2ea0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:56.870808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-84c7d3b6-489d-473f-a127-8589fabf2ea0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:56.871244 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-84c7d3b6-489d-473f-a127-8589fabf2ea0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:56.933812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-af13c896-766e-4995-9073-9f52387df981 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:56.934420 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-af13c896-766e-4995-9073-9f52387df981 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:56.941331 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-af13c896-766e-4995-9073-9f52387df981 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:56.941773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-af13c896-766e-4995-9073-9f52387df981 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:56.942535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-af13c896-766e-4995-9073-9f52387df981 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:56.942961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-af13c896-766e-4995-9073-9f52387df981 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:57.002698 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-84c7d3b6-489d-473f-a127-8589fabf2ea0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:57.010624 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-84c7d3b6-489d-473f-a127-8589fabf2ea0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151768 Apr 07 13:17:57.011191 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 614/1350] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:56 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:57.077176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-af13c896-766e-4995-9073-9f52387df981 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:57.084918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-af13c896-766e-4995-9073-9f52387df981 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154964 Apr 07 13:17:57.085478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 737/1351] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:56 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:57.101660 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b877600d-26df-4cb2-b208-4b53b34bbbd9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:57.102266 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b877600d-26df-4cb2-b208-4b53b34bbbd9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:57.108808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b877600d-26df-4cb2-b208-4b53b34bbbd9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:57.109258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b877600d-26df-4cb2-b208-4b53b34bbbd9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:57.110017 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b877600d-26df-4cb2-b208-4b53b34bbbd9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:57.110449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b877600d-26df-4cb2-b208-4b53b34bbbd9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:57.172792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b877600d-26df-4cb2-b208-4b53b34bbbd9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:57.181153 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b877600d-26df-4cb2-b208-4b53b34bbbd9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:57.182625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b877600d-26df-4cb2-b208-4b53b34bbbd9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:57.183758 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b877600d-26df-4cb2-b208-4b53b34bbbd9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086001 Apr 07 13:17:57.184330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 615/1352] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:57 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:17:58.027184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5ea90b3c-ed18-42aa-8398-d7f210af8e4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:58.027828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5ea90b3c-ed18-42aa-8398-d7f210af8e4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:58.034119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5ea90b3c-ed18-42aa-8398-d7f210af8e4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:58.034565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5ea90b3c-ed18-42aa-8398-d7f210af8e4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:58.035578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5ea90b3c-ed18-42aa-8398-d7f210af8e4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:58.036013 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5ea90b3c-ed18-42aa-8398-d7f210af8e4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:58.102561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e59f319d-a757-4846-9881-db5209c94fb4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:58.103199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e59f319d-a757-4846-9881-db5209c94fb4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:58.110115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e59f319d-a757-4846-9881-db5209c94fb4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:58.110558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e59f319d-a757-4846-9881-db5209c94fb4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:58.111319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e59f319d-a757-4846-9881-db5209c94fb4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:58.111752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e59f319d-a757-4846-9881-db5209c94fb4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:58.165109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5ea90b3c-ed18-42aa-8398-d7f210af8e4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:58.174012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5ea90b3c-ed18-42aa-8398-d7f210af8e4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150618 Apr 07 13:17:58.174585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 738/1353] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:58 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:58.202257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b154c1da-b8e1-4021-944d-0a1055f4da7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:58.202941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b154c1da-b8e1-4021-944d-0a1055f4da7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:58.208791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b154c1da-b8e1-4021-944d-0a1055f4da7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:58.209244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b154c1da-b8e1-4021-944d-0a1055f4da7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:58.210008 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b154c1da-b8e1-4021-944d-0a1055f4da7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:58.210441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b154c1da-b8e1-4021-944d-0a1055f4da7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:58.246286 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e59f319d-a757-4846-9881-db5209c94fb4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:58.254749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e59f319d-a757-4846-9881-db5209c94fb4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155997 Apr 07 13:17:58.255316 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 616/1354] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:58 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:58.274119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b154c1da-b8e1-4021-944d-0a1055f4da7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:58.282669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b154c1da-b8e1-4021-944d-0a1055f4da7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:58.284089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b154c1da-b8e1-4021-944d-0a1055f4da7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:58.285509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b154c1da-b8e1-4021-944d-0a1055f4da7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087046 Apr 07 13:17:58.286056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 739/1355] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:58 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:17:59.190850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-daee3d1e-b005-4a8c-a2a8-e9f11311d004 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:59.191496 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-daee3d1e-b005-4a8c-a2a8-e9f11311d004 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:59.197762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-daee3d1e-b005-4a8c-a2a8-e9f11311d004 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:59.198210 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-daee3d1e-b005-4a8c-a2a8-e9f11311d004 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:59.198973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-daee3d1e-b005-4a8c-a2a8-e9f11311d004 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:59.199410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-daee3d1e-b005-4a8c-a2a8-e9f11311d004 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:59.270673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a989dd2b-cb61-4d01-afd3-a9853789ebfd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:59.271414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a989dd2b-cb61-4d01-afd3-a9853789ebfd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:59.278026 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a989dd2b-cb61-4d01-afd3-a9853789ebfd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:59.278145 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a989dd2b-cb61-4d01-afd3-a9853789ebfd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:59.279415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a989dd2b-cb61-4d01-afd3-a9853789ebfd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:59.280327 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a989dd2b-cb61-4d01-afd3-a9853789ebfd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:59.331350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-daee3d1e-b005-4a8c-a2a8-e9f11311d004 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:59.339545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-daee3d1e-b005-4a8c-a2a8-e9f11311d004 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152444 Apr 07 13:17:59.340115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 617/1356] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:59 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:17:59.345746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5e5ea4ee-06cd-4ba3-a29e-c057ee4824e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:17:59.346361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5e5ea4ee-06cd-4ba3-a29e-c057ee4824e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:17:59.352097 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e5ea4ee-06cd-4ba3-a29e-c057ee4824e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:59.352575 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e5ea4ee-06cd-4ba3-a29e-c057ee4824e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:59.353346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e5ea4ee-06cd-4ba3-a29e-c057ee4824e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:17:59.353779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e5ea4ee-06cd-4ba3-a29e-c057ee4824e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:17:59.413797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a989dd2b-cb61-4d01-afd3-a9853789ebfd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:59.416903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5e5ea4ee-06cd-4ba3-a29e-c057ee4824e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:59.422604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a989dd2b-cb61-4d01-afd3-a9853789ebfd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155690 Apr 07 13:17:59.423187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 740/1357] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:17:59 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:17:59.426181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5e5ea4ee-06cd-4ba3-a29e-c057ee4824e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:59.427676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5e5ea4ee-06cd-4ba3-a29e-c057ee4824e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:17:59.428852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5e5ea4ee-06cd-4ba3-a29e-c057ee4824e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087811 Apr 07 13:17:59.429387 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 618/1358] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:17:59 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:00.358306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1139378c-e11e-4982-89ac-07e1b7c5f66e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:00.358913 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1139378c-e11e-4982-89ac-07e1b7c5f66e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:00.365180 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1139378c-e11e-4982-89ac-07e1b7c5f66e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:00.365637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1139378c-e11e-4982-89ac-07e1b7c5f66e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:00.366384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1139378c-e11e-4982-89ac-07e1b7c5f66e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:00.366812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1139378c-e11e-4982-89ac-07e1b7c5f66e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:00.439614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b6d04dee-75e0-4985-8d0b-df4def0554fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:00.440344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b6d04dee-75e0-4985-8d0b-df4def0554fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:00.446796 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6d04dee-75e0-4985-8d0b-df4def0554fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:00.447251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6d04dee-75e0-4985-8d0b-df4def0554fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:00.448031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6d04dee-75e0-4985-8d0b-df4def0554fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:00.448514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6d04dee-75e0-4985-8d0b-df4def0554fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:00.502698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1139378c-e11e-4982-89ac-07e1b7c5f66e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:00.510781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1139378c-e11e-4982-89ac-07e1b7c5f66e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.157171 Apr 07 13:18:00.511678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 741/1359] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:00 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:00.516181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-86352a68-2365-46bf-850c-526d651bb596 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:00.516804 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-86352a68-2365-46bf-850c-526d651bb596 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:00.522676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-86352a68-2365-46bf-850c-526d651bb596 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:00.523129 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-86352a68-2365-46bf-850c-526d651bb596 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:00.523902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-86352a68-2365-46bf-850c-526d651bb596 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:00.524368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-86352a68-2365-46bf-850c-526d651bb596 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:00.586665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-86352a68-2365-46bf-850c-526d651bb596 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:00.596041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-86352a68-2365-46bf-850c-526d651bb596 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:00.597197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b6d04dee-75e0-4985-8d0b-df4def0554fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:00.597602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-86352a68-2365-46bf-850c-526d651bb596 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:00.598773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-86352a68-2365-46bf-850c-526d651bb596 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086305 Apr 07 13:18:00.599321 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 742/1360] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:00 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:00.605286 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b6d04dee-75e0-4985-8d0b-df4def0554fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.170355 Apr 07 13:18:00.605841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 619/1361] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:00 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:01.528449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4f57d1db-ebbb-4e6f-8060-cdf8b012155b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:01.529170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4f57d1db-ebbb-4e6f-8060-cdf8b012155b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:01.535737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f57d1db-ebbb-4e6f-8060-cdf8b012155b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:01.536210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f57d1db-ebbb-4e6f-8060-cdf8b012155b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:01.536967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f57d1db-ebbb-4e6f-8060-cdf8b012155b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:01.537396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f57d1db-ebbb-4e6f-8060-cdf8b012155b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:01.617994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5b19a8f8-1949-47c8-8a31-adbad9557b5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:01.618621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5b19a8f8-1949-47c8-8a31-adbad9557b5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:01.625357 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b19a8f8-1949-47c8-8a31-adbad9557b5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:01.625807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b19a8f8-1949-47c8-8a31-adbad9557b5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:01.626577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b19a8f8-1949-47c8-8a31-adbad9557b5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:01.627008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b19a8f8-1949-47c8-8a31-adbad9557b5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:01.667986 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4f57d1db-ebbb-4e6f-8060-cdf8b012155b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:01.676167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4f57d1db-ebbb-4e6f-8060-cdf8b012155b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151630 Apr 07 13:18:01.676739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 743/1362] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:01 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:01.681271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a774f5b0-03fd-4f3b-a4d4-3d5fe6a0b622 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:01.681883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a774f5b0-03fd-4f3b-a4d4-3d5fe6a0b622 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:01.686823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5b19a8f8-1949-47c8-8a31-adbad9557b5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:01.688546 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a774f5b0-03fd-4f3b-a4d4-3d5fe6a0b622 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:01.689006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a774f5b0-03fd-4f3b-a4d4-3d5fe6a0b622 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:01.689782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a774f5b0-03fd-4f3b-a4d4-3d5fe6a0b622 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:01.690219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a774f5b0-03fd-4f3b-a4d4-3d5fe6a0b622 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:01.695222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5b19a8f8-1949-47c8-8a31-adbad9557b5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:01.696732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5b19a8f8-1949-47c8-8a31-adbad9557b5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:01.697861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5b19a8f8-1949-47c8-8a31-adbad9557b5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083820 Apr 07 13:18:01.698409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 620/1363] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:01 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:18:01.822264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a774f5b0-03fd-4f3b-a4d4-3d5fe6a0b622 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:01.830344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a774f5b0-03fd-4f3b-a4d4-3d5fe6a0b622 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152667 Apr 07 13:18:01.830910 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 744/1364] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:01 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:02.694250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e54e7445-a4b0-412e-ae47-98f23c6f462a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:02.694920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e54e7445-a4b0-412e-ae47-98f23c6f462a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:02.702201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e54e7445-a4b0-412e-ae47-98f23c6f462a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:02.703265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e54e7445-a4b0-412e-ae47-98f23c6f462a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:02.704034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e54e7445-a4b0-412e-ae47-98f23c6f462a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:02.704520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e54e7445-a4b0-412e-ae47-98f23c6f462a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:02.717029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-aefa4383-0564-4382-ba9f-779fde2b5843 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:02.717643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-aefa4383-0564-4382-ba9f-779fde2b5843 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:02.723821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aefa4383-0564-4382-ba9f-779fde2b5843 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:02.724315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aefa4383-0564-4382-ba9f-779fde2b5843 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:02.725113 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aefa4383-0564-4382-ba9f-779fde2b5843 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:02.725550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aefa4383-0564-4382-ba9f-779fde2b5843 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:02.789234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-aefa4383-0564-4382-ba9f-779fde2b5843 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:02.798996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-aefa4383-0564-4382-ba9f-779fde2b5843 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:02.800497 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-aefa4383-0564-4382-ba9f-779fde2b5843 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:02.801638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-aefa4383-0564-4382-ba9f-779fde2b5843 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.089097 Apr 07 13:18:02.802196 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 745/1365] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:02 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:02.844011 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e54e7445-a4b0-412e-ae47-98f23c6f462a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:02.847274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-be31888b-b66a-46a5-9df9-eb39d2b5736b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:02.847888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-be31888b-b66a-46a5-9df9-eb39d2b5736b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:02.852029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e54e7445-a4b0-412e-ae47-98f23c6f462a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.161606 Apr 07 13:18:02.852628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 621/1366] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:02 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:02.853793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-be31888b-b66a-46a5-9df9-eb39d2b5736b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:02.854231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-be31888b-b66a-46a5-9df9-eb39d2b5736b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:02.854992 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-be31888b-b66a-46a5-9df9-eb39d2b5736b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:02.855426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-be31888b-b66a-46a5-9df9-eb39d2b5736b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:02.984789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-be31888b-b66a-46a5-9df9-eb39d2b5736b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:02.992565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-be31888b-b66a-46a5-9df9-eb39d2b5736b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149016 Apr 07 13:18:02.993130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 746/1367] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:02 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:03.820789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-45e6d1f1-ff39-40f3-8dda-b740b1ad3f5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:03.821410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-45e6d1f1-ff39-40f3-8dda-b740b1ad3f5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:03.828373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-45e6d1f1-ff39-40f3-8dda-b740b1ad3f5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:03.828836 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-45e6d1f1-ff39-40f3-8dda-b740b1ad3f5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:03.829612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-45e6d1f1-ff39-40f3-8dda-b740b1ad3f5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:03.830055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-45e6d1f1-ff39-40f3-8dda-b740b1ad3f5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:03.868955 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fd3ca531-ba5c-4589-b23d-eee483a63787 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:03.869602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fd3ca531-ba5c-4589-b23d-eee483a63787 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:03.876527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd3ca531-ba5c-4589-b23d-eee483a63787 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:03.876983 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd3ca531-ba5c-4589-b23d-eee483a63787 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:03.877757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd3ca531-ba5c-4589-b23d-eee483a63787 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:03.878197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd3ca531-ba5c-4589-b23d-eee483a63787 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:03.889786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-45e6d1f1-ff39-40f3-8dda-b740b1ad3f5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:03.898101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-45e6d1f1-ff39-40f3-8dda-b740b1ad3f5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:03.899609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-45e6d1f1-ff39-40f3-8dda-b740b1ad3f5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:03.900792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-45e6d1f1-ff39-40f3-8dda-b740b1ad3f5d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083887 Apr 07 13:18:03.901346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 622/1368] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:03 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:04.007464 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fd3ca531-ba5c-4589-b23d-eee483a63787 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:04.010387 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-43a74f30-0c64-4ba4-8c2b-faf1b9c6fe9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:04.011090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-43a74f30-0c64-4ba4-8c2b-faf1b9c6fe9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:04.015306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fd3ca531-ba5c-4589-b23d-eee483a63787 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150097 Apr 07 13:18:04.015872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 747/1369] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:03 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:04.017103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43a74f30-0c64-4ba4-8c2b-faf1b9c6fe9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:04.017567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43a74f30-0c64-4ba4-8c2b-faf1b9c6fe9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:04.018344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43a74f30-0c64-4ba4-8c2b-faf1b9c6fe9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:04.018820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43a74f30-0c64-4ba4-8c2b-faf1b9c6fe9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:04.148445 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-43a74f30-0c64-4ba4-8c2b-faf1b9c6fe9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:04.156676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-43a74f30-0c64-4ba4-8c2b-faf1b9c6fe9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150217 Apr 07 13:18:04.157236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 623/1370] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:04 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:04.918784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-11a4d9a4-d218-4805-a53e-bb895cfe1a7d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:04.919423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-11a4d9a4-d218-4805-a53e-bb895cfe1a7d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:04.925760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11a4d9a4-d218-4805-a53e-bb895cfe1a7d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:04.926207 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11a4d9a4-d218-4805-a53e-bb895cfe1a7d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:04.926964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11a4d9a4-d218-4805-a53e-bb895cfe1a7d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:04.927399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11a4d9a4-d218-4805-a53e-bb895cfe1a7d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:04.988739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-11a4d9a4-d218-4805-a53e-bb895cfe1a7d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:04.996964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-11a4d9a4-d218-4805-a53e-bb895cfe1a7d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:04.998468 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-11a4d9a4-d218-4805-a53e-bb895cfe1a7d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:04.999604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-11a4d9a4-d218-4805-a53e-bb895cfe1a7d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084778 Apr 07 13:18:05.000189 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 748/1371] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:04 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:05.032580 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-86ec26e3-f027-4c7f-be95-9476376c8b8d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:05.033197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-86ec26e3-f027-4c7f-be95-9476376c8b8d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:05.039660 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-86ec26e3-f027-4c7f-be95-9476376c8b8d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:05.040111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-86ec26e3-f027-4c7f-be95-9476376c8b8d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:05.040908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-86ec26e3-f027-4c7f-be95-9476376c8b8d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:05.041351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-86ec26e3-f027-4c7f-be95-9476376c8b8d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:05.173219 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-86ec26e3-f027-4c7f-be95-9476376c8b8d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:05.173796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b16179dd-3f4c-4b58-a8b1-92ef7f721b92 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:05.174435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b16179dd-3f4c-4b58-a8b1-92ef7f721b92 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:05.180103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b16179dd-3f4c-4b58-a8b1-92ef7f721b92 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:05.180987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-86ec26e3-f027-4c7f-be95-9476376c8b8d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152940 Apr 07 13:18:05.181187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b16179dd-3f4c-4b58-a8b1-92ef7f721b92 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:05.181542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 624/1372] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:05 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:05.181944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b16179dd-3f4c-4b58-a8b1-92ef7f721b92 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:05.182377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b16179dd-3f4c-4b58-a8b1-92ef7f721b92 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:05.313642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b16179dd-3f4c-4b58-a8b1-92ef7f721b92 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:05.321435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b16179dd-3f4c-4b58-a8b1-92ef7f721b92 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151445 Apr 07 13:18:05.322005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 749/1373] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:05 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:06.017947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f34d4f0d-a82c-43d3-aebb-c105d3eac2b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:06.018551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f34d4f0d-a82c-43d3-aebb-c105d3eac2b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:06.024405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f34d4f0d-a82c-43d3-aebb-c105d3eac2b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:06.024854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f34d4f0d-a82c-43d3-aebb-c105d3eac2b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:06.025616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f34d4f0d-a82c-43d3-aebb-c105d3eac2b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:06.026053 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f34d4f0d-a82c-43d3-aebb-c105d3eac2b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:06.084673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f34d4f0d-a82c-43d3-aebb-c105d3eac2b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:06.093808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f34d4f0d-a82c-43d3-aebb-c105d3eac2b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:06.095291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f34d4f0d-a82c-43d3-aebb-c105d3eac2b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:06.096460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f34d4f0d-a82c-43d3-aebb-c105d3eac2b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082380 Apr 07 13:18:06.097012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 625/1374] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:06 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:06.198682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a5ebe4a5-f734-41a3-af17-d24c181b3778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:06.199297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a5ebe4a5-f734-41a3-af17-d24c181b3778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:06.206074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a5ebe4a5-f734-41a3-af17-d24c181b3778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:06.206530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a5ebe4a5-f734-41a3-af17-d24c181b3778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:06.207297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a5ebe4a5-f734-41a3-af17-d24c181b3778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:06.207734 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a5ebe4a5-f734-41a3-af17-d24c181b3778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:06.334541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a5ebe4a5-f734-41a3-af17-d24c181b3778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:06.338759 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1bda0b7b-9f14-400b-aaba-42a9fb494127 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:06.339375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1bda0b7b-9f14-400b-aaba-42a9fb494127 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:06.343353 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a5ebe4a5-f734-41a3-af17-d24c181b3778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148398 Apr 07 13:18:06.343924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 750/1375] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:06 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:06.345935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1bda0b7b-9f14-400b-aaba-42a9fb494127 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:06.346384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1bda0b7b-9f14-400b-aaba-42a9fb494127 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:06.347144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1bda0b7b-9f14-400b-aaba-42a9fb494127 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:06.347578 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1bda0b7b-9f14-400b-aaba-42a9fb494127 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:06.479073 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1bda0b7b-9f14-400b-aaba-42a9fb494127 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:06.487535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1bda0b7b-9f14-400b-aaba-42a9fb494127 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152629 Apr 07 13:18:06.488110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 626/1376] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:06 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:07.114221 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0217dd08-b755-498a-b897-5155f991f3bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:07.114910 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0217dd08-b755-498a-b897-5155f991f3bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:07.120830 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0217dd08-b755-498a-b897-5155f991f3bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:07.121273 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0217dd08-b755-498a-b897-5155f991f3bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:07.122027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0217dd08-b755-498a-b897-5155f991f3bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:07.123579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0217dd08-b755-498a-b897-5155f991f3bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:07.196801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0217dd08-b755-498a-b897-5155f991f3bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:07.206846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0217dd08-b755-498a-b897-5155f991f3bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:07.208379 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0217dd08-b755-498a-b897-5155f991f3bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:07.209549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0217dd08-b755-498a-b897-5155f991f3bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.099331 Apr 07 13:18:07.210097 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 751/1377] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:07 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:07.360837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-751fd2ff-3704-4507-a64a-b3199e4a7221 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:07.361461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-751fd2ff-3704-4507-a64a-b3199e4a7221 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:07.367826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-751fd2ff-3704-4507-a64a-b3199e4a7221 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:07.368269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-751fd2ff-3704-4507-a64a-b3199e4a7221 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:07.369046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-751fd2ff-3704-4507-a64a-b3199e4a7221 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:07.369487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-751fd2ff-3704-4507-a64a-b3199e4a7221 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:07.505301 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-09e0dc30-4413-454f-95c4-174d88c6fb44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:07.505918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-09e0dc30-4413-454f-95c4-174d88c6fb44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:07.511778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-09e0dc30-4413-454f-95c4-174d88c6fb44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:07.512252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-09e0dc30-4413-454f-95c4-174d88c6fb44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:07.513011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-09e0dc30-4413-454f-95c4-174d88c6fb44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:07.513446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-09e0dc30-4413-454f-95c4-174d88c6fb44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:07.526238 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-751fd2ff-3704-4507-a64a-b3199e4a7221 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:07.534773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-751fd2ff-3704-4507-a64a-b3199e4a7221 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.178376 Apr 07 13:18:07.535599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 627/1378] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:07 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:07.641826 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-09e0dc30-4413-454f-95c4-174d88c6fb44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:07.649553 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-09e0dc30-4413-454f-95c4-174d88c6fb44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.148052 Apr 07 13:18:07.650109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 752/1379] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:07 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:08.226836 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f340e8b0-53fc-40f6-82b0-3730ce5df4f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:08.227440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f340e8b0-53fc-40f6-82b0-3730ce5df4f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:08.233373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f340e8b0-53fc-40f6-82b0-3730ce5df4f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:08.233820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f340e8b0-53fc-40f6-82b0-3730ce5df4f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:08.234579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f340e8b0-53fc-40f6-82b0-3730ce5df4f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:08.235012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f340e8b0-53fc-40f6-82b0-3730ce5df4f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:08.292750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f340e8b0-53fc-40f6-82b0-3730ce5df4f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:08.300899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f340e8b0-53fc-40f6-82b0-3730ce5df4f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:08.302437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f340e8b0-53fc-40f6-82b0-3730ce5df4f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:08.303573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f340e8b0-53fc-40f6-82b0-3730ce5df4f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.080669 Apr 07 13:18:08.304136 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 628/1380] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:08 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:08.552929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-614ffab4-8a5d-46e0-86cd-9e86665ff620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:08.553453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-614ffab4-8a5d-46e0-86cd-9e86665ff620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:08.559667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-614ffab4-8a5d-46e0-86cd-9e86665ff620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:08.560738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-614ffab4-8a5d-46e0-86cd-9e86665ff620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:08.561501 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-614ffab4-8a5d-46e0-86cd-9e86665ff620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:08.561938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-614ffab4-8a5d-46e0-86cd-9e86665ff620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:08.667018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d5fb9b6e-bd51-42dc-b3e4-e4b123555898 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:08.667645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d5fb9b6e-bd51-42dc-b3e4-e4b123555898 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:08.674856 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d5fb9b6e-bd51-42dc-b3e4-e4b123555898 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:08.675309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d5fb9b6e-bd51-42dc-b3e4-e4b123555898 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:08.676103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d5fb9b6e-bd51-42dc-b3e4-e4b123555898 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:08.676562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d5fb9b6e-bd51-42dc-b3e4-e4b123555898 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:08.690804 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-614ffab4-8a5d-46e0-86cd-9e86665ff620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:08.698656 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-614ffab4-8a5d-46e0-86cd-9e86665ff620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149632 Apr 07 13:18:08.699218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 753/1381] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:08 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:08.806748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d5fb9b6e-bd51-42dc-b3e4-e4b123555898 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:08.815376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d5fb9b6e-bd51-42dc-b3e4-e4b123555898 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152199 Apr 07 13:18:08.815989 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 629/1382] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:08 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:09.322185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1e9d124c-7ed6-4d6a-81d2-1d7e01f4272b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:09.322796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1e9d124c-7ed6-4d6a-81d2-1d7e01f4272b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:09.329622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e9d124c-7ed6-4d6a-81d2-1d7e01f4272b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:09.330069 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e9d124c-7ed6-4d6a-81d2-1d7e01f4272b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:09.330830 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e9d124c-7ed6-4d6a-81d2-1d7e01f4272b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:09.331271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e9d124c-7ed6-4d6a-81d2-1d7e01f4272b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:09.395377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1e9d124c-7ed6-4d6a-81d2-1d7e01f4272b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:09.404335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1e9d124c-7ed6-4d6a-81d2-1d7e01f4272b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:09.405845 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1e9d124c-7ed6-4d6a-81d2-1d7e01f4272b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:09.406989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1e9d124c-7ed6-4d6a-81d2-1d7e01f4272b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088690 Apr 07 13:18:09.407539 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 754/1383] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:09 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:09.715828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9c27eb5f-3ad0-402b-b0b5-52a5d9c3a120 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:09.717364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9c27eb5f-3ad0-402b-b0b5-52a5d9c3a120 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:09.723807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c27eb5f-3ad0-402b-b0b5-52a5d9c3a120 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:09.724292 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c27eb5f-3ad0-402b-b0b5-52a5d9c3a120 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:09.725072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c27eb5f-3ad0-402b-b0b5-52a5d9c3a120 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:09.725510 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c27eb5f-3ad0-402b-b0b5-52a5d9c3a120 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:09.832711 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-946816d3-f549-440c-a23c-72065aa2ebd9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:09.833249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-946816d3-f549-440c-a23c-72065aa2ebd9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:09.839802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-946816d3-f549-440c-a23c-72065aa2ebd9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:09.840291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-946816d3-f549-440c-a23c-72065aa2ebd9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:09.841562 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-946816d3-f549-440c-a23c-72065aa2ebd9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:09.842002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-946816d3-f549-440c-a23c-72065aa2ebd9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:09.867238 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9c27eb5f-3ad0-402b-b0b5-52a5d9c3a120 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:09.875711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9c27eb5f-3ad0-402b-b0b5-52a5d9c3a120 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.163698 Apr 07 13:18:09.876314 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 630/1384] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:09 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:10.086603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-946816d3-f549-440c-a23c-72065aa2ebd9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:10.095170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-946816d3-f549-440c-a23c-72065aa2ebd9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.266390 Apr 07 13:18:10.095738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 755/1385] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:09 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:10.425131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5e723302-67fa-4dae-bb34-e901e7db9035 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:10.425736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5e723302-67fa-4dae-bb34-e901e7db9035 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:10.431500 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e723302-67fa-4dae-bb34-e901e7db9035 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:10.431943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e723302-67fa-4dae-bb34-e901e7db9035 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:10.432729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e723302-67fa-4dae-bb34-e901e7db9035 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:10.433161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e723302-67fa-4dae-bb34-e901e7db9035 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:10.492203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5e723302-67fa-4dae-bb34-e901e7db9035 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:10.501166 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5e723302-67fa-4dae-bb34-e901e7db9035 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:10.502638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5e723302-67fa-4dae-bb34-e901e7db9035 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:10.503774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5e723302-67fa-4dae-bb34-e901e7db9035 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082531 Apr 07 13:18:10.504341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 631/1386] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:10 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:10.893494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-21265d18-d747-42be-b570-0dae2b46ef66 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:10.894112 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-21265d18-d747-42be-b570-0dae2b46ef66 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:10.900509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21265d18-d747-42be-b570-0dae2b46ef66 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:10.900989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21265d18-d747-42be-b570-0dae2b46ef66 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:10.901753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21265d18-d747-42be-b570-0dae2b46ef66 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:10.902190 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21265d18-d747-42be-b570-0dae2b46ef66 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:11.034041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-21265d18-d747-42be-b570-0dae2b46ef66 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:11.041991 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-21265d18-d747-42be-b570-0dae2b46ef66 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153203 Apr 07 13:18:11.042554 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 756/1387] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:10 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:11.111930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d69b17f0-ebb2-4c04-9c74-159d11b0e7fa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:11.112580 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d69b17f0-ebb2-4c04-9c74-159d11b0e7fa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:11.118765 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d69b17f0-ebb2-4c04-9c74-159d11b0e7fa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:11.119232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d69b17f0-ebb2-4c04-9c74-159d11b0e7fa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:11.119972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d69b17f0-ebb2-4c04-9c74-159d11b0e7fa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:11.120439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d69b17f0-ebb2-4c04-9c74-159d11b0e7fa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:11.253477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d69b17f0-ebb2-4c04-9c74-159d11b0e7fa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:11.261151 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d69b17f0-ebb2-4c04-9c74-159d11b0e7fa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153029 Apr 07 13:18:11.261714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 632/1388] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:11 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:11.522836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b1d367cc-591b-4c39-b1aa-fea3af7cd68e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:11.523474 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b1d367cc-591b-4c39-b1aa-fea3af7cd68e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:11.529335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b1d367cc-591b-4c39-b1aa-fea3af7cd68e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:11.530487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b1d367cc-591b-4c39-b1aa-fea3af7cd68e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:11.531250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b1d367cc-591b-4c39-b1aa-fea3af7cd68e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:11.531685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b1d367cc-591b-4c39-b1aa-fea3af7cd68e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:11.589083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b1d367cc-591b-4c39-b1aa-fea3af7cd68e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:11.598146 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b1d367cc-591b-4c39-b1aa-fea3af7cd68e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:11.599630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b1d367cc-591b-4c39-b1aa-fea3af7cd68e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:11.600803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b1d367cc-591b-4c39-b1aa-fea3af7cd68e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081887 Apr 07 13:18:11.601353 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 757/1389] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:11 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:12.058808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cc8f72b3-bfce-457c-a980-c174aaaad93c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:12.060034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cc8f72b3-bfce-457c-a980-c174aaaad93c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:12.067009 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc8f72b3-bfce-457c-a980-c174aaaad93c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:12.067456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc8f72b3-bfce-457c-a980-c174aaaad93c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:12.068238 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc8f72b3-bfce-457c-a980-c174aaaad93c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:12.068672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc8f72b3-bfce-457c-a980-c174aaaad93c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:12.201164 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cc8f72b3-bfce-457c-a980-c174aaaad93c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:12.209524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cc8f72b3-bfce-457c-a980-c174aaaad93c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154617 Apr 07 13:18:12.210084 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 633/1390] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:12 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:12.278488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-aaeddde3-5e64-434d-b326-d05b81bbcd01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:12.279094 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-aaeddde3-5e64-434d-b326-d05b81bbcd01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:12.286044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aaeddde3-5e64-434d-b326-d05b81bbcd01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:12.286492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aaeddde3-5e64-434d-b326-d05b81bbcd01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:12.287242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aaeddde3-5e64-434d-b326-d05b81bbcd01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:12.287668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aaeddde3-5e64-434d-b326-d05b81bbcd01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:12.415553 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-aaeddde3-5e64-434d-b326-d05b81bbcd01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:12.424284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-aaeddde3-5e64-434d-b326-d05b81bbcd01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149514 Apr 07 13:18:12.424849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 758/1391] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:12 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:12.618812 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8a3a48b2-bc9c-49c3-913d-bc661553df42 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:12.619363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8a3a48b2-bc9c-49c3-913d-bc661553df42 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:12.626069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a3a48b2-bc9c-49c3-913d-bc661553df42 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:12.626526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a3a48b2-bc9c-49c3-913d-bc661553df42 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:12.627292 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a3a48b2-bc9c-49c3-913d-bc661553df42 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:12.627731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a3a48b2-bc9c-49c3-913d-bc661553df42 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:12.685391 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8a3a48b2-bc9c-49c3-913d-bc661553df42 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:12.693973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8a3a48b2-bc9c-49c3-913d-bc661553df42 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:12.695468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8a3a48b2-bc9c-49c3-913d-bc661553df42 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:12.696645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8a3a48b2-bc9c-49c3-913d-bc661553df42 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081907 Apr 07 13:18:12.697202 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 634/1392] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:12 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:13.226768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3bd276da-2084-4585-b475-8cbb75c05798 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:13.227390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3bd276da-2084-4585-b475-8cbb75c05798 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:13.233881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bd276da-2084-4585-b475-8cbb75c05798 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:13.234330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bd276da-2084-4585-b475-8cbb75c05798 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:13.235088 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bd276da-2084-4585-b475-8cbb75c05798 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:13.235524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bd276da-2084-4585-b475-8cbb75c05798 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:13.367966 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3bd276da-2084-4585-b475-8cbb75c05798 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:13.376570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3bd276da-2084-4585-b475-8cbb75c05798 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153608 Apr 07 13:18:13.377135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 759/1393] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:13 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:13.440899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eafdef90-e076-42d0-b838-d6d76e1bc4c7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:13.441508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-eafdef90-e076-42d0-b838-d6d76e1bc4c7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:13.447733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eafdef90-e076-42d0-b838-d6d76e1bc4c7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:13.448209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eafdef90-e076-42d0-b838-d6d76e1bc4c7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:13.448968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eafdef90-e076-42d0-b838-d6d76e1bc4c7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:13.449407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eafdef90-e076-42d0-b838-d6d76e1bc4c7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:13.577784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eafdef90-e076-42d0-b838-d6d76e1bc4c7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:13.585666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eafdef90-e076-42d0-b838-d6d76e1bc4c7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.148540 Apr 07 13:18:13.586231 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 635/1394] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:13 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:13.714972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-13cec08c-3db6-44d5-8cf2-22c7aab9445a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:13.715576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-13cec08c-3db6-44d5-8cf2-22c7aab9445a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:13.722595 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13cec08c-3db6-44d5-8cf2-22c7aab9445a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:13.723043 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13cec08c-3db6-44d5-8cf2-22c7aab9445a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:13.723800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13cec08c-3db6-44d5-8cf2-22c7aab9445a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:13.724258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13cec08c-3db6-44d5-8cf2-22c7aab9445a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:13.783626 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-13cec08c-3db6-44d5-8cf2-22c7aab9445a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:13.798854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-13cec08c-3db6-44d5-8cf2-22c7aab9445a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:13.800377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-13cec08c-3db6-44d5-8cf2-22c7aab9445a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:13.801525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-13cec08c-3db6-44d5-8cf2-22c7aab9445a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.090369 Apr 07 13:18:13.802083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 760/1395] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:13 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:14.393899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ad4dd0b4-05f2-4244-9eb4-006906dae879 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:14.394554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ad4dd0b4-05f2-4244-9eb4-006906dae879 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:14.401947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad4dd0b4-05f2-4244-9eb4-006906dae879 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:14.402438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad4dd0b4-05f2-4244-9eb4-006906dae879 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:14.403527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad4dd0b4-05f2-4244-9eb4-006906dae879 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:14.404005 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad4dd0b4-05f2-4244-9eb4-006906dae879 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:14.552325 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ad4dd0b4-05f2-4244-9eb4-006906dae879 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:14.560240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ad4dd0b4-05f2-4244-9eb4-006906dae879 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.170337 Apr 07 13:18:14.560806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 636/1396] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:14 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:14.602678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e6aac25e-599f-4dc5-a2d9-6d47a111e688 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:14.603294 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e6aac25e-599f-4dc5-a2d9-6d47a111e688 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:14.609899 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e6aac25e-599f-4dc5-a2d9-6d47a111e688 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:14.610349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e6aac25e-599f-4dc5-a2d9-6d47a111e688 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:14.611559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e6aac25e-599f-4dc5-a2d9-6d47a111e688 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:14.612003 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e6aac25e-599f-4dc5-a2d9-6d47a111e688 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:14.743108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e6aac25e-599f-4dc5-a2d9-6d47a111e688 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:14.750940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e6aac25e-599f-4dc5-a2d9-6d47a111e688 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152083 Apr 07 13:18:14.751509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 761/1397] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:14 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:14.819529 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e3446d71-d922-44f6-8b08-c5a5895e1f57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:14.820158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e3446d71-d922-44f6-8b08-c5a5895e1f57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:14.826138 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e3446d71-d922-44f6-8b08-c5a5895e1f57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:14.827728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e3446d71-d922-44f6-8b08-c5a5895e1f57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:14.836411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e3446d71-d922-44f6-8b08-c5a5895e1f57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:14.836881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e3446d71-d922-44f6-8b08-c5a5895e1f57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:14.899841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e3446d71-d922-44f6-8b08-c5a5895e1f57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:14.908085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e3446d71-d922-44f6-8b08-c5a5895e1f57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:14.909607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e3446d71-d922-44f6-8b08-c5a5895e1f57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:14.911011 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e3446d71-d922-44f6-8b08-c5a5895e1f57 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.095397 Apr 07 13:18:14.911565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 637/1398] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:14 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:15.577443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a0e2358e-90d8-4b83-9eb7-5c712f78f7a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:15.578202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a0e2358e-90d8-4b83-9eb7-5c712f78f7a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:15.584552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0e2358e-90d8-4b83-9eb7-5c712f78f7a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:15.585046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0e2358e-90d8-4b83-9eb7-5c712f78f7a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:15.585815 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0e2358e-90d8-4b83-9eb7-5c712f78f7a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:15.586244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0e2358e-90d8-4b83-9eb7-5c712f78f7a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:15.722139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a0e2358e-90d8-4b83-9eb7-5c712f78f7a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:15.730158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a0e2358e-90d8-4b83-9eb7-5c712f78f7a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.157080 Apr 07 13:18:15.730722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 762/1399] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:15 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:15.767703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-72cf6898-b6a0-4ee4-8247-374a0d1ff245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:15.768274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-72cf6898-b6a0-4ee4-8247-374a0d1ff245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:15.774519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-72cf6898-b6a0-4ee4-8247-374a0d1ff245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:15.774971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-72cf6898-b6a0-4ee4-8247-374a0d1ff245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:15.775753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-72cf6898-b6a0-4ee4-8247-374a0d1ff245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:15.776196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-72cf6898-b6a0-4ee4-8247-374a0d1ff245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:15.909137 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-72cf6898-b6a0-4ee4-8247-374a0d1ff245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:15.917180 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-72cf6898-b6a0-4ee4-8247-374a0d1ff245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153348 Apr 07 13:18:15.917751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 638/1400] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:15 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:15.929563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d2809a4c-adb7-4415-bc42-744bee71e72a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:15.930294 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d2809a4c-adb7-4415-bc42-744bee71e72a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:15.936412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2809a4c-adb7-4415-bc42-744bee71e72a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:15.936864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2809a4c-adb7-4415-bc42-744bee71e72a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:15.937635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2809a4c-adb7-4415-bc42-744bee71e72a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:15.938069 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2809a4c-adb7-4415-bc42-744bee71e72a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:16.000037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d2809a4c-adb7-4415-bc42-744bee71e72a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:16.008454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d2809a4c-adb7-4415-bc42-744bee71e72a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:16.010201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d2809a4c-adb7-4415-bc42-744bee71e72a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:16.011677 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d2809a4c-adb7-4415-bc42-744bee71e72a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085714 Apr 07 13:18:16.012262 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 763/1401] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:15 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:18:16.747844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5b0c8dfb-d076-41fd-8fc1-523be732a074 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:16.749178 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5b0c8dfb-d076-41fd-8fc1-523be732a074 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:16.755296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b0c8dfb-d076-41fd-8fc1-523be732a074 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:16.755751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b0c8dfb-d076-41fd-8fc1-523be732a074 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:16.756544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b0c8dfb-d076-41fd-8fc1-523be732a074 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:16.756983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5b0c8dfb-d076-41fd-8fc1-523be732a074 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:16.891578 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5b0c8dfb-d076-41fd-8fc1-523be732a074 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:16.899718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5b0c8dfb-d076-41fd-8fc1-523be732a074 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.155653 Apr 07 13:18:16.900337 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 639/1402] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:16 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:16.934727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-31155424-1143-4dc0-9a2b-3669019fbc72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:16.935344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-31155424-1143-4dc0-9a2b-3669019fbc72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:16.942294 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-31155424-1143-4dc0-9a2b-3669019fbc72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:16.942743 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-31155424-1143-4dc0-9a2b-3669019fbc72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:16.943507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-31155424-1143-4dc0-9a2b-3669019fbc72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:16.943944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-31155424-1143-4dc0-9a2b-3669019fbc72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:17.031172 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9b2c99bf-1765-4576-a4ac-e6a70815f13a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:17.031794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9b2c99bf-1765-4576-a4ac-e6a70815f13a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:17.038120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b2c99bf-1765-4576-a4ac-e6a70815f13a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:17.038581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b2c99bf-1765-4576-a4ac-e6a70815f13a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:17.039402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b2c99bf-1765-4576-a4ac-e6a70815f13a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:17.039848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b2c99bf-1765-4576-a4ac-e6a70815f13a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:17.084442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-31155424-1143-4dc0-9a2b-3669019fbc72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:17.093490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-31155424-1143-4dc0-9a2b-3669019fbc72 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.162412 Apr 07 13:18:17.093989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 764/1403] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:16 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:17.108466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9b2c99bf-1765-4576-a4ac-e6a70815f13a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:17.118780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9b2c99bf-1765-4576-a4ac-e6a70815f13a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:17.120344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9b2c99bf-1765-4576-a4ac-e6a70815f13a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:17.121554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9b2c99bf-1765-4576-a4ac-e6a70815f13a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.094898 Apr 07 13:18:17.122113 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 640/1404] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:17 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:18:17.916503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a46e96fc-7dc7-4242-ae3b-98f884af40ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:17.917237 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a46e96fc-7dc7-4242-ae3b-98f884af40ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:17.925094 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a46e96fc-7dc7-4242-ae3b-98f884af40ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:17.925540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a46e96fc-7dc7-4242-ae3b-98f884af40ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:17.926316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a46e96fc-7dc7-4242-ae3b-98f884af40ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:17.926751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a46e96fc-7dc7-4242-ae3b-98f884af40ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:18.060533 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a46e96fc-7dc7-4242-ae3b-98f884af40ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:18.069245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a46e96fc-7dc7-4242-ae3b-98f884af40ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.156603 Apr 07 13:18:18.069821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 765/1405] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:17 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:18.110505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cc47d948-f44d-4a08-803b-f47edc8f186f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:18.111127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cc47d948-f44d-4a08-803b-f47edc8f186f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:18.117460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc47d948-f44d-4a08-803b-f47edc8f186f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:18.117920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc47d948-f44d-4a08-803b-f47edc8f186f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:18.118691 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc47d948-f44d-4a08-803b-f47edc8f186f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:18.119135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc47d948-f44d-4a08-803b-f47edc8f186f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:18.139686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7ea89e60-c6c0-4a2e-9002-3abf6d9d77c4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:18.140337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7ea89e60-c6c0-4a2e-9002-3abf6d9d77c4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:18.146062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ea89e60-c6c0-4a2e-9002-3abf6d9d77c4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:18.146511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ea89e60-c6c0-4a2e-9002-3abf6d9d77c4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:18.147280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ea89e60-c6c0-4a2e-9002-3abf6d9d77c4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:18.147713 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ea89e60-c6c0-4a2e-9002-3abf6d9d77c4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:18.208209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7ea89e60-c6c0-4a2e-9002-3abf6d9d77c4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:18.217177 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7ea89e60-c6c0-4a2e-9002-3abf6d9d77c4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:18.218859 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7ea89e60-c6c0-4a2e-9002-3abf6d9d77c4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:18.220043 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7ea89e60-c6c0-4a2e-9002-3abf6d9d77c4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084835 Apr 07 13:18:18.220858 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 766/1406] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:18 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:18:18.256710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cc47d948-f44d-4a08-803b-f47edc8f186f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:18.264570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cc47d948-f44d-4a08-803b-f47edc8f186f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157956 Apr 07 13:18:18.265437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 641/1407] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:18 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:19.086694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cafd8dcd-baab-4ee6-961a-9a0101ad5232 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:19.087405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cafd8dcd-baab-4ee6-961a-9a0101ad5232 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:19.095165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cafd8dcd-baab-4ee6-961a-9a0101ad5232 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:19.095719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cafd8dcd-baab-4ee6-961a-9a0101ad5232 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:19.096589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cafd8dcd-baab-4ee6-961a-9a0101ad5232 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:19.097021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cafd8dcd-baab-4ee6-961a-9a0101ad5232 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:19.232113 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cafd8dcd-baab-4ee6-961a-9a0101ad5232 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:19.238320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0229402c-9fa5-430b-9109-5aee80c84386 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:19.239022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0229402c-9fa5-430b-9109-5aee80c84386 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:19.239886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cafd8dcd-baab-4ee6-961a-9a0101ad5232 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.156987 Apr 07 13:18:19.240472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 767/1408] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:19 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:19.245526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0229402c-9fa5-430b-9109-5aee80c84386 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:19.246050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0229402c-9fa5-430b-9109-5aee80c84386 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:19.246890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0229402c-9fa5-430b-9109-5aee80c84386 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:19.247394 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0229402c-9fa5-430b-9109-5aee80c84386 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:19.282046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bc7518d6-62ec-410e-a5f1-09b67402b530 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:19.282688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bc7518d6-62ec-410e-a5f1-09b67402b530 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:19.288841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc7518d6-62ec-410e-a5f1-09b67402b530 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:19.289308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc7518d6-62ec-410e-a5f1-09b67402b530 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:19.290063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc7518d6-62ec-410e-a5f1-09b67402b530 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:19.290493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc7518d6-62ec-410e-a5f1-09b67402b530 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:19.306839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0229402c-9fa5-430b-9109-5aee80c84386 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:19.315655 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0229402c-9fa5-430b-9109-5aee80c84386 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:19.317369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0229402c-9fa5-430b-9109-5aee80c84386 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:19.318603 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0229402c-9fa5-430b-9109-5aee80c84386 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084206 Apr 07 13:18:19.319423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 642/1409] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:19 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:18:19.420234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bc7518d6-62ec-410e-a5f1-09b67402b530 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:19.427964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bc7518d6-62ec-410e-a5f1-09b67402b530 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150207 Apr 07 13:18:19.428558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 768/1410] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:19 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:20.256327 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a0540826-38f8-4580-8e5e-4fa15f41703c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:20.256927 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a0540826-38f8-4580-8e5e-4fa15f41703c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:20.263242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0540826-38f8-4580-8e5e-4fa15f41703c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:20.263738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0540826-38f8-4580-8e5e-4fa15f41703c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:20.264533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0540826-38f8-4580-8e5e-4fa15f41703c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:20.264970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0540826-38f8-4580-8e5e-4fa15f41703c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:20.337362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e3f89722-464b-45d5-9e6e-9a3252f67ae7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:20.338095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e3f89722-464b-45d5-9e6e-9a3252f67ae7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:20.344938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e3f89722-464b-45d5-9e6e-9a3252f67ae7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:20.345392 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e3f89722-464b-45d5-9e6e-9a3252f67ae7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:20.346165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e3f89722-464b-45d5-9e6e-9a3252f67ae7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:20.346607 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e3f89722-464b-45d5-9e6e-9a3252f67ae7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:20.398665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a0540826-38f8-4580-8e5e-4fa15f41703c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:20.406126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e3f89722-464b-45d5-9e6e-9a3252f67ae7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:20.407034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a0540826-38f8-4580-8e5e-4fa15f41703c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154541 Apr 07 13:18:20.407611 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 643/1411] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:20 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:20.414665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e3f89722-464b-45d5-9e6e-9a3252f67ae7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:20.416416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e3f89722-464b-45d5-9e6e-9a3252f67ae7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:20.417552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e3f89722-464b-45d5-9e6e-9a3252f67ae7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084258 Apr 07 13:18:20.418098 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 769/1412] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:20 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:18:20.444476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0d3b55ea-5c78-4815-93b3-df1f13a41b9b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:20.445089 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0d3b55ea-5c78-4815-93b3-df1f13a41b9b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:20.450860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d3b55ea-5c78-4815-93b3-df1f13a41b9b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:20.452081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d3b55ea-5c78-4815-93b3-df1f13a41b9b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:20.453038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d3b55ea-5c78-4815-93b3-df1f13a41b9b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:20.453480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d3b55ea-5c78-4815-93b3-df1f13a41b9b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:20.588609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0d3b55ea-5c78-4815-93b3-df1f13a41b9b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:20.597122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0d3b55ea-5c78-4815-93b3-df1f13a41b9b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156401 Apr 07 13:18:20.597726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 644/1413] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:20 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:21.425008 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-349bbe43-4ec2-4f18-9741-fb08baeb614b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:21.425650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-349bbe43-4ec2-4f18-9741-fb08baeb614b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:21.431981 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-349bbe43-4ec2-4f18-9741-fb08baeb614b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:21.432455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-349bbe43-4ec2-4f18-9741-fb08baeb614b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:21.433217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-349bbe43-4ec2-4f18-9741-fb08baeb614b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:21.433652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-349bbe43-4ec2-4f18-9741-fb08baeb614b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:21.436605 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8079d7db-e4ef-4727-82ca-273727383744 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:21.437311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8079d7db-e4ef-4727-82ca-273727383744 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:21.443429 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8079d7db-e4ef-4727-82ca-273727383744 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:21.443878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8079d7db-e4ef-4727-82ca-273727383744 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:21.444678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8079d7db-e4ef-4727-82ca-273727383744 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:21.445139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8079d7db-e4ef-4727-82ca-273727383744 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:21.509837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8079d7db-e4ef-4727-82ca-273727383744 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:21.518267 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8079d7db-e4ef-4727-82ca-273727383744 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:21.519749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8079d7db-e4ef-4727-82ca-273727383744 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:21.520998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8079d7db-e4ef-4727-82ca-273727383744 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088920 Apr 07 13:18:21.521557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 645/1414] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:21 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:18:21.573240 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-349bbe43-4ec2-4f18-9741-fb08baeb614b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:21.581338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-349bbe43-4ec2-4f18-9741-fb08baeb614b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.160090 Apr 07 13:18:21.581910 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 770/1415] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:21 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:21.614448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b2f9f399-a187-44a8-8a10-bac20952791d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:21.615103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b2f9f399-a187-44a8-8a10-bac20952791d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:21.621204 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b2f9f399-a187-44a8-8a10-bac20952791d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:21.621656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b2f9f399-a187-44a8-8a10-bac20952791d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:21.622421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b2f9f399-a187-44a8-8a10-bac20952791d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:21.622858 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b2f9f399-a187-44a8-8a10-bac20952791d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:21.752422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b2f9f399-a187-44a8-8a10-bac20952791d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:21.760380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b2f9f399-a187-44a8-8a10-bac20952791d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149740 Apr 07 13:18:21.760964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 646/1416] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:21 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:22.540041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-282c2f30-c4b0-468b-be0e-d19b876f8a6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:22.540673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-282c2f30-c4b0-468b-be0e-d19b876f8a6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:22.547049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-282c2f30-c4b0-468b-be0e-d19b876f8a6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:22.547493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-282c2f30-c4b0-468b-be0e-d19b876f8a6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:22.548279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-282c2f30-c4b0-468b-be0e-d19b876f8a6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:22.548715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-282c2f30-c4b0-468b-be0e-d19b876f8a6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:22.598895 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8a0e4e79-cfa4-498c-b031-2f08fd4a8f81 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:22.599512 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8a0e4e79-cfa4-498c-b031-2f08fd4a8f81 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:22.605867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a0e4e79-cfa4-498c-b031-2f08fd4a8f81 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:22.606321 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a0e4e79-cfa4-498c-b031-2f08fd4a8f81 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:22.607093 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a0e4e79-cfa4-498c-b031-2f08fd4a8f81 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:22.607607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a0e4e79-cfa4-498c-b031-2f08fd4a8f81 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:22.609326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-282c2f30-c4b0-468b-be0e-d19b876f8a6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:22.617406 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-282c2f30-c4b0-468b-be0e-d19b876f8a6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:22.618888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-282c2f30-c4b0-468b-be0e-d19b876f8a6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:22.620023 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-282c2f30-c4b0-468b-be0e-d19b876f8a6e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084114 Apr 07 13:18:22.620598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 771/1417] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:22.747439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8a0e4e79-cfa4-498c-b031-2f08fd4a8f81 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:22.755984 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8a0e4e79-cfa4-498c-b031-2f08fd4a8f81 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.160927 Apr 07 13:18:22.756578 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 647/1418] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:22 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:22.777514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-55310f25-56ee-4831-80ed-686ca1549e46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:22.779059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-55310f25-56ee-4831-80ed-686ca1549e46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:22.786705 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55310f25-56ee-4831-80ed-686ca1549e46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:22.787154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55310f25-56ee-4831-80ed-686ca1549e46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:22.787914 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55310f25-56ee-4831-80ed-686ca1549e46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:22.788384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55310f25-56ee-4831-80ed-686ca1549e46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:22.917615 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-55310f25-56ee-4831-80ed-686ca1549e46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:22.926220 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-55310f25-56ee-4831-80ed-686ca1549e46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153532 Apr 07 13:18:22.926786 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 772/1419] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:22 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:23.638246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cb5f6995-4c77-48f9-b400-935d4d678b49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:23.639555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cb5f6995-4c77-48f9-b400-935d4d678b49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:23.645821 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb5f6995-4c77-48f9-b400-935d4d678b49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:23.646268 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb5f6995-4c77-48f9-b400-935d4d678b49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:23.647031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb5f6995-4c77-48f9-b400-935d4d678b49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:23.647466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cb5f6995-4c77-48f9-b400-935d4d678b49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:23.713196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cb5f6995-4c77-48f9-b400-935d4d678b49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:23.722241 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cb5f6995-4c77-48f9-b400-935d4d678b49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:23.723723 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cb5f6995-4c77-48f9-b400-935d4d678b49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:23.724939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cb5f6995-4c77-48f9-b400-935d4d678b49 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.090585 Apr 07 13:18:23.725484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 648/1420] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:23 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:18:23.774871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4cb0a03f-514a-4df9-b5f0-9af365962f5e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:23.775449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4cb0a03f-514a-4df9-b5f0-9af365962f5e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:23.783549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4cb0a03f-514a-4df9-b5f0-9af365962f5e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:23.783992 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4cb0a03f-514a-4df9-b5f0-9af365962f5e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:23.784775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4cb0a03f-514a-4df9-b5f0-9af365962f5e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:23.785461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4cb0a03f-514a-4df9-b5f0-9af365962f5e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:23.916314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4cb0a03f-514a-4df9-b5f0-9af365962f5e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:23.924226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4cb0a03f-514a-4df9-b5f0-9af365962f5e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153167 Apr 07 13:18:23.924789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 773/1421] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:23 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:23.942545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-76c266c7-3fe2-402d-95d0-f9cd8c91be3e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:23.943164 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-76c266c7-3fe2-402d-95d0-f9cd8c91be3e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:23.949093 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76c266c7-3fe2-402d-95d0-f9cd8c91be3e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:23.949547 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76c266c7-3fe2-402d-95d0-f9cd8c91be3e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:23.950311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76c266c7-3fe2-402d-95d0-f9cd8c91be3e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:23.950759 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76c266c7-3fe2-402d-95d0-f9cd8c91be3e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:24.086318 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-76c266c7-3fe2-402d-95d0-f9cd8c91be3e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:24.094823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-76c266c7-3fe2-402d-95d0-f9cd8c91be3e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156007 Apr 07 13:18:24.095390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 649/1422] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:23 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:24.742909 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-dd894bc3-a253-4273-8414-5122eef4228e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:24.743593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-dd894bc3-a253-4273-8414-5122eef4228e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:24.750029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dd894bc3-a253-4273-8414-5122eef4228e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:24.750478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dd894bc3-a253-4273-8414-5122eef4228e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:24.751231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dd894bc3-a253-4273-8414-5122eef4228e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:24.751663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dd894bc3-a253-4273-8414-5122eef4228e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:24.811921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-dd894bc3-a253-4273-8414-5122eef4228e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:24.820166 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-dd894bc3-a253-4273-8414-5122eef4228e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:24.821699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-dd894bc3-a253-4273-8414-5122eef4228e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:24.822828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-dd894bc3-a253-4273-8414-5122eef4228e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083761 Apr 07 13:18:24.823386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 774/1423] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:24 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:24.941223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e7e3a0c7-21da-4415-acc0-1763e877a875 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:24.941839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e7e3a0c7-21da-4415-acc0-1763e877a875 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:24.948190 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e7e3a0c7-21da-4415-acc0-1763e877a875 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:24.948645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e7e3a0c7-21da-4415-acc0-1763e877a875 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:24.949410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e7e3a0c7-21da-4415-acc0-1763e877a875 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:24.949850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e7e3a0c7-21da-4415-acc0-1763e877a875 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:25.080935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e7e3a0c7-21da-4415-acc0-1763e877a875 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:25.088655 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e7e3a0c7-21da-4415-acc0-1763e877a875 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151302 Apr 07 13:18:25.089218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 650/1424] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:24 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:25.110780 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-efb1512a-8095-402c-8796-0432c1ce0547 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:25.111394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-efb1512a-8095-402c-8796-0432c1ce0547 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:25.117334 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-efb1512a-8095-402c-8796-0432c1ce0547 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:25.117790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-efb1512a-8095-402c-8796-0432c1ce0547 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:25.118538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-efb1512a-8095-402c-8796-0432c1ce0547 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:25.118974 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-efb1512a-8095-402c-8796-0432c1ce0547 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:25.245691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-efb1512a-8095-402c-8796-0432c1ce0547 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:25.253579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-efb1512a-8095-402c-8796-0432c1ce0547 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.146813 Apr 07 13:18:25.254145 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 775/1425] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:25 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:25.841303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9984c9e0-ee74-4fc3-b8d2-96e110dfdd5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:25.841962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9984c9e0-ee74-4fc3-b8d2-96e110dfdd5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:25.847970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9984c9e0-ee74-4fc3-b8d2-96e110dfdd5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:25.848456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9984c9e0-ee74-4fc3-b8d2-96e110dfdd5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:25.849224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9984c9e0-ee74-4fc3-b8d2-96e110dfdd5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:25.849666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9984c9e0-ee74-4fc3-b8d2-96e110dfdd5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:25.910572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9984c9e0-ee74-4fc3-b8d2-96e110dfdd5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:25.918879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9984c9e0-ee74-4fc3-b8d2-96e110dfdd5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:25.920999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9984c9e0-ee74-4fc3-b8d2-96e110dfdd5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:25.922143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9984c9e0-ee74-4fc3-b8d2-96e110dfdd5c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085078 Apr 07 13:18:25.922703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 651/1426] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:25 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:26.105906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cbc4c6d3-20fb-469b-9b49-4328cf8245ba tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:26.106519 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cbc4c6d3-20fb-469b-9b49-4328cf8245ba tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:26.113634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbc4c6d3-20fb-469b-9b49-4328cf8245ba tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:26.114085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbc4c6d3-20fb-469b-9b49-4328cf8245ba tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:26.114840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbc4c6d3-20fb-469b-9b49-4328cf8245ba tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:26.115270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbc4c6d3-20fb-469b-9b49-4328cf8245ba tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:26.247791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cbc4c6d3-20fb-469b-9b49-4328cf8245ba tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:26.255555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cbc4c6d3-20fb-469b-9b49-4328cf8245ba tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153477 Apr 07 13:18:26.256119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 776/1427] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:26 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:26.269999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4fc08dab-93c8-44fd-bb91-edf0662a12bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:26.270619 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4fc08dab-93c8-44fd-bb91-edf0662a12bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:26.276929 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fc08dab-93c8-44fd-bb91-edf0662a12bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:26.277385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fc08dab-93c8-44fd-bb91-edf0662a12bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:26.278164 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fc08dab-93c8-44fd-bb91-edf0662a12bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:26.278603 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fc08dab-93c8-44fd-bb91-edf0662a12bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:26.409309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4fc08dab-93c8-44fd-bb91-edf0662a12bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:26.417350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4fc08dab-93c8-44fd-bb91-edf0662a12bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151145 Apr 07 13:18:26.417906 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 652/1428] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:26 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:26.940631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-04834b40-dcdb-4239-839e-0011a0818941 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:26.941241 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-04834b40-dcdb-4239-839e-0011a0818941 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:26.947083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04834b40-dcdb-4239-839e-0011a0818941 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:26.947526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04834b40-dcdb-4239-839e-0011a0818941 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:26.948315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04834b40-dcdb-4239-839e-0011a0818941 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:26.948774 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04834b40-dcdb-4239-839e-0011a0818941 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:27.009477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-04834b40-dcdb-4239-839e-0011a0818941 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:27.017998 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-04834b40-dcdb-4239-839e-0011a0818941 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:27.019477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-04834b40-dcdb-4239-839e-0011a0818941 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:27.020642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-04834b40-dcdb-4239-839e-0011a0818941 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083948 Apr 07 13:18:27.021193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 777/1429] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:26 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:27.272220 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c20dc10f-31c1-4167-84e6-c4186de149eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:27.272837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c20dc10f-31c1-4167-84e6-c4186de149eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:27.279738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c20dc10f-31c1-4167-84e6-c4186de149eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:27.280372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c20dc10f-31c1-4167-84e6-c4186de149eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:27.281144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c20dc10f-31c1-4167-84e6-c4186de149eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:27.281582 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c20dc10f-31c1-4167-84e6-c4186de149eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:27.409046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c20dc10f-31c1-4167-84e6-c4186de149eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:27.417092 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c20dc10f-31c1-4167-84e6-c4186de149eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148727 Apr 07 13:18:27.417656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 653/1430] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:27 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:27.433782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ea7dcaad-0a12-4a92-95a7-4511a9b1bfb6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:27.434437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ea7dcaad-0a12-4a92-95a7-4511a9b1bfb6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:27.444028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea7dcaad-0a12-4a92-95a7-4511a9b1bfb6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:27.444566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea7dcaad-0a12-4a92-95a7-4511a9b1bfb6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:27.445323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea7dcaad-0a12-4a92-95a7-4511a9b1bfb6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:27.445755 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea7dcaad-0a12-4a92-95a7-4511a9b1bfb6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:27.586291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ea7dcaad-0a12-4a92-95a7-4511a9b1bfb6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:27.594092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ea7dcaad-0a12-4a92-95a7-4511a9b1bfb6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.164087 Apr 07 13:18:27.594654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 778/1431] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:27 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:28.038932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-951ba8bb-77ad-4030-83a4-6361454f73c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:28.039543 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-951ba8bb-77ad-4030-83a4-6361454f73c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:28.045516 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-951ba8bb-77ad-4030-83a4-6361454f73c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:28.045958 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-951ba8bb-77ad-4030-83a4-6361454f73c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:28.046724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-951ba8bb-77ad-4030-83a4-6361454f73c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:28.047164 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-951ba8bb-77ad-4030-83a4-6361454f73c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:28.108071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-951ba8bb-77ad-4030-83a4-6361454f73c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:28.116280 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-951ba8bb-77ad-4030-83a4-6361454f73c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:28.117779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-951ba8bb-77ad-4030-83a4-6361454f73c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:28.118929 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-951ba8bb-77ad-4030-83a4-6361454f73c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084162 Apr 07 13:18:28.119505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 654/1432] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:28 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:28.434227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4c02c737-50f2-44a2-9def-9899d992510f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:28.434841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4c02c737-50f2-44a2-9def-9899d992510f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:28.441661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c02c737-50f2-44a2-9def-9899d992510f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:28.442112 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c02c737-50f2-44a2-9def-9899d992510f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:28.442872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c02c737-50f2-44a2-9def-9899d992510f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:28.443302 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c02c737-50f2-44a2-9def-9899d992510f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:28.571056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4c02c737-50f2-44a2-9def-9899d992510f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:28.579530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4c02c737-50f2-44a2-9def-9899d992510f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149152 Apr 07 13:18:28.580100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 779/1433] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:28 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:28.610584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3a23358e-8400-4a60-8f70-5cf851e6d563 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:28.611203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3a23358e-8400-4a60-8f70-5cf851e6d563 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:28.617522 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3a23358e-8400-4a60-8f70-5cf851e6d563 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:28.617972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3a23358e-8400-4a60-8f70-5cf851e6d563 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:28.618737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3a23358e-8400-4a60-8f70-5cf851e6d563 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:28.619177 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3a23358e-8400-4a60-8f70-5cf851e6d563 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:28.751003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3a23358e-8400-4a60-8f70-5cf851e6d563 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:28.758708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3a23358e-8400-4a60-8f70-5cf851e6d563 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151839 Apr 07 13:18:28.759274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 655/1434] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:28 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:29.135924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e0a23206-28d1-4643-8c87-71ec028490a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:29.136563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e0a23206-28d1-4643-8c87-71ec028490a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:29.142457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0a23206-28d1-4643-8c87-71ec028490a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:29.142911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0a23206-28d1-4643-8c87-71ec028490a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:29.143678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0a23206-28d1-4643-8c87-71ec028490a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:29.144109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0a23206-28d1-4643-8c87-71ec028490a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:29.203596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e0a23206-28d1-4643-8c87-71ec028490a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:29.211678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e0a23206-28d1-4643-8c87-71ec028490a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:29.213200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e0a23206-28d1-4643-8c87-71ec028490a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:29.214327 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e0a23206-28d1-4643-8c87-71ec028490a5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082314 Apr 07 13:18:29.214875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 780/1435] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:29 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:29.597357 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f5d5c5d7-957c-4a04-aa46-78f796f61375 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:29.597983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f5d5c5d7-957c-4a04-aa46-78f796f61375 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:29.603910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5d5c5d7-957c-4a04-aa46-78f796f61375 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:29.604403 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5d5c5d7-957c-4a04-aa46-78f796f61375 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:29.605174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5d5c5d7-957c-4a04-aa46-78f796f61375 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:29.605616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5d5c5d7-957c-4a04-aa46-78f796f61375 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:29.734451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f5d5c5d7-957c-4a04-aa46-78f796f61375 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:29.742213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f5d5c5d7-957c-4a04-aa46-78f796f61375 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148731 Apr 07 13:18:29.742779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 656/1436] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:29 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:29.775736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-070ff299-b388-4226-9eab-308c322da675 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:29.776376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-070ff299-b388-4226-9eab-308c322da675 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:29.783930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-070ff299-b388-4226-9eab-308c322da675 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:29.784401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-070ff299-b388-4226-9eab-308c322da675 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:29.785409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-070ff299-b388-4226-9eab-308c322da675 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:29.785837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-070ff299-b388-4226-9eab-308c322da675 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:29.916587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-070ff299-b388-4226-9eab-308c322da675 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:29.924558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-070ff299-b388-4226-9eab-308c322da675 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152606 Apr 07 13:18:29.925117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 781/1437] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:29 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:30.232950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-227c94ee-0360-46cb-b611-f23a29ee4138 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:30.233554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-227c94ee-0360-46cb-b611-f23a29ee4138 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:30.239485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-227c94ee-0360-46cb-b611-f23a29ee4138 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:30.239939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-227c94ee-0360-46cb-b611-f23a29ee4138 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:30.240747 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-227c94ee-0360-46cb-b611-f23a29ee4138 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:30.241187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-227c94ee-0360-46cb-b611-f23a29ee4138 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:30.302491 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-227c94ee-0360-46cb-b611-f23a29ee4138 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:30.310694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-227c94ee-0360-46cb-b611-f23a29ee4138 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:30.312163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-227c94ee-0360-46cb-b611-f23a29ee4138 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:30.313342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-227c94ee-0360-46cb-b611-f23a29ee4138 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084423 Apr 07 13:18:30.313893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 657/1438] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:30 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:30.758661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-86ee154e-6dd5-4209-9ae3-dd99f2195801 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:30.759316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-86ee154e-6dd5-4209-9ae3-dd99f2195801 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:30.766344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-86ee154e-6dd5-4209-9ae3-dd99f2195801 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:30.766789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-86ee154e-6dd5-4209-9ae3-dd99f2195801 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:30.767556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-86ee154e-6dd5-4209-9ae3-dd99f2195801 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:30.767991 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-86ee154e-6dd5-4209-9ae3-dd99f2195801 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:30.895984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-86ee154e-6dd5-4209-9ae3-dd99f2195801 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:30.903707 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-86ee154e-6dd5-4209-9ae3-dd99f2195801 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148859 Apr 07 13:18:30.904288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 782/1439] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:30 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:30.942123 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-867f3946-abd1-40c5-a139-bd9998476075 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:30.942736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-867f3946-abd1-40c5-a139-bd9998476075 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:30.949011 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-867f3946-abd1-40c5-a139-bd9998476075 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:30.949463 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-867f3946-abd1-40c5-a139-bd9998476075 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:30.950225 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-867f3946-abd1-40c5-a139-bd9998476075 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:30.950870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-867f3946-abd1-40c5-a139-bd9998476075 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:31.080393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-867f3946-abd1-40c5-a139-bd9998476075 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:31.088174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-867f3946-abd1-40c5-a139-bd9998476075 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149843 Apr 07 13:18:31.088753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 658/1440] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:30 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:31.331642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9351f1b0-9013-4afd-8f16-6a0addeabd4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:31.332414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9351f1b0-9013-4afd-8f16-6a0addeabd4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:31.338666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9351f1b0-9013-4afd-8f16-6a0addeabd4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:31.339215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9351f1b0-9013-4afd-8f16-6a0addeabd4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:31.340066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9351f1b0-9013-4afd-8f16-6a0addeabd4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:31.340597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9351f1b0-9013-4afd-8f16-6a0addeabd4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:31.399479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9351f1b0-9013-4afd-8f16-6a0addeabd4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:31.408383 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9351f1b0-9013-4afd-8f16-6a0addeabd4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:31.409887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9351f1b0-9013-4afd-8f16-6a0addeabd4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:31.411298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9351f1b0-9013-4afd-8f16-6a0addeabd4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083648 Apr 07 13:18:31.412125 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 783/1441] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:31 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:31.922266 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5eed6f35-1c31-41fd-aa81-bcd48b705965 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:31.922911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5eed6f35-1c31-41fd-aa81-bcd48b705965 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:31.928894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5eed6f35-1c31-41fd-aa81-bcd48b705965 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:31.929473 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5eed6f35-1c31-41fd-aa81-bcd48b705965 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:31.930236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5eed6f35-1c31-41fd-aa81-bcd48b705965 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:31.930668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5eed6f35-1c31-41fd-aa81-bcd48b705965 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:32.059612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5eed6f35-1c31-41fd-aa81-bcd48b705965 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:32.068419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5eed6f35-1c31-41fd-aa81-bcd48b705965 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150923 Apr 07 13:18:32.068974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 659/1442] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:31 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:32.105209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-03b6c327-2fac-4c06-babc-dab45bf50245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:32.105855 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-03b6c327-2fac-4c06-babc-dab45bf50245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:32.112227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03b6c327-2fac-4c06-babc-dab45bf50245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:32.112673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03b6c327-2fac-4c06-babc-dab45bf50245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:32.113423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03b6c327-2fac-4c06-babc-dab45bf50245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:32.113853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-03b6c327-2fac-4c06-babc-dab45bf50245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:32.256257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-03b6c327-2fac-4c06-babc-dab45bf50245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:32.264550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-03b6c327-2fac-4c06-babc-dab45bf50245 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.163192 Apr 07 13:18:32.265113 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 784/1443] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:32 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:32.429310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-97df8016-5e77-4592-b912-5c0223c69512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:32.429922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-97df8016-5e77-4592-b912-5c0223c69512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:32.436454 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-97df8016-5e77-4592-b912-5c0223c69512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:32.436897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-97df8016-5e77-4592-b912-5c0223c69512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:32.437774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-97df8016-5e77-4592-b912-5c0223c69512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:32.438266 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-97df8016-5e77-4592-b912-5c0223c69512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:32.500475 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-97df8016-5e77-4592-b912-5c0223c69512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:32.508546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-97df8016-5e77-4592-b912-5c0223c69512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:32.510032 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-97df8016-5e77-4592-b912-5c0223c69512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:32.511174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-97df8016-5e77-4592-b912-5c0223c69512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085746 Apr 07 13:18:32.511724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 660/1444] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:32 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:33.085819 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8380520f-3924-470d-a95d-099b43149d24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:33.086352 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8380520f-3924-470d-a95d-099b43149d24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:33.093175 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8380520f-3924-470d-a95d-099b43149d24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:33.093619 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8380520f-3924-470d-a95d-099b43149d24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:33.094370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8380520f-3924-470d-a95d-099b43149d24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:33.094801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8380520f-3924-470d-a95d-099b43149d24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:33.223197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8380520f-3924-470d-a95d-099b43149d24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:33.230853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8380520f-3924-470d-a95d-099b43149d24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148953 Apr 07 13:18:33.231402 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 785/1445] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:33 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:33.282046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bbab65e3-a424-42f6-8533-da742402faf7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:33.282665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bbab65e3-a424-42f6-8533-da742402faf7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:33.289131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bbab65e3-a424-42f6-8533-da742402faf7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:33.289582 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bbab65e3-a424-42f6-8533-da742402faf7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:33.290349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bbab65e3-a424-42f6-8533-da742402faf7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:33.290790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bbab65e3-a424-42f6-8533-da742402faf7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:33.420621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bbab65e3-a424-42f6-8533-da742402faf7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:33.428322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bbab65e3-a424-42f6-8533-da742402faf7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150800 Apr 07 13:18:33.428889 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 661/1446] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:33 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:33.528627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ff4a2d65-3555-443a-ac6f-fad855941ca9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:33.529802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ff4a2d65-3555-443a-ac6f-fad855941ca9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:33.535924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff4a2d65-3555-443a-ac6f-fad855941ca9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:33.536407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff4a2d65-3555-443a-ac6f-fad855941ca9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:33.537163 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff4a2d65-3555-443a-ac6f-fad855941ca9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:33.537597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff4a2d65-3555-443a-ac6f-fad855941ca9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:33.595852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ff4a2d65-3555-443a-ac6f-fad855941ca9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:33.604006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ff4a2d65-3555-443a-ac6f-fad855941ca9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:33.605524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ff4a2d65-3555-443a-ac6f-fad855941ca9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:33.606657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ff4a2d65-3555-443a-ac6f-fad855941ca9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081919 Apr 07 13:18:33.607859 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 786/1447] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:33 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:34.249208 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ac6fdf16-e417-4c50-8ee6-ebf2ff1d1d16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:34.249824 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ac6fdf16-e417-4c50-8ee6-ebf2ff1d1d16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:34.255869 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac6fdf16-e417-4c50-8ee6-ebf2ff1d1d16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:34.256358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac6fdf16-e417-4c50-8ee6-ebf2ff1d1d16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:34.257127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac6fdf16-e417-4c50-8ee6-ebf2ff1d1d16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:34.257566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac6fdf16-e417-4c50-8ee6-ebf2ff1d1d16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:34.386033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ac6fdf16-e417-4c50-8ee6-ebf2ff1d1d16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:34.394906 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ac6fdf16-e417-4c50-8ee6-ebf2ff1d1d16 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150553 Apr 07 13:18:34.395462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 662/1448] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:34 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:34.445653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8d5ff96c-ea5f-4fb2-b3b8-5ed7b5e9b4a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:34.446261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8d5ff96c-ea5f-4fb2-b3b8-5ed7b5e9b4a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:34.453996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d5ff96c-ea5f-4fb2-b3b8-5ed7b5e9b4a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:34.454441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d5ff96c-ea5f-4fb2-b3b8-5ed7b5e9b4a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:34.455192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d5ff96c-ea5f-4fb2-b3b8-5ed7b5e9b4a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:34.455643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d5ff96c-ea5f-4fb2-b3b8-5ed7b5e9b4a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:34.590561 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8d5ff96c-ea5f-4fb2-b3b8-5ed7b5e9b4a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:34.598679 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8d5ff96c-ea5f-4fb2-b3b8-5ed7b5e9b4a1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156898 Apr 07 13:18:34.599251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 787/1449] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:34 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:34.626306 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ad8ee3a6-3054-4c03-a180-4ebab9d8d3df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:34.626928 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ad8ee3a6-3054-4c03-a180-4ebab9d8d3df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:34.632821 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad8ee3a6-3054-4c03-a180-4ebab9d8d3df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:34.633282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad8ee3a6-3054-4c03-a180-4ebab9d8d3df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:34.634046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad8ee3a6-3054-4c03-a180-4ebab9d8d3df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:34.634490 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad8ee3a6-3054-4c03-a180-4ebab9d8d3df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:34.696738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ad8ee3a6-3054-4c03-a180-4ebab9d8d3df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:34.705469 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ad8ee3a6-3054-4c03-a180-4ebab9d8d3df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:34.706945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ad8ee3a6-3054-4c03-a180-4ebab9d8d3df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:34.708094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ad8ee3a6-3054-4c03-a180-4ebab9d8d3df tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086180 Apr 07 13:18:34.708677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 663/1450] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:34 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:35.614802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dad1231c-437a-4d92-bd7c-8cdac6a57838 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:35.615442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dad1231c-437a-4d92-bd7c-8cdac6a57838 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:35.621744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dad1231c-437a-4d92-bd7c-8cdac6a57838 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:35.622197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dad1231c-437a-4d92-bd7c-8cdac6a57838 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:35.622974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dad1231c-437a-4d92-bd7c-8cdac6a57838 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:35.623411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dad1231c-437a-4d92-bd7c-8cdac6a57838 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:35.624586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a21f31b6-8850-423c-a999-ccb693767919 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:35.625204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a21f31b6-8850-423c-a999-ccb693767919 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:35.630920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a21f31b6-8850-423c-a999-ccb693767919 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:35.631367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a21f31b6-8850-423c-a999-ccb693767919 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:35.632120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a21f31b6-8850-423c-a999-ccb693767919 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:35.632581 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a21f31b6-8850-423c-a999-ccb693767919 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:35.757987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dad1231c-437a-4d92-bd7c-8cdac6a57838 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:35.766565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dad1231c-437a-4d92-bd7c-8cdac6a57838 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155565 Apr 07 13:18:35.767334 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 664/1451] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:35 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:35.770435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a21f31b6-8850-423c-a999-ccb693767919 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:35.772640 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-55ba9d77-544d-42eb-8a44-241f8ab13770 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:35.773395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-55ba9d77-544d-42eb-8a44-241f8ab13770 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:35.778206 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a21f31b6-8850-423c-a999-ccb693767919 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.370233 Apr 07 13:18:35.778865 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 788/1452] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:35 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:35.779748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-55ba9d77-544d-42eb-8a44-241f8ab13770 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:35.780238 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-55ba9d77-544d-42eb-8a44-241f8ab13770 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:35.781022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-55ba9d77-544d-42eb-8a44-241f8ab13770 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:35.781464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-55ba9d77-544d-42eb-8a44-241f8ab13770 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:35.841302 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-55ba9d77-544d-42eb-8a44-241f8ab13770 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:35.850012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-55ba9d77-544d-42eb-8a44-241f8ab13770 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:35.851514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-55ba9d77-544d-42eb-8a44-241f8ab13770 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:35.852702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-55ba9d77-544d-42eb-8a44-241f8ab13770 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083743 Apr 07 13:18:35.853261 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 665/1453] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:35 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:36.783413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-79dbc661-deba-458a-876c-a7138ad7fe4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:36.784028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-79dbc661-deba-458a-876c-a7138ad7fe4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:36.790673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79dbc661-deba-458a-876c-a7138ad7fe4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:36.791128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79dbc661-deba-458a-876c-a7138ad7fe4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:36.791894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79dbc661-deba-458a-876c-a7138ad7fe4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:36.792359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79dbc661-deba-458a-876c-a7138ad7fe4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:36.795233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5ed79659-b98f-4f35-ba12-9c86b92b251d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:36.796042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5ed79659-b98f-4f35-ba12-9c86b92b251d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:36.802150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ed79659-b98f-4f35-ba12-9c86b92b251d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:36.802599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ed79659-b98f-4f35-ba12-9c86b92b251d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:36.803367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ed79659-b98f-4f35-ba12-9c86b92b251d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:36.803808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ed79659-b98f-4f35-ba12-9c86b92b251d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:36.929251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-79dbc661-deba-458a-876c-a7138ad7fe4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:36.937667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-79dbc661-deba-458a-876c-a7138ad7fe4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158256 Apr 07 13:18:36.938231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 789/1454] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:36 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:36.942633 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5ed79659-b98f-4f35-ba12-9c86b92b251d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:36.942805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9440dec3-4044-4a19-875b-eabfaf2f4625 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:36.943415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9440dec3-4044-4a19-875b-eabfaf2f4625 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:36.949637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9440dec3-4044-4a19-875b-eabfaf2f4625 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:36.950093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9440dec3-4044-4a19-875b-eabfaf2f4625 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:36.950680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5ed79659-b98f-4f35-ba12-9c86b92b251d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.159330 Apr 07 13:18:36.950900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9440dec3-4044-4a19-875b-eabfaf2f4625 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:36.951409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9440dec3-4044-4a19-875b-eabfaf2f4625 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:36.951525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 666/1455] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:36 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:37.009010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9440dec3-4044-4a19-875b-eabfaf2f4625 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:37.017135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9440dec3-4044-4a19-875b-eabfaf2f4625 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:37.018633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9440dec3-4044-4a19-875b-eabfaf2f4625 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:37.019771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9440dec3-4044-4a19-875b-eabfaf2f4625 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.080630 Apr 07 13:18:37.020360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 790/1456] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:36 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:37.580988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d799a2a4-bc0e-4cda-b932-5114a7788b9d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:37.581496 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d799a2a4-bc0e-4cda-b932-5114a7788b9d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:37.588108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d799a2a4-bc0e-4cda-b932-5114a7788b9d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:37.588683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d799a2a4-bc0e-4cda-b932-5114a7788b9d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:37.589386 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d799a2a4-bc0e-4cda-b932-5114a7788b9d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:37.589826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d799a2a4-bc0e-4cda-b932-5114a7788b9d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:37.604277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-d799a2a4-bc0e-4cda-b932-5114a7788b9d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] HTTP exception thrown: Instance b3439aee-0673-4237-9ac0-67d6959acdad could not be found. Apr 07 13:18:37.604873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d799a2a4-bc0e-4cda-b932-5114a7788b9d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Returning 404 to user: Instance b3439aee-0673-4237-9ac0-67d6959acdad could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:18:37.605702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d799a2a4-bc0e-4cda-b932-5114a7788b9d tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 404 len: 111 microversion: 2.1 time: 0.028510 Apr 07 13:18:37.606372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 667/1457] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:18:37 2022] DELETE /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:18:37.614638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-83f32c1b-53f0-4233-9838-d07905b02c98 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:37.615257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-83f32c1b-53f0-4233-9838-d07905b02c98 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: b3439aee-0673-4237-9ac0-67d6959acdad] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:37.621037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-83f32c1b-53f0-4233-9838-d07905b02c98 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:37.621495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-83f32c1b-53f0-4233-9838-d07905b02c98 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:37.622255 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-83f32c1b-53f0-4233-9838-d07905b02c98 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:37.622741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-83f32c1b-53f0-4233-9838-d07905b02c98 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:37.636219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-83f32c1b-53f0-4233-9838-d07905b02c98 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] HTTP exception thrown: Instance b3439aee-0673-4237-9ac0-67d6959acdad could not be found. Apr 07 13:18:37.636812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-83f32c1b-53f0-4233-9838-d07905b02c98 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Returning 404 to user: Instance b3439aee-0673-4237-9ac0-67d6959acdad could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:18:37.637695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-83f32c1b-53f0-4233-9838-d07905b02c98 tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad" status: 404 len: 111 microversion: 2.1 time: 0.026805 Apr 07 13:18:37.638236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 791/1458] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:37 2022] GET /compute/v2.1/servers/b3439aee-0673-4237-9ac0-67d6959acdad => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:18:37.954758 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a5ba49f6-306b-46a8-b099-9808b50a1ada tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:37.955379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a5ba49f6-306b-46a8-b099-9808b50a1ada tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:37.963092 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a5ba49f6-306b-46a8-b099-9808b50a1ada tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:37.963092 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a5ba49f6-306b-46a8-b099-9808b50a1ada tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:37.963092 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a5ba49f6-306b-46a8-b099-9808b50a1ada tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:37.963397 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a5ba49f6-306b-46a8-b099-9808b50a1ada tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:37.968924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9366e74b-e719-48e4-8e22-8b97ef590af1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:37.969543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9366e74b-e719-48e4-8e22-8b97ef590af1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:37.975720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9366e74b-e719-48e4-8e22-8b97ef590af1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:37.976189 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9366e74b-e719-48e4-8e22-8b97ef590af1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:37.976949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9366e74b-e719-48e4-8e22-8b97ef590af1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:37.977740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9366e74b-e719-48e4-8e22-8b97ef590af1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:38.098446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a5ba49f6-306b-46a8-b099-9808b50a1ada tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:38.106471 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a5ba49f6-306b-46a8-b099-9808b50a1ada tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155377 Apr 07 13:18:38.106868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 668/1459] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:37 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:38.109984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9366e74b-e719-48e4-8e22-8b97ef590af1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:38.111837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d73ebe93-b591-44d1-86c4-842aeb44eecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:38.112506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d73ebe93-b591-44d1-86c4-842aeb44eecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:38.118293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9366e74b-e719-48e4-8e22-8b97ef590af1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153718 Apr 07 13:18:38.118477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d73ebe93-b591-44d1-86c4-842aeb44eecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:38.118933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d73ebe93-b591-44d1-86c4-842aeb44eecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:38.119036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 792/1460] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:37 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:38.119851 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d73ebe93-b591-44d1-86c4-842aeb44eecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:38.120327 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d73ebe93-b591-44d1-86c4-842aeb44eecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:38.186384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d73ebe93-b591-44d1-86c4-842aeb44eecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:38.195760 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d73ebe93-b591-44d1-86c4-842aeb44eecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:38.197300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d73ebe93-b591-44d1-86c4-842aeb44eecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:38.198449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d73ebe93-b591-44d1-86c4-842aeb44eecf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.090276 Apr 07 13:18:38.199004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 669/1461] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:38 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:39.124580 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fe1ccd60-31d0-4881-833e-15d42f34ad4f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:39.125189 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fe1ccd60-31d0-4881-833e-15d42f34ad4f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:39.131447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe1ccd60-31d0-4881-833e-15d42f34ad4f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:39.131896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe1ccd60-31d0-4881-833e-15d42f34ad4f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:39.132681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe1ccd60-31d0-4881-833e-15d42f34ad4f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:39.133115 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe1ccd60-31d0-4881-833e-15d42f34ad4f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:39.138051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ac16bc95-7bfb-48b3-b59a-16fc60dd6ed1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:39.139589 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ac16bc95-7bfb-48b3-b59a-16fc60dd6ed1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:39.148948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac16bc95-7bfb-48b3-b59a-16fc60dd6ed1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:39.149520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac16bc95-7bfb-48b3-b59a-16fc60dd6ed1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:39.150424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac16bc95-7bfb-48b3-b59a-16fc60dd6ed1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:39.151101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac16bc95-7bfb-48b3-b59a-16fc60dd6ed1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:39.270078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fe1ccd60-31d0-4881-833e-15d42f34ad4f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:39.277752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fe1ccd60-31d0-4881-833e-15d42f34ad4f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158391 Apr 07 13:18:39.278312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 793/1462] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:39 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:39.282807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-60cdfccf-aebe-402d-b492-4052a282c8e4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:39.283405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-60cdfccf-aebe-402d-b492-4052a282c8e4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:39.289262 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60cdfccf-aebe-402d-b492-4052a282c8e4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:39.289710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60cdfccf-aebe-402d-b492-4052a282c8e4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:39.290167 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ac16bc95-7bfb-48b3-b59a-16fc60dd6ed1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:39.290469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60cdfccf-aebe-402d-b492-4052a282c8e4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:39.290899 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60cdfccf-aebe-402d-b492-4052a282c8e4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:39.299279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ac16bc95-7bfb-48b3-b59a-16fc60dd6ed1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.167256 Apr 07 13:18:39.299937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 670/1463] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:39 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:39.348610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-60cdfccf-aebe-402d-b492-4052a282c8e4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:39.356646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-60cdfccf-aebe-402d-b492-4052a282c8e4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:39.358817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-60cdfccf-aebe-402d-b492-4052a282c8e4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:39.359938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-60cdfccf-aebe-402d-b492-4052a282c8e4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.080736 Apr 07 13:18:39.360510 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 794/1464] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:39 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:40.296393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dab9a204-6fb5-4540-bec3-6d1140e31429 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:40.297055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dab9a204-6fb5-4540-bec3-6d1140e31429 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:40.303332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dab9a204-6fb5-4540-bec3-6d1140e31429 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:40.303774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dab9a204-6fb5-4540-bec3-6d1140e31429 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:40.304564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dab9a204-6fb5-4540-bec3-6d1140e31429 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:40.305003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dab9a204-6fb5-4540-bec3-6d1140e31429 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:40.316901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-98715443-6846-4f94-89c7-5b57978a40a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:40.317514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-98715443-6846-4f94-89c7-5b57978a40a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:40.323667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98715443-6846-4f94-89c7-5b57978a40a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:40.324116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98715443-6846-4f94-89c7-5b57978a40a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:40.324900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98715443-6846-4f94-89c7-5b57978a40a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:40.325337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98715443-6846-4f94-89c7-5b57978a40a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:40.435936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dab9a204-6fb5-4540-bec3-6d1140e31429 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:40.443817 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dab9a204-6fb5-4540-bec3-6d1140e31429 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152301 Apr 07 13:18:40.444414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 671/1465] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:40 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:40.448872 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8c5a95c2-4597-486e-8489-4b422b3e5572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:40.449478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8c5a95c2-4597-486e-8489-4b422b3e5572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:40.455168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c5a95c2-4597-486e-8489-4b422b3e5572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:40.455632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c5a95c2-4597-486e-8489-4b422b3e5572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:40.456288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-98715443-6846-4f94-89c7-5b57978a40a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:40.456429 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c5a95c2-4597-486e-8489-4b422b3e5572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:40.456865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c5a95c2-4597-486e-8489-4b422b3e5572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:40.464180 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-98715443-6846-4f94-89c7-5b57978a40a6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151054 Apr 07 13:18:40.464832 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 795/1466] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:40 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:40.514777 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8c5a95c2-4597-486e-8489-4b422b3e5572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:40.522913 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8c5a95c2-4597-486e-8489-4b422b3e5572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:40.524443 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8c5a95c2-4597-486e-8489-4b422b3e5572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:40.525595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8c5a95c2-4597-486e-8489-4b422b3e5572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.080263 Apr 07 13:18:40.526158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 672/1467] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:40 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:41.460746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a0b5d19c-d7a1-4b25-9ba6-112db76803ab tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:41.461351 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a0b5d19c-d7a1-4b25-9ba6-112db76803ab tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:41.467725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0b5d19c-d7a1-4b25-9ba6-112db76803ab tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:41.468200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0b5d19c-d7a1-4b25-9ba6-112db76803ab tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:41.468968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0b5d19c-d7a1-4b25-9ba6-112db76803ab tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:41.469404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0b5d19c-d7a1-4b25-9ba6-112db76803ab tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:41.481390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a4a82c95-85b9-494b-a0c5-13271ac4cd12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:41.482637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a4a82c95-85b9-494b-a0c5-13271ac4cd12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:41.490924 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a4a82c95-85b9-494b-a0c5-13271ac4cd12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:41.491408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a4a82c95-85b9-494b-a0c5-13271ac4cd12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:41.492344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a4a82c95-85b9-494b-a0c5-13271ac4cd12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:41.493081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a4a82c95-85b9-494b-a0c5-13271ac4cd12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:41.606453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a0b5d19c-d7a1-4b25-9ba6-112db76803ab tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:41.615158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a0b5d19c-d7a1-4b25-9ba6-112db76803ab tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158145 Apr 07 13:18:41.615729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 796/1468] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:41 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:41.620697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bb0b0740-5c28-439b-96e5-8df80c43dd79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:41.621331 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bb0b0740-5c28-439b-96e5-8df80c43dd79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:41.627711 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb0b0740-5c28-439b-96e5-8df80c43dd79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:41.628187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb0b0740-5c28-439b-96e5-8df80c43dd79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:41.629080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb0b0740-5c28-439b-96e5-8df80c43dd79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:41.629512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb0b0740-5c28-439b-96e5-8df80c43dd79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:41.631215 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a4a82c95-85b9-494b-a0c5-13271ac4cd12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:41.639143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a4a82c95-85b9-494b-a0c5-13271ac4cd12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.161491 Apr 07 13:18:41.639854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 673/1469] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:41 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:41.689393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bb0b0740-5c28-439b-96e5-8df80c43dd79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:41.697444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bb0b0740-5c28-439b-96e5-8df80c43dd79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:41.698931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bb0b0740-5c28-439b-96e5-8df80c43dd79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:41.700059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bb0b0740-5c28-439b-96e5-8df80c43dd79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083040 Apr 07 13:18:41.700658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 797/1470] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:41 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:42.633282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3833c329-5399-4f41-9bd6-bb94ba73ba3d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:42.633899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3833c329-5399-4f41-9bd6-bb94ba73ba3d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:42.641194 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3833c329-5399-4f41-9bd6-bb94ba73ba3d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:42.641647 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3833c329-5399-4f41-9bd6-bb94ba73ba3d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:42.642417 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3833c329-5399-4f41-9bd6-bb94ba73ba3d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:42.642858 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3833c329-5399-4f41-9bd6-bb94ba73ba3d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:42.655418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-63b9dd69-2a4b-4056-b886-b7834718d962 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:42.656064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-63b9dd69-2a4b-4056-b886-b7834718d962 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:42.662485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63b9dd69-2a4b-4056-b886-b7834718d962 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:42.662948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63b9dd69-2a4b-4056-b886-b7834718d962 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:42.663743 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63b9dd69-2a4b-4056-b886-b7834718d962 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:42.664204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63b9dd69-2a4b-4056-b886-b7834718d962 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:42.775343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3833c329-5399-4f41-9bd6-bb94ba73ba3d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:42.784328 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3833c329-5399-4f41-9bd6-bb94ba73ba3d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154840 Apr 07 13:18:42.785360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 674/1471] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:42 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:42.789638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-643f4047-ea2c-46bf-a5db-a2e45ab1fa4f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:42.790179 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-643f4047-ea2c-46bf-a5db-a2e45ab1fa4f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:42.796491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-63b9dd69-2a4b-4056-b886-b7834718d962 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:42.797261 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-643f4047-ea2c-46bf-a5db-a2e45ab1fa4f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:42.797614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-643f4047-ea2c-46bf-a5db-a2e45ab1fa4f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:42.798398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-643f4047-ea2c-46bf-a5db-a2e45ab1fa4f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:42.798832 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-643f4047-ea2c-46bf-a5db-a2e45ab1fa4f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:42.804733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-63b9dd69-2a4b-4056-b886-b7834718d962 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153157 Apr 07 13:18:42.805322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 798/1472] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:42 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:42.862129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-643f4047-ea2c-46bf-a5db-a2e45ab1fa4f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:42.870184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-643f4047-ea2c-46bf-a5db-a2e45ab1fa4f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:42.871665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-643f4047-ea2c-46bf-a5db-a2e45ab1fa4f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:42.873228 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-643f4047-ea2c-46bf-a5db-a2e45ab1fa4f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086795 Apr 07 13:18:42.873815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 675/1473] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:42 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:43.801231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fb1d404d-a191-4438-9e14-aadd5aa9cdc1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:43.801840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fb1d404d-a191-4438-9e14-aadd5aa9cdc1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:43.808419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb1d404d-a191-4438-9e14-aadd5aa9cdc1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:43.808872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb1d404d-a191-4438-9e14-aadd5aa9cdc1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:43.809629 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb1d404d-a191-4438-9e14-aadd5aa9cdc1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:43.810740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb1d404d-a191-4438-9e14-aadd5aa9cdc1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:43.821494 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c68d9ca8-8730-4c16-8d36-24e981328e20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:43.822119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c68d9ca8-8730-4c16-8d36-24e981328e20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:43.828695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c68d9ca8-8730-4c16-8d36-24e981328e20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:43.829147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c68d9ca8-8730-4c16-8d36-24e981328e20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:43.829920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c68d9ca8-8730-4c16-8d36-24e981328e20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:43.830361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c68d9ca8-8730-4c16-8d36-24e981328e20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:43.944361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fb1d404d-a191-4438-9e14-aadd5aa9cdc1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:43.953005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fb1d404d-a191-4438-9e14-aadd5aa9cdc1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155558 Apr 07 13:18:43.953584 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 799/1474] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:43 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:43.958280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1049f757-d446-483f-9e3d-c6c429397d9d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:43.958894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1049f757-d446-483f-9e3d-c6c429397d9d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:43.963546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c68d9ca8-8730-4c16-8d36-24e981328e20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:43.970537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1049f757-d446-483f-9e3d-c6c429397d9d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:43.971079 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1049f757-d446-483f-9e3d-c6c429397d9d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:43.971914 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1049f757-d446-483f-9e3d-c6c429397d9d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:43.972033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c68d9ca8-8730-4c16-8d36-24e981328e20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154249 Apr 07 13:18:43.972486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1049f757-d446-483f-9e3d-c6c429397d9d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:43.972652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 676/1475] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:43 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:44.030042 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1049f757-d446-483f-9e3d-c6c429397d9d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:44.038458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1049f757-d446-483f-9e3d-c6c429397d9d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:44.039935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1049f757-d446-483f-9e3d-c6c429397d9d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:44.041083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1049f757-d446-483f-9e3d-c6c429397d9d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086592 Apr 07 13:18:44.041634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 800/1476] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:43 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:44.970399 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0d5164d9-beb0-4ede-8230-630cfcb1bd08 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:44.971012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0d5164d9-beb0-4ede-8230-630cfcb1bd08 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:44.977562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d5164d9-beb0-4ede-8230-630cfcb1bd08 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:44.978007 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d5164d9-beb0-4ede-8230-630cfcb1bd08 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:44.978763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d5164d9-beb0-4ede-8230-630cfcb1bd08 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:44.979196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d5164d9-beb0-4ede-8230-630cfcb1bd08 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:44.989038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c6933aa0-6884-46e0-95f7-9a9bdddfe7d0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:44.989654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c6933aa0-6884-46e0-95f7-9a9bdddfe7d0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:44.995890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c6933aa0-6884-46e0-95f7-9a9bdddfe7d0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:44.996384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c6933aa0-6884-46e0-95f7-9a9bdddfe7d0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:44.997148 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c6933aa0-6884-46e0-95f7-9a9bdddfe7d0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:44.997710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c6933aa0-6884-46e0-95f7-9a9bdddfe7d0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:45.112473 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0d5164d9-beb0-4ede-8230-630cfcb1bd08 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:45.120061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0d5164d9-beb0-4ede-8230-630cfcb1bd08 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154034 Apr 07 13:18:45.120650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 677/1477] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:44 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:45.126368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9e2e6600-6b0b-45c9-94b7-d066f03b4656 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:45.126935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9e2e6600-6b0b-45c9-94b7-d066f03b4656 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:45.129313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c6933aa0-6884-46e0-95f7-9a9bdddfe7d0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:45.132647 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9e2e6600-6b0b-45c9-94b7-d066f03b4656 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:45.133167 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9e2e6600-6b0b-45c9-94b7-d066f03b4656 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:45.134002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9e2e6600-6b0b-45c9-94b7-d066f03b4656 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:45.134502 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9e2e6600-6b0b-45c9-94b7-d066f03b4656 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:45.137229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c6933aa0-6884-46e0-95f7-9a9bdddfe7d0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151823 Apr 07 13:18:45.137921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 801/1478] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:44 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:45.198568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9e2e6600-6b0b-45c9-94b7-d066f03b4656 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:45.207570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9e2e6600-6b0b-45c9-94b7-d066f03b4656 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:45.209080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9e2e6600-6b0b-45c9-94b7-d066f03b4656 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:45.210214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9e2e6600-6b0b-45c9-94b7-d066f03b4656 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088664 Apr 07 13:18:45.210764 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 678/1479] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:45 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:46.137637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-561b70ee-7ca1-4639-b371-a35c9458fa54 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:46.138524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-561b70ee-7ca1-4639-b371-a35c9458fa54 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:46.145177 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-561b70ee-7ca1-4639-b371-a35c9458fa54 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:46.145624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-561b70ee-7ca1-4639-b371-a35c9458fa54 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:46.146386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-561b70ee-7ca1-4639-b371-a35c9458fa54 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:46.146819 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-561b70ee-7ca1-4639-b371-a35c9458fa54 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:46.153949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-196a8bf7-56fa-4b1f-b7b2-4108e31cf4ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:46.154886 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-196a8bf7-56fa-4b1f-b7b2-4108e31cf4ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:46.161465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-196a8bf7-56fa-4b1f-b7b2-4108e31cf4ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:46.161925 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-196a8bf7-56fa-4b1f-b7b2-4108e31cf4ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:46.162703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-196a8bf7-56fa-4b1f-b7b2-4108e31cf4ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:46.163148 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-196a8bf7-56fa-4b1f-b7b2-4108e31cf4ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:46.282479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-561b70ee-7ca1-4639-b371-a35c9458fa54 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:46.290660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-561b70ee-7ca1-4639-b371-a35c9458fa54 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156875 Apr 07 13:18:46.291234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 802/1480] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:46 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:46.296328 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-196a8bf7-56fa-4b1f-b7b2-4108e31cf4ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:46.296526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f4c5a76c-989a-4ca7-acdf-02fe518a65f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:46.297086 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f4c5a76c-989a-4ca7-acdf-02fe518a65f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:46.303929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f4c5a76c-989a-4ca7-acdf-02fe518a65f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:46.304405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f4c5a76c-989a-4ca7-acdf-02fe518a65f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:46.305183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f4c5a76c-989a-4ca7-acdf-02fe518a65f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:46.305598 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-196a8bf7-56fa-4b1f-b7b2-4108e31cf4ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.155414 Apr 07 13:18:46.305714 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f4c5a76c-989a-4ca7-acdf-02fe518a65f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:46.306200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 679/1481] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:46 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:46.363862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f4c5a76c-989a-4ca7-acdf-02fe518a65f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:46.372135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f4c5a76c-989a-4ca7-acdf-02fe518a65f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:46.373976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f4c5a76c-989a-4ca7-acdf-02fe518a65f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:46.375156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f4c5a76c-989a-4ca7-acdf-02fe518a65f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082979 Apr 07 13:18:46.375712 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 803/1482] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:46 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:47.308360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-838d62c7-17e8-40a8-8eb6-4ede97897aad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:47.309021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-838d62c7-17e8-40a8-8eb6-4ede97897aad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:47.315953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-838d62c7-17e8-40a8-8eb6-4ede97897aad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:47.316448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-838d62c7-17e8-40a8-8eb6-4ede97897aad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:47.317228 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-838d62c7-17e8-40a8-8eb6-4ede97897aad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:47.317668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-838d62c7-17e8-40a8-8eb6-4ede97897aad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:47.321617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ba1039ec-2087-4e52-8b03-a8161a8e4869 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:47.322229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ba1039ec-2087-4e52-8b03-a8161a8e4869 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:47.329144 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ba1039ec-2087-4e52-8b03-a8161a8e4869 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:47.329591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ba1039ec-2087-4e52-8b03-a8161a8e4869 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:47.330478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ba1039ec-2087-4e52-8b03-a8161a8e4869 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:47.330942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ba1039ec-2087-4e52-8b03-a8161a8e4869 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:47.449320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-838d62c7-17e8-40a8-8eb6-4ede97897aad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:47.457597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-838d62c7-17e8-40a8-8eb6-4ede97897aad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153088 Apr 07 13:18:47.458168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 680/1483] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:47 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:47.461842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ba1039ec-2087-4e52-8b03-a8161a8e4869 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:47.463818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0c23aae1-c9e8-43d5-8fdc-446f7911b16a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:47.464416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0c23aae1-c9e8-43d5-8fdc-446f7911b16a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:47.470083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ba1039ec-2087-4e52-8b03-a8161a8e4869 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152215 Apr 07 13:18:47.470466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0c23aae1-c9e8-43d5-8fdc-446f7911b16a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:47.470733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 804/1484] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:47 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:47.470985 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0c23aae1-c9e8-43d5-8fdc-446f7911b16a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:47.471839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0c23aae1-c9e8-43d5-8fdc-446f7911b16a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:47.472309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0c23aae1-c9e8-43d5-8fdc-446f7911b16a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:47.533105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0c23aae1-c9e8-43d5-8fdc-446f7911b16a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:47.541527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0c23aae1-c9e8-43d5-8fdc-446f7911b16a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:47.543031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0c23aae1-c9e8-43d5-8fdc-446f7911b16a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:47.544748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0c23aae1-c9e8-43d5-8fdc-446f7911b16a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085094 Apr 07 13:18:47.545348 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 681/1485] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:47 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:48.474851 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6bbbda8f-de13-40ea-a6f0-6f9bd3a1a326 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:48.475553 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6bbbda8f-de13-40ea-a6f0-6f9bd3a1a326 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:48.481883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bbbda8f-de13-40ea-a6f0-6f9bd3a1a326 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:48.482560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bbbda8f-de13-40ea-a6f0-6f9bd3a1a326 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:48.483336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bbbda8f-de13-40ea-a6f0-6f9bd3a1a326 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:48.483780 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bbbda8f-de13-40ea-a6f0-6f9bd3a1a326 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:48.486945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-087f27d6-4132-4611-bbac-2379579bd466 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:48.487561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-087f27d6-4132-4611-bbac-2379579bd466 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:48.493875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-087f27d6-4132-4611-bbac-2379579bd466 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:48.494319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-087f27d6-4132-4611-bbac-2379579bd466 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:48.495082 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-087f27d6-4132-4611-bbac-2379579bd466 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:48.495513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-087f27d6-4132-4611-bbac-2379579bd466 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:48.620106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6bbbda8f-de13-40ea-a6f0-6f9bd3a1a326 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:48.629013 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6bbbda8f-de13-40ea-a6f0-6f9bd3a1a326 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157993 Apr 07 13:18:48.629252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-087f27d6-4132-4611-bbac-2379579bd466 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:48.629588 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 805/1486] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:48 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:48.634146 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1a85ff5c-96de-4709-9e2a-003df182d5bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:48.634793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1a85ff5c-96de-4709-9e2a-003df182d5bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:48.637413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-087f27d6-4132-4611-bbac-2379579bd466 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154361 Apr 07 13:18:48.638822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 682/1487] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:48 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:48.641390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a85ff5c-96de-4709-9e2a-003df182d5bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:48.641852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a85ff5c-96de-4709-9e2a-003df182d5bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:48.642630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a85ff5c-96de-4709-9e2a-003df182d5bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:48.643071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a85ff5c-96de-4709-9e2a-003df182d5bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:48.702460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1a85ff5c-96de-4709-9e2a-003df182d5bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:48.710580 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1a85ff5c-96de-4709-9e2a-003df182d5bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:48.712083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1a85ff5c-96de-4709-9e2a-003df182d5bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:48.713257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1a85ff5c-96de-4709-9e2a-003df182d5bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082759 Apr 07 13:18:48.713814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 806/1488] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:48 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:49.646441 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-aece1daf-b07b-4ab3-8f96-713a72d27bd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:49.647059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-aece1daf-b07b-4ab3-8f96-713a72d27bd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:49.655186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-643db70e-686a-495f-bb9b-2c8cb4eff6e6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:49.655649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aece1daf-b07b-4ab3-8f96-713a72d27bd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:49.655798 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-643db70e-686a-495f-bb9b-2c8cb4eff6e6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:49.655926 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aece1daf-b07b-4ab3-8f96-713a72d27bd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:49.656637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aece1daf-b07b-4ab3-8f96-713a72d27bd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:49.657107 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aece1daf-b07b-4ab3-8f96-713a72d27bd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:49.662282 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-643db70e-686a-495f-bb9b-2c8cb4eff6e6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:49.662728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-643db70e-686a-495f-bb9b-2c8cb4eff6e6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:49.663488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-643db70e-686a-495f-bb9b-2c8cb4eff6e6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:49.663923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-643db70e-686a-495f-bb9b-2c8cb4eff6e6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:49.789365 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-aece1daf-b07b-4ab3-8f96-713a72d27bd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:49.792499 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-643db70e-686a-495f-bb9b-2c8cb4eff6e6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:49.797783 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-aece1daf-b07b-4ab3-8f96-713a72d27bd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155198 Apr 07 13:18:49.798358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 683/1489] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:49 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:49.800939 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-643db70e-686a-495f-bb9b-2c8cb4eff6e6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150194 Apr 07 13:18:49.801489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 807/1490] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:49 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:49.806838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a6725887-2346-4ff2-ae9d-c136b4c0e0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:49.807458 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a6725887-2346-4ff2-ae9d-c136b4c0e0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:49.813515 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a6725887-2346-4ff2-ae9d-c136b4c0e0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:49.813972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a6725887-2346-4ff2-ae9d-c136b4c0e0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:49.814747 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a6725887-2346-4ff2-ae9d-c136b4c0e0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:49.815189 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a6725887-2346-4ff2-ae9d-c136b4c0e0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:49.880813 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a6725887-2346-4ff2-ae9d-c136b4c0e0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:49.890037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a6725887-2346-4ff2-ae9d-c136b4c0e0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:49.891526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a6725887-2346-4ff2-ae9d-c136b4c0e0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:49.892710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a6725887-2346-4ff2-ae9d-c136b4c0e0c2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.089565 Apr 07 13:18:49.893255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 684/1491] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:49 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:50.815902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fae7e337-c7ee-45c1-bb8e-e14390492d67 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:50.816902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fae7e337-c7ee-45c1-bb8e-e14390492d67 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:50.817372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-83a5e53e-682f-42ee-9130-bd35243e63e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:50.817997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-83a5e53e-682f-42ee-9130-bd35243e63e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:50.824464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83a5e53e-682f-42ee-9130-bd35243e63e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:50.824924 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83a5e53e-682f-42ee-9130-bd35243e63e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:50.825709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83a5e53e-682f-42ee-9130-bd35243e63e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:50.825941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fae7e337-c7ee-45c1-bb8e-e14390492d67 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:50.826244 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83a5e53e-682f-42ee-9130-bd35243e63e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:50.826644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fae7e337-c7ee-45c1-bb8e-e14390492d67 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:50.827801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fae7e337-c7ee-45c1-bb8e-e14390492d67 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:50.828488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fae7e337-c7ee-45c1-bb8e-e14390492d67 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:50.964158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-83a5e53e-682f-42ee-9130-bd35243e63e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:50.968423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fae7e337-c7ee-45c1-bb8e-e14390492d67 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:50.972587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-83a5e53e-682f-42ee-9130-bd35243e63e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.158909 Apr 07 13:18:50.973350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 685/1492] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:50 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:50.976628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fae7e337-c7ee-45c1-bb8e-e14390492d67 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.165552 Apr 07 13:18:50.977307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 808/1493] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:50 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:50.977585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f9144b2f-7323-4df0-8fb5-fefec518fb18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:50.978193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f9144b2f-7323-4df0-8fb5-fefec518fb18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:50.984486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f9144b2f-7323-4df0-8fb5-fefec518fb18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:50.984940 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f9144b2f-7323-4df0-8fb5-fefec518fb18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:50.985706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f9144b2f-7323-4df0-8fb5-fefec518fb18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:50.986142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f9144b2f-7323-4df0-8fb5-fefec518fb18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:51.043911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f9144b2f-7323-4df0-8fb5-fefec518fb18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:51.052857 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f9144b2f-7323-4df0-8fb5-fefec518fb18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:51.054302 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f9144b2f-7323-4df0-8fb5-fefec518fb18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:51.055446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f9144b2f-7323-4df0-8fb5-fefec518fb18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081378 Apr 07 13:18:51.056004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 686/1494] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:50 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:51.990217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5b043d08-7a48-4b7c-990f-ebfa0bc40455 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:51.990868 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5b043d08-7a48-4b7c-990f-ebfa0bc40455 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:51.994616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-05b959c2-170a-4528-b166-bf25f97c67ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:51.995243 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-05b959c2-170a-4528-b166-bf25f97c67ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:51.997054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b043d08-7a48-4b7c-990f-ebfa0bc40455 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:51.997610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b043d08-7a48-4b7c-990f-ebfa0bc40455 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:51.998384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b043d08-7a48-4b7c-990f-ebfa0bc40455 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:51.998822 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b043d08-7a48-4b7c-990f-ebfa0bc40455 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:52.001545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05b959c2-170a-4528-b166-bf25f97c67ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:52.002005 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05b959c2-170a-4528-b166-bf25f97c67ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:52.002785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05b959c2-170a-4528-b166-bf25f97c67ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:52.003237 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-05b959c2-170a-4528-b166-bf25f97c67ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:52.129063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5b043d08-7a48-4b7c-990f-ebfa0bc40455 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:52.136111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-05b959c2-170a-4528-b166-bf25f97c67ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:52.137396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5b043d08-7a48-4b7c-990f-ebfa0bc40455 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151226 Apr 07 13:18:52.139844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 809/1495] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:51 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:52.143091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-69e15cb8-edf6-4d99-856b-c13e54afaf13 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:52.143695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-69e15cb8-edf6-4d99-856b-c13e54afaf13 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:52.144777 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-05b959c2-170a-4528-b166-bf25f97c67ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154006 Apr 07 13:18:52.145500 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 687/1496] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:51 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:52.149521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-69e15cb8-edf6-4d99-856b-c13e54afaf13 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:52.149976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-69e15cb8-edf6-4d99-856b-c13e54afaf13 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:52.150797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-69e15cb8-edf6-4d99-856b-c13e54afaf13 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:52.151232 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-69e15cb8-edf6-4d99-856b-c13e54afaf13 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:52.213646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-69e15cb8-edf6-4d99-856b-c13e54afaf13 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:52.222471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-69e15cb8-edf6-4d99-856b-c13e54afaf13 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:52.223962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-69e15cb8-edf6-4d99-856b-c13e54afaf13 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:52.225119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-69e15cb8-edf6-4d99-856b-c13e54afaf13 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085738 Apr 07 13:18:52.225667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 810/1497] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:52 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:53.154802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bf770439-f23f-4658-bc20-90eb5f2eb13c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:53.155394 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bf770439-f23f-4658-bc20-90eb5f2eb13c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:53.162107 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf770439-f23f-4658-bc20-90eb5f2eb13c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:53.162385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-778abd95-0930-41d7-a114-ef20c85b2c53 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:53.162809 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf770439-f23f-4658-bc20-90eb5f2eb13c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:53.163006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-778abd95-0930-41d7-a114-ef20c85b2c53 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:53.163353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf770439-f23f-4658-bc20-90eb5f2eb13c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:53.163796 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf770439-f23f-4658-bc20-90eb5f2eb13c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:53.169521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-778abd95-0930-41d7-a114-ef20c85b2c53 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:53.169986 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-778abd95-0930-41d7-a114-ef20c85b2c53 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:53.170764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-778abd95-0930-41d7-a114-ef20c85b2c53 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:53.171266 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-778abd95-0930-41d7-a114-ef20c85b2c53 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:53.295049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bf770439-f23f-4658-bc20-90eb5f2eb13c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:53.302969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bf770439-f23f-4658-bc20-90eb5f2eb13c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152067 Apr 07 13:18:53.303533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 688/1498] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:53 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:53.305720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-778abd95-0930-41d7-a114-ef20c85b2c53 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:53.308105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d57a2d5d-20f0-48b0-9125-dfe982e5b83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:53.309185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d57a2d5d-20f0-48b0-9125-dfe982e5b83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:53.314403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-778abd95-0930-41d7-a114-ef20c85b2c53 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155976 Apr 07 13:18:53.315158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 811/1499] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:53 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:53.315296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d57a2d5d-20f0-48b0-9125-dfe982e5b83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:53.315665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d57a2d5d-20f0-48b0-9125-dfe982e5b83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:53.316466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d57a2d5d-20f0-48b0-9125-dfe982e5b83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:53.316906 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d57a2d5d-20f0-48b0-9125-dfe982e5b83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:53.374867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d57a2d5d-20f0-48b0-9125-dfe982e5b83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:53.382947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d57a2d5d-20f0-48b0-9125-dfe982e5b83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:53.384473 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d57a2d5d-20f0-48b0-9125-dfe982e5b83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:53.385623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d57a2d5d-20f0-48b0-9125-dfe982e5b83e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081153 Apr 07 13:18:53.386188 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 689/1500] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:53 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:54.320435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-35138f55-7c9b-4223-82c6-6ecbd0e03a60 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:54.321044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-35138f55-7c9b-4223-82c6-6ecbd0e03a60 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:54.328494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-35138f55-7c9b-4223-82c6-6ecbd0e03a60 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:54.328940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-35138f55-7c9b-4223-82c6-6ecbd0e03a60 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:54.329691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-35138f55-7c9b-4223-82c6-6ecbd0e03a60 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:54.330118 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-35138f55-7c9b-4223-82c6-6ecbd0e03a60 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:54.331148 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-56191c92-419c-4966-8186-31d344df49f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:54.331910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-56191c92-419c-4966-8186-31d344df49f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:54.338331 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-56191c92-419c-4966-8186-31d344df49f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:54.338790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-56191c92-419c-4966-8186-31d344df49f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:54.339556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-56191c92-419c-4966-8186-31d344df49f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:54.339994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-56191c92-419c-4966-8186-31d344df49f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:54.467292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-35138f55-7c9b-4223-82c6-6ecbd0e03a60 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:54.475771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-35138f55-7c9b-4223-82c6-6ecbd0e03a60 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.159118 Apr 07 13:18:54.476442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 812/1501] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:54 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:54.482502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3a9d774e-b999-4669-98e4-6458edf14c8c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:54.483115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-56191c92-419c-4966-8186-31d344df49f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:54.483925 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3a9d774e-b999-4669-98e4-6458edf14c8c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:54.491355 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3a9d774e-b999-4669-98e4-6458edf14c8c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:54.491522 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-56191c92-419c-4966-8186-31d344df49f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.164234 Apr 07 13:18:54.491809 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3a9d774e-b999-4669-98e4-6458edf14c8c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:54.492357 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 690/1502] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:54 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:54.492597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3a9d774e-b999-4669-98e4-6458edf14c8c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:54.493026 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3a9d774e-b999-4669-98e4-6458edf14c8c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:54.551263 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3a9d774e-b999-4669-98e4-6458edf14c8c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:54.559321 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3a9d774e-b999-4669-98e4-6458edf14c8c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:54.561912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3a9d774e-b999-4669-98e4-6458edf14c8c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:54.563041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3a9d774e-b999-4669-98e4-6458edf14c8c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085768 Apr 07 13:18:54.563592 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 813/1503] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:54 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:55.498098 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f9846fd8-9477-40ca-a3cb-f1563e46a379 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:55.498712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f9846fd8-9477-40ca-a3cb-f1563e46a379 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:55.505037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f9846fd8-9477-40ca-a3cb-f1563e46a379 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:55.505483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f9846fd8-9477-40ca-a3cb-f1563e46a379 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:55.506251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f9846fd8-9477-40ca-a3cb-f1563e46a379 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:55.506683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f9846fd8-9477-40ca-a3cb-f1563e46a379 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:55.508661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c9a7cc17-dfaa-4b00-a52e-755eca71075d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:55.509285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c9a7cc17-dfaa-4b00-a52e-755eca71075d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:55.516360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9a7cc17-dfaa-4b00-a52e-755eca71075d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:55.516814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9a7cc17-dfaa-4b00-a52e-755eca71075d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:55.517585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9a7cc17-dfaa-4b00-a52e-755eca71075d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:55.518026 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9a7cc17-dfaa-4b00-a52e-755eca71075d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:55.643934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f9846fd8-9477-40ca-a3cb-f1563e46a379 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:55.651954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f9846fd8-9477-40ca-a3cb-f1563e46a379 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.158381 Apr 07 13:18:55.652555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 691/1504] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:55 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:55.654993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c9a7cc17-dfaa-4b00-a52e-755eca71075d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:55.657082 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e19d0c12-96e2-427b-bb97-2af6ed7da2d1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:55.657688 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e19d0c12-96e2-427b-bb97-2af6ed7da2d1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:55.663250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c9a7cc17-dfaa-4b00-a52e-755eca71075d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158458 Apr 07 13:18:55.663493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e19d0c12-96e2-427b-bb97-2af6ed7da2d1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:55.663818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 814/1505] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:55 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:55.664062 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e19d0c12-96e2-427b-bb97-2af6ed7da2d1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:55.664728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e19d0c12-96e2-427b-bb97-2af6ed7da2d1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:55.665173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e19d0c12-96e2-427b-bb97-2af6ed7da2d1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:55.723847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e19d0c12-96e2-427b-bb97-2af6ed7da2d1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:55.732519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e19d0c12-96e2-427b-bb97-2af6ed7da2d1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:55.734160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e19d0c12-96e2-427b-bb97-2af6ed7da2d1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:55.735325 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e19d0c12-96e2-427b-bb97-2af6ed7da2d1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081856 Apr 07 13:18:55.735879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 692/1506] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:55 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:56.670146 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-eb69d266-52f2-47b0-9e1f-090e07aa0e35 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:56.670753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-eb69d266-52f2-47b0-9e1f-090e07aa0e35 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:56.677273 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eb69d266-52f2-47b0-9e1f-090e07aa0e35 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:56.677727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eb69d266-52f2-47b0-9e1f-090e07aa0e35 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:56.678494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eb69d266-52f2-47b0-9e1f-090e07aa0e35 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:56.678937 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eb69d266-52f2-47b0-9e1f-090e07aa0e35 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:56.681039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a661fcc9-5824-44a3-9901-4669515055a2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:56.681683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a661fcc9-5824-44a3-9901-4669515055a2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:56.688701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a661fcc9-5824-44a3-9901-4669515055a2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:56.689162 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a661fcc9-5824-44a3-9901-4669515055a2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:56.689977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a661fcc9-5824-44a3-9901-4669515055a2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:56.690416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a661fcc9-5824-44a3-9901-4669515055a2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:56.814241 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-eb69d266-52f2-47b0-9e1f-090e07aa0e35 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:56.822117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-eb69d266-52f2-47b0-9e1f-090e07aa0e35 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.156201 Apr 07 13:18:56.822677 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 815/1507] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:56 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:56.824524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a661fcc9-5824-44a3-9901-4669515055a2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:56.827227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1663b4ae-b2b3-4d8e-99b5-b0f403356087 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:56.827936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1663b4ae-b2b3-4d8e-99b5-b0f403356087 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:56.832680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a661fcc9-5824-44a3-9901-4669515055a2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155389 Apr 07 13:18:56.833187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 693/1508] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:56 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:56.834196 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1663b4ae-b2b3-4d8e-99b5-b0f403356087 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:56.834653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1663b4ae-b2b3-4d8e-99b5-b0f403356087 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:56.835425 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1663b4ae-b2b3-4d8e-99b5-b0f403356087 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:56.835867 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1663b4ae-b2b3-4d8e-99b5-b0f403356087 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:56.895646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1663b4ae-b2b3-4d8e-99b5-b0f403356087 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:56.903868 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1663b4ae-b2b3-4d8e-99b5-b0f403356087 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:56.905395 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1663b4ae-b2b3-4d8e-99b5-b0f403356087 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:56.906525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1663b4ae-b2b3-4d8e-99b5-b0f403356087 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082941 Apr 07 13:18:56.907078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 816/1509] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:56 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:57.839140 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b678f4df-1b00-4e31-b602-d05517511392 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:57.839705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b678f4df-1b00-4e31-b602-d05517511392 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:57.846450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b678f4df-1b00-4e31-b602-d05517511392 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:57.846904 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b678f4df-1b00-4e31-b602-d05517511392 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:57.847710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b678f4df-1b00-4e31-b602-d05517511392 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:57.848163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b678f4df-1b00-4e31-b602-d05517511392 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:57.850054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c22f67ef-1a4e-4358-9a99-880cd4bddf19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:57.850666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c22f67ef-1a4e-4358-9a99-880cd4bddf19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:57.856654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c22f67ef-1a4e-4358-9a99-880cd4bddf19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:57.857065 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c22f67ef-1a4e-4358-9a99-880cd4bddf19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:57.857895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c22f67ef-1a4e-4358-9a99-880cd4bddf19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:57.858329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c22f67ef-1a4e-4358-9a99-880cd4bddf19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:57.980748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b678f4df-1b00-4e31-b602-d05517511392 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:57.989058 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b678f4df-1b00-4e31-b602-d05517511392 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153885 Apr 07 13:18:57.989959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 694/1510] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:57 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:57.994554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6e8941c2-7848-4319-b3cf-de59456c28a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:57.995182 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6e8941c2-7848-4319-b3cf-de59456c28a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:58.000380 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c22f67ef-1a4e-4358-9a99-880cd4bddf19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:58.007999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6e8941c2-7848-4319-b3cf-de59456c28a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:58.008486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6e8941c2-7848-4319-b3cf-de59456c28a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:58.008917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c22f67ef-1a4e-4358-9a99-880cd4bddf19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.162436 Apr 07 13:18:58.009266 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6e8941c2-7848-4319-b3cf-de59456c28a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:58.009489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 817/1511] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:57 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:58.009705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6e8941c2-7848-4319-b3cf-de59456c28a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:58.067782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6e8941c2-7848-4319-b3cf-de59456c28a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:58.075898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6e8941c2-7848-4319-b3cf-de59456c28a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:58.077434 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6e8941c2-7848-4319-b3cf-de59456c28a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:58.078579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6e8941c2-7848-4319-b3cf-de59456c28a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087624 Apr 07 13:18:58.079133 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 695/1512] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:57 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:18:59.007249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0bab127d-6dd8-49a7-b922-6f55e3c55c6b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:59.007894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0bab127d-6dd8-49a7-b922-6f55e3c55c6b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:59.014333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0bab127d-6dd8-49a7-b922-6f55e3c55c6b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:59.014776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0bab127d-6dd8-49a7-b922-6f55e3c55c6b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:59.015533 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0bab127d-6dd8-49a7-b922-6f55e3c55c6b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:59.015968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0bab127d-6dd8-49a7-b922-6f55e3c55c6b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:59.025916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-df221223-e7e1-492d-9711-6619901e06bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:59.026561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-df221223-e7e1-492d-9711-6619901e06bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:59.033863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df221223-e7e1-492d-9711-6619901e06bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:59.034306 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df221223-e7e1-492d-9711-6619901e06bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:59.035318 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df221223-e7e1-492d-9711-6619901e06bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:59.035757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df221223-e7e1-492d-9711-6619901e06bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:59.146389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0bab127d-6dd8-49a7-b922-6f55e3c55c6b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:59.154790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0bab127d-6dd8-49a7-b922-6f55e3c55c6b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151310 Apr 07 13:18:59.155359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 818/1513] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:59 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:18:59.159932 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1200b27a-4fd1-477f-9421-2479cc4e0e7b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:18:59.160819 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1200b27a-4fd1-477f-9421-2479cc4e0e7b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:18:59.166398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1200b27a-4fd1-477f-9421-2479cc4e0e7b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:59.166848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1200b27a-4fd1-477f-9421-2479cc4e0e7b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:59.167611 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1200b27a-4fd1-477f-9421-2479cc4e0e7b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:18:59.168047 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1200b27a-4fd1-477f-9421-2479cc4e0e7b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:18:59.173540 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-df221223-e7e1-492d-9711-6619901e06bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:59.181430 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-df221223-e7e1-492d-9711-6619901e06bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.159351 Apr 07 13:18:59.181998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 696/1514] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:18:59 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:18:59.230051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1200b27a-4fd1-477f-9421-2479cc4e0e7b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:59.238986 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1200b27a-4fd1-477f-9421-2479cc4e0e7b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:59.240477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1200b27a-4fd1-477f-9421-2479cc4e0e7b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:18:59.241602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1200b27a-4fd1-477f-9421-2479cc4e0e7b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085312 Apr 07 13:18:59.242153 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 819/1515] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:18:59 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:00.172518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-df309587-579a-4af8-b5e7-82236fb1ff4a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:00.173128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-df309587-579a-4af8-b5e7-82236fb1ff4a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:00.179562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df309587-579a-4af8-b5e7-82236fb1ff4a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:00.180012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df309587-579a-4af8-b5e7-82236fb1ff4a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:00.180798 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df309587-579a-4af8-b5e7-82236fb1ff4a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:00.181232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df309587-579a-4af8-b5e7-82236fb1ff4a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:00.198344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-96ba7071-dec3-4eb0-8fec-35800e72b1f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:00.198958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-96ba7071-dec3-4eb0-8fec-35800e72b1f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:00.205349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-96ba7071-dec3-4eb0-8fec-35800e72b1f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:00.205800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-96ba7071-dec3-4eb0-8fec-35800e72b1f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:00.206569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-96ba7071-dec3-4eb0-8fec-35800e72b1f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:00.207006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-96ba7071-dec3-4eb0-8fec-35800e72b1f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:00.316544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-df309587-579a-4af8-b5e7-82236fb1ff4a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:00.324891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-df309587-579a-4af8-b5e7-82236fb1ff4a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.156627 Apr 07 13:19:00.325735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 697/1516] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:00 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:00.338907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-90d1f196-635a-495f-9461-c2df03f7495d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:00.339590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-90d1f196-635a-495f-9461-c2df03f7495d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:00.346137 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90d1f196-635a-495f-9461-c2df03f7495d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:00.346593 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90d1f196-635a-495f-9461-c2df03f7495d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:00.347385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90d1f196-635a-495f-9461-c2df03f7495d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:00.347831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90d1f196-635a-495f-9461-c2df03f7495d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:00.413788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-90d1f196-635a-495f-9461-c2df03f7495d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:00.423258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-90d1f196-635a-495f-9461-c2df03f7495d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:00.424721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-90d1f196-635a-495f-9461-c2df03f7495d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:00.425908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-90d1f196-635a-495f-9461-c2df03f7495d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.099135 Apr 07 13:19:00.426480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 698/1517] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:00 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:00.594551 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-96ba7071-dec3-4eb0-8fec-35800e72b1f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:00.602315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-96ba7071-dec3-4eb0-8fec-35800e72b1f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.407800 Apr 07 13:19:00.602872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 820/1518] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:00 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:01.343054 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bd2509d2-45b2-41f0-8219-3b8786b15fbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:01.343670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bd2509d2-45b2-41f0-8219-3b8786b15fbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:01.350066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd2509d2-45b2-41f0-8219-3b8786b15fbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:01.350519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd2509d2-45b2-41f0-8219-3b8786b15fbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:01.351288 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd2509d2-45b2-41f0-8219-3b8786b15fbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:01.351726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd2509d2-45b2-41f0-8219-3b8786b15fbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:01.445295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2b0d091d-c2f3-4f5a-b94d-40d10168f17f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:01.445989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2b0d091d-c2f3-4f5a-b94d-40d10168f17f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:01.452316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2b0d091d-c2f3-4f5a-b94d-40d10168f17f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:01.452839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2b0d091d-c2f3-4f5a-b94d-40d10168f17f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:01.453608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2b0d091d-c2f3-4f5a-b94d-40d10168f17f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:01.454038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2b0d091d-c2f3-4f5a-b94d-40d10168f17f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:01.485059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bd2509d2-45b2-41f0-8219-3b8786b15fbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:01.493237 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bd2509d2-45b2-41f0-8219-3b8786b15fbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154477 Apr 07 13:19:01.494689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 699/1519] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:01 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:01.514286 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2b0d091d-c2f3-4f5a-b94d-40d10168f17f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:01.522531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2b0d091d-c2f3-4f5a-b94d-40d10168f17f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:01.524003 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2b0d091d-c2f3-4f5a-b94d-40d10168f17f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:01.525157 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2b0d091d-c2f3-4f5a-b94d-40d10168f17f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083682 Apr 07 13:19:01.525708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 821/1520] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:01 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:01.620519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dae11c72-f1e1-4507-8104-ddb3c8ca032d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:01.621132 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dae11c72-f1e1-4507-8104-ddb3c8ca032d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:01.627594 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dae11c72-f1e1-4507-8104-ddb3c8ca032d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:01.628045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dae11c72-f1e1-4507-8104-ddb3c8ca032d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:01.628839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dae11c72-f1e1-4507-8104-ddb3c8ca032d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:01.629277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dae11c72-f1e1-4507-8104-ddb3c8ca032d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:01.757994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dae11c72-f1e1-4507-8104-ddb3c8ca032d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:01.766465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dae11c72-f1e1-4507-8104-ddb3c8ca032d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149780 Apr 07 13:19:01.767030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 700/1521] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:01 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:02.510966 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-392a225b-4657-49a9-863f-89a3a9e54b24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:02.511584 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-392a225b-4657-49a9-863f-89a3a9e54b24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:02.518024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-392a225b-4657-49a9-863f-89a3a9e54b24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:02.518478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-392a225b-4657-49a9-863f-89a3a9e54b24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:02.519246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-392a225b-4657-49a9-863f-89a3a9e54b24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:02.519685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-392a225b-4657-49a9-863f-89a3a9e54b24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:02.542713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6e34f543-9b97-4ce4-b6ab-dd0b0904518f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:02.543360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6e34f543-9b97-4ce4-b6ab-dd0b0904518f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:02.550139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6e34f543-9b97-4ce4-b6ab-dd0b0904518f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:02.550595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6e34f543-9b97-4ce4-b6ab-dd0b0904518f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:02.551368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6e34f543-9b97-4ce4-b6ab-dd0b0904518f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:02.551804 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6e34f543-9b97-4ce4-b6ab-dd0b0904518f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:02.615589 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6e34f543-9b97-4ce4-b6ab-dd0b0904518f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:02.625291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6e34f543-9b97-4ce4-b6ab-dd0b0904518f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:02.626773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6e34f543-9b97-4ce4-b6ab-dd0b0904518f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:02.627920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6e34f543-9b97-4ce4-b6ab-dd0b0904518f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.089084 Apr 07 13:19:02.628529 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 701/1522] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:02 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:02.654938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-392a225b-4657-49a9-863f-89a3a9e54b24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:02.662953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-392a225b-4657-49a9-863f-89a3a9e54b24 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.155898 Apr 07 13:19:02.663508 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 822/1523] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:02 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:02.783657 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-948e3672-a0dc-4ebd-81a2-76cbfc57c253 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:02.784233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-948e3672-a0dc-4ebd-81a2-76cbfc57c253 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:02.790328 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-948e3672-a0dc-4ebd-81a2-76cbfc57c253 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:02.790780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-948e3672-a0dc-4ebd-81a2-76cbfc57c253 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:02.791548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-948e3672-a0dc-4ebd-81a2-76cbfc57c253 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:02.791983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-948e3672-a0dc-4ebd-81a2-76cbfc57c253 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:02.920867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-948e3672-a0dc-4ebd-81a2-76cbfc57c253 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:02.928526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-948e3672-a0dc-4ebd-81a2-76cbfc57c253 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.148772 Apr 07 13:19:02.929086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 702/1524] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:02 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:03.645920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-52c2fb63-945c-41d4-bfd4-fdb180e81380 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:03.646525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-52c2fb63-945c-41d4-bfd4-fdb180e81380 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:03.652826 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-52c2fb63-945c-41d4-bfd4-fdb180e81380 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:03.653565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-52c2fb63-945c-41d4-bfd4-fdb180e81380 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:03.654071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-52c2fb63-945c-41d4-bfd4-fdb180e81380 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:03.654529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-52c2fb63-945c-41d4-bfd4-fdb180e81380 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:03.680438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-34268725-a11a-4fac-94e4-073fb7fe5d20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:03.681802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-34268725-a11a-4fac-94e4-073fb7fe5d20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:03.689039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34268725-a11a-4fac-94e4-073fb7fe5d20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:03.689495 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34268725-a11a-4fac-94e4-073fb7fe5d20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:03.690277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34268725-a11a-4fac-94e4-073fb7fe5d20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:03.690717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34268725-a11a-4fac-94e4-073fb7fe5d20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:03.714060 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-52c2fb63-945c-41d4-bfd4-fdb180e81380 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:03.726085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-52c2fb63-945c-41d4-bfd4-fdb180e81380 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:03.727563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-52c2fb63-945c-41d4-bfd4-fdb180e81380 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:03.728733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-52c2fb63-945c-41d4-bfd4-fdb180e81380 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086689 Apr 07 13:19:03.729273 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 823/1525] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:03 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:03.821661 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-34268725-a11a-4fac-94e4-073fb7fe5d20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:03.829683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-34268725-a11a-4fac-94e4-073fb7fe5d20 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153136 Apr 07 13:19:03.830248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 703/1526] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:03 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:03.945494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5b8c0619-8bf0-40ef-906a-d35034bbc8ba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:03.946097 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5b8c0619-8bf0-40ef-906a-d35034bbc8ba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:03.953137 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b8c0619-8bf0-40ef-906a-d35034bbc8ba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:03.953583 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b8c0619-8bf0-40ef-906a-d35034bbc8ba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:03.954342 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b8c0619-8bf0-40ef-906a-d35034bbc8ba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:03.954924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b8c0619-8bf0-40ef-906a-d35034bbc8ba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:04.084187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5b8c0619-8bf0-40ef-906a-d35034bbc8ba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:04.093119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5b8c0619-8bf0-40ef-906a-d35034bbc8ba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151457 Apr 07 13:19:04.093676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 824/1527] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:03 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:04.747966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f8c879fc-2e72-4b7b-b647-39e5ffe96c83 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:04.748607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f8c879fc-2e72-4b7b-b647-39e5ffe96c83 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:04.754521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f8c879fc-2e72-4b7b-b647-39e5ffe96c83 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:04.754972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f8c879fc-2e72-4b7b-b647-39e5ffe96c83 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:04.755734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f8c879fc-2e72-4b7b-b647-39e5ffe96c83 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:04.756201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f8c879fc-2e72-4b7b-b647-39e5ffe96c83 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:04.817302 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f8c879fc-2e72-4b7b-b647-39e5ffe96c83 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:04.825736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f8c879fc-2e72-4b7b-b647-39e5ffe96c83 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:04.827236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f8c879fc-2e72-4b7b-b647-39e5ffe96c83 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:04.828417 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f8c879fc-2e72-4b7b-b647-39e5ffe96c83 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085272 Apr 07 13:19:04.828986 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 704/1528] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:04 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:04.846526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f93d760f-3afb-4187-b731-57f9d3ddc019 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:04.847076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f93d760f-3afb-4187-b731-57f9d3ddc019 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:04.853352 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f93d760f-3afb-4187-b731-57f9d3ddc019 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:04.853801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f93d760f-3afb-4187-b731-57f9d3ddc019 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:04.854562 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f93d760f-3afb-4187-b731-57f9d3ddc019 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:04.854997 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f93d760f-3afb-4187-b731-57f9d3ddc019 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:04.989427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f93d760f-3afb-4187-b731-57f9d3ddc019 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:04.998009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f93d760f-3afb-4187-b731-57f9d3ddc019 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.155270 Apr 07 13:19:04.998581 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 825/1529] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:04 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:05.110515 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-28331e4b-000f-4374-b308-b791bde0a6da tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:05.111133 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-28331e4b-000f-4374-b308-b791bde0a6da tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:05.117115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-28331e4b-000f-4374-b308-b791bde0a6da tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:05.117568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-28331e4b-000f-4374-b308-b791bde0a6da tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:05.118332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-28331e4b-000f-4374-b308-b791bde0a6da tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:05.118773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-28331e4b-000f-4374-b308-b791bde0a6da tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:05.251743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-28331e4b-000f-4374-b308-b791bde0a6da tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:05.259463 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-28331e4b-000f-4374-b308-b791bde0a6da tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153342 Apr 07 13:19:05.260031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 705/1530] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:05 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:05.848197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-25bc15e3-d7a3-494d-a986-edded31ed8bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:05.848752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-25bc15e3-d7a3-494d-a986-edded31ed8bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:05.855177 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-25bc15e3-d7a3-494d-a986-edded31ed8bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:05.855625 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-25bc15e3-d7a3-494d-a986-edded31ed8bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:05.856448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-25bc15e3-d7a3-494d-a986-edded31ed8bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:05.857022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-25bc15e3-d7a3-494d-a986-edded31ed8bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:05.915825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-25bc15e3-d7a3-494d-a986-edded31ed8bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:05.924440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-25bc15e3-d7a3-494d-a986-edded31ed8bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:05.925919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-25bc15e3-d7a3-494d-a986-edded31ed8bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:05.927048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-25bc15e3-d7a3-494d-a986-edded31ed8bd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084367 Apr 07 13:19:05.927593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 826/1531] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:05 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:06.014956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9bb1ed07-acd2-4ca4-ab7f-8cef66824c96 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:06.015573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9bb1ed07-acd2-4ca4-ab7f-8cef66824c96 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:06.022664 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bb1ed07-acd2-4ca4-ab7f-8cef66824c96 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:06.023123 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bb1ed07-acd2-4ca4-ab7f-8cef66824c96 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:06.023899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bb1ed07-acd2-4ca4-ab7f-8cef66824c96 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:06.024380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bb1ed07-acd2-4ca4-ab7f-8cef66824c96 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:06.151873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9bb1ed07-acd2-4ca4-ab7f-8cef66824c96 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:06.166119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9bb1ed07-acd2-4ca4-ab7f-8cef66824c96 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.155092 Apr 07 13:19:06.166696 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 706/1532] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:06 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:06.276794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-53203825-b658-4b77-b653-03947d951a6a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:06.277403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-53203825-b658-4b77-b653-03947d951a6a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:06.283474 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53203825-b658-4b77-b653-03947d951a6a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:06.283920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53203825-b658-4b77-b653-03947d951a6a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:06.284702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53203825-b658-4b77-b653-03947d951a6a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:06.285392 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53203825-b658-4b77-b653-03947d951a6a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:06.417787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-53203825-b658-4b77-b653-03947d951a6a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:06.425727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-53203825-b658-4b77-b653-03947d951a6a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152753 Apr 07 13:19:06.426290 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 827/1533] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:06 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:06.945579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-79689d7e-e25e-48fb-b96f-5e1f4bf76c95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:06.946193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-79689d7e-e25e-48fb-b96f-5e1f4bf76c95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:06.952264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-79689d7e-e25e-48fb-b96f-5e1f4bf76c95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:06.952718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-79689d7e-e25e-48fb-b96f-5e1f4bf76c95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:06.953483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-79689d7e-e25e-48fb-b96f-5e1f4bf76c95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:06.953930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-79689d7e-e25e-48fb-b96f-5e1f4bf76c95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:07.015047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-79689d7e-e25e-48fb-b96f-5e1f4bf76c95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:07.023543 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-79689d7e-e25e-48fb-b96f-5e1f4bf76c95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:07.025122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-79689d7e-e25e-48fb-b96f-5e1f4bf76c95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:07.026249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-79689d7e-e25e-48fb-b96f-5e1f4bf76c95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084614 Apr 07 13:19:07.026795 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 707/1534] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:06 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:07.183651 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-21779c86-7e0a-44be-880c-bdf9cc836301 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:07.185368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-21779c86-7e0a-44be-880c-bdf9cc836301 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:07.191810 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21779c86-7e0a-44be-880c-bdf9cc836301 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:07.192296 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21779c86-7e0a-44be-880c-bdf9cc836301 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:07.193174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21779c86-7e0a-44be-880c-bdf9cc836301 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:07.193604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21779c86-7e0a-44be-880c-bdf9cc836301 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:07.325322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-21779c86-7e0a-44be-880c-bdf9cc836301 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:07.333114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-21779c86-7e0a-44be-880c-bdf9cc836301 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153184 Apr 07 13:19:07.333683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 828/1535] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:07 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:07.442680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d61c09d1-64ce-4fda-b682-5f1be524546a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:07.443229 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d61c09d1-64ce-4fda-b682-5f1be524546a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:07.449144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d61c09d1-64ce-4fda-b682-5f1be524546a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:07.449625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d61c09d1-64ce-4fda-b682-5f1be524546a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:07.450418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d61c09d1-64ce-4fda-b682-5f1be524546a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:07.450854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d61c09d1-64ce-4fda-b682-5f1be524546a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:07.583681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d61c09d1-64ce-4fda-b682-5f1be524546a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:07.592023 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d61c09d1-64ce-4fda-b682-5f1be524546a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153168 Apr 07 13:19:07.592620 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 708/1536] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:07 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:08.044440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9ae2d74d-7d0d-4c1f-b163-ca5cb90fa9fa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:08.045107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9ae2d74d-7d0d-4c1f-b163-ca5cb90fa9fa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:08.051212 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9ae2d74d-7d0d-4c1f-b163-ca5cb90fa9fa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:08.051669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9ae2d74d-7d0d-4c1f-b163-ca5cb90fa9fa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:08.052474 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9ae2d74d-7d0d-4c1f-b163-ca5cb90fa9fa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:08.052916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9ae2d74d-7d0d-4c1f-b163-ca5cb90fa9fa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:08.111409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9ae2d74d-7d0d-4c1f-b163-ca5cb90fa9fa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:08.119829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9ae2d74d-7d0d-4c1f-b163-ca5cb90fa9fa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:08.121412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9ae2d74d-7d0d-4c1f-b163-ca5cb90fa9fa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:08.123031 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9ae2d74d-7d0d-4c1f-b163-ca5cb90fa9fa tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082578 Apr 07 13:19:08.123587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 829/1537] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:08 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:08.350668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1c484722-6ee6-46a9-b49f-9c9da112f2a4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:08.351283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1c484722-6ee6-46a9-b49f-9c9da112f2a4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:08.358079 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1c484722-6ee6-46a9-b49f-9c9da112f2a4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:08.358522 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1c484722-6ee6-46a9-b49f-9c9da112f2a4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:08.359280 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1c484722-6ee6-46a9-b49f-9c9da112f2a4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:08.359714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1c484722-6ee6-46a9-b49f-9c9da112f2a4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:08.488519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1c484722-6ee6-46a9-b49f-9c9da112f2a4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:08.496313 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1c484722-6ee6-46a9-b49f-9c9da112f2a4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149382 Apr 07 13:19:08.497205 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 709/1538] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:08 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:08.609665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-24ead8bf-2bb5-4f6d-8919-f3312b02efde tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:08.610304 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-24ead8bf-2bb5-4f6d-8919-f3312b02efde tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:08.616673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-24ead8bf-2bb5-4f6d-8919-f3312b02efde tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:08.617122 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-24ead8bf-2bb5-4f6d-8919-f3312b02efde tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:08.617882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-24ead8bf-2bb5-4f6d-8919-f3312b02efde tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:08.618318 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-24ead8bf-2bb5-4f6d-8919-f3312b02efde tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:08.750524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-24ead8bf-2bb5-4f6d-8919-f3312b02efde tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:08.758307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-24ead8bf-2bb5-4f6d-8919-f3312b02efde tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152532 Apr 07 13:19:08.758869 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 830/1539] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:08 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:09.141659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0fb4ee55-c99e-47c8-a44c-df3999d31be8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:09.142312 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0fb4ee55-c99e-47c8-a44c-df3999d31be8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:09.148755 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0fb4ee55-c99e-47c8-a44c-df3999d31be8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:09.149218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0fb4ee55-c99e-47c8-a44c-df3999d31be8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:09.150019 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0fb4ee55-c99e-47c8-a44c-df3999d31be8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:09.150467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0fb4ee55-c99e-47c8-a44c-df3999d31be8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:09.215971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0fb4ee55-c99e-47c8-a44c-df3999d31be8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:09.224125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0fb4ee55-c99e-47c8-a44c-df3999d31be8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:09.225631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0fb4ee55-c99e-47c8-a44c-df3999d31be8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:09.226760 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0fb4ee55-c99e-47c8-a44c-df3999d31be8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.089631 Apr 07 13:19:09.227318 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 710/1540] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:09 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:09.514512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fac36c1a-2202-4802-89a1-f4ad0dc7eab1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:09.515156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fac36c1a-2202-4802-89a1-f4ad0dc7eab1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:09.521049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fac36c1a-2202-4802-89a1-f4ad0dc7eab1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:09.521495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fac36c1a-2202-4802-89a1-f4ad0dc7eab1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:09.522246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fac36c1a-2202-4802-89a1-f4ad0dc7eab1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:09.522676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fac36c1a-2202-4802-89a1-f4ad0dc7eab1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:09.652445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fac36c1a-2202-4802-89a1-f4ad0dc7eab1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:09.661442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fac36c1a-2202-4802-89a1-f4ad0dc7eab1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151387 Apr 07 13:19:09.662000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 831/1541] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:09 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:09.775546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-38adbcf6-a9ed-4556-a4b1-f6d854e53e4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:09.776127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-38adbcf6-a9ed-4556-a4b1-f6d854e53e4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:09.785971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38adbcf6-a9ed-4556-a4b1-f6d854e53e4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:09.786429 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38adbcf6-a9ed-4556-a4b1-f6d854e53e4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:09.787447 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38adbcf6-a9ed-4556-a4b1-f6d854e53e4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:09.788317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38adbcf6-a9ed-4556-a4b1-f6d854e53e4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:09.921573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-38adbcf6-a9ed-4556-a4b1-f6d854e53e4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:09.929432 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-38adbcf6-a9ed-4556-a4b1-f6d854e53e4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158108 Apr 07 13:19:09.929997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 711/1542] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:09 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:10.244831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-538822a0-fb6b-40bb-b8ca-d0bb186d9be0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:10.245470 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-538822a0-fb6b-40bb-b8ca-d0bb186d9be0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:10.251948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-538822a0-fb6b-40bb-b8ca-d0bb186d9be0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:10.252430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-538822a0-fb6b-40bb-b8ca-d0bb186d9be0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:10.253224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-538822a0-fb6b-40bb-b8ca-d0bb186d9be0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:10.253661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-538822a0-fb6b-40bb-b8ca-d0bb186d9be0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:10.311432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-538822a0-fb6b-40bb-b8ca-d0bb186d9be0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:10.319438 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-538822a0-fb6b-40bb-b8ca-d0bb186d9be0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:10.320976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-538822a0-fb6b-40bb-b8ca-d0bb186d9be0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:10.322108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-538822a0-fb6b-40bb-b8ca-d0bb186d9be0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081254 Apr 07 13:19:10.322661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 832/1543] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:10 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:10.679567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7d06d8f4-7a2f-42fe-b374-7c82d9fb53e3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:10.680846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7d06d8f4-7a2f-42fe-b374-7c82d9fb53e3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:10.687567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d06d8f4-7a2f-42fe-b374-7c82d9fb53e3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:10.688018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d06d8f4-7a2f-42fe-b374-7c82d9fb53e3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:10.688826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d06d8f4-7a2f-42fe-b374-7c82d9fb53e3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:10.689263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d06d8f4-7a2f-42fe-b374-7c82d9fb53e3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:10.818757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7d06d8f4-7a2f-42fe-b374-7c82d9fb53e3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:10.826687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7d06d8f4-7a2f-42fe-b374-7c82d9fb53e3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151013 Apr 07 13:19:10.827242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 712/1544] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:10 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:10.946253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9f482a60-ea0d-462a-ad0c-f6aa81e54c9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:10.946864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9f482a60-ea0d-462a-ad0c-f6aa81e54c9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:10.953265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9f482a60-ea0d-462a-ad0c-f6aa81e54c9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:10.953718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9f482a60-ea0d-462a-ad0c-f6aa81e54c9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:10.954476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9f482a60-ea0d-462a-ad0c-f6aa81e54c9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:10.954911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9f482a60-ea0d-462a-ad0c-f6aa81e54c9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:11.085636 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9f482a60-ea0d-462a-ad0c-f6aa81e54c9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:11.094018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9f482a60-ea0d-462a-ad0c-f6aa81e54c9f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151570 Apr 07 13:19:11.094597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 833/1545] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:10 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:11.341130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8f3cbd7f-8693-4e2f-ba78-564bd1f10a98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:11.342356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8f3cbd7f-8693-4e2f-ba78-564bd1f10a98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:11.348682 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8f3cbd7f-8693-4e2f-ba78-564bd1f10a98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:11.349131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8f3cbd7f-8693-4e2f-ba78-564bd1f10a98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:11.349899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8f3cbd7f-8693-4e2f-ba78-564bd1f10a98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:11.350345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8f3cbd7f-8693-4e2f-ba78-564bd1f10a98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:11.413874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8f3cbd7f-8693-4e2f-ba78-564bd1f10a98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:11.422071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8f3cbd7f-8693-4e2f-ba78-564bd1f10a98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:11.423554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8f3cbd7f-8693-4e2f-ba78-564bd1f10a98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:11.424729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8f3cbd7f-8693-4e2f-ba78-564bd1f10a98 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087579 Apr 07 13:19:11.425279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 713/1546] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:11 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:11.843766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bc144577-91e0-4557-b43c-ed3f1c14f3cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:11.844365 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bc144577-91e0-4557-b43c-ed3f1c14f3cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:11.850278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc144577-91e0-4557-b43c-ed3f1c14f3cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:11.850727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc144577-91e0-4557-b43c-ed3f1c14f3cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:11.851504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc144577-91e0-4557-b43c-ed3f1c14f3cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:11.851937 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bc144577-91e0-4557-b43c-ed3f1c14f3cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:11.981321 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bc144577-91e0-4557-b43c-ed3f1c14f3cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:11.989137 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bc144577-91e0-4557-b43c-ed3f1c14f3cc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149368 Apr 07 13:19:11.989699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 834/1547] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:11 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:12.111222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f444979d-167a-4352-adf5-bfee8b84e2d5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:12.111851 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f444979d-167a-4352-adf5-bfee8b84e2d5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:12.118186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f444979d-167a-4352-adf5-bfee8b84e2d5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:12.118646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f444979d-167a-4352-adf5-bfee8b84e2d5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:12.119419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f444979d-167a-4352-adf5-bfee8b84e2d5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:12.119866 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f444979d-167a-4352-adf5-bfee8b84e2d5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:12.249642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f444979d-167a-4352-adf5-bfee8b84e2d5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:12.257534 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f444979d-167a-4352-adf5-bfee8b84e2d5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150626 Apr 07 13:19:12.258127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 714/1548] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:12 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:12.443134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-98ad6eb0-d8cc-4db8-8117-333649ba5f31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:12.443665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-98ad6eb0-d8cc-4db8-8117-333649ba5f31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:12.449550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98ad6eb0-d8cc-4db8-8117-333649ba5f31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:12.450006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98ad6eb0-d8cc-4db8-8117-333649ba5f31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:12.450766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98ad6eb0-d8cc-4db8-8117-333649ba5f31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:12.451204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98ad6eb0-d8cc-4db8-8117-333649ba5f31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:12.508401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-98ad6eb0-d8cc-4db8-8117-333649ba5f31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:12.516606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-98ad6eb0-d8cc-4db8-8117-333649ba5f31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:12.518092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-98ad6eb0-d8cc-4db8-8117-333649ba5f31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:12.519220 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-98ad6eb0-d8cc-4db8-8117-333649ba5f31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.080074 Apr 07 13:19:12.519768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 835/1549] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:12 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:13.006786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-32fc6eaf-ca8e-4c80-850f-8bdd62f03a83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:13.007403 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-32fc6eaf-ca8e-4c80-850f-8bdd62f03a83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:13.013283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32fc6eaf-ca8e-4c80-850f-8bdd62f03a83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:13.013731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32fc6eaf-ca8e-4c80-850f-8bdd62f03a83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:13.014978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32fc6eaf-ca8e-4c80-850f-8bdd62f03a83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:13.015407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32fc6eaf-ca8e-4c80-850f-8bdd62f03a83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:13.144060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-32fc6eaf-ca8e-4c80-850f-8bdd62f03a83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:13.151809 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-32fc6eaf-ca8e-4c80-850f-8bdd62f03a83 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148873 Apr 07 13:19:13.152397 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 715/1550] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:13 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:13.274754 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8fd905e5-437b-4c2e-82db-55221231019e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:13.275484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8fd905e5-437b-4c2e-82db-55221231019e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:13.282544 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fd905e5-437b-4c2e-82db-55221231019e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:13.283083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fd905e5-437b-4c2e-82db-55221231019e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:13.283873 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fd905e5-437b-4c2e-82db-55221231019e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:13.284337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fd905e5-437b-4c2e-82db-55221231019e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:13.417253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8fd905e5-437b-4c2e-82db-55221231019e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:13.425302 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8fd905e5-437b-4c2e-82db-55221231019e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154495 Apr 07 13:19:13.425861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 836/1551] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:13 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:13.538028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-21db5d07-5dbf-46d5-a774-2a2e4dd9f314 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:13.538649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-21db5d07-5dbf-46d5-a774-2a2e4dd9f314 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:13.544586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-21db5d07-5dbf-46d5-a774-2a2e4dd9f314 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:13.545050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-21db5d07-5dbf-46d5-a774-2a2e4dd9f314 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:13.545829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-21db5d07-5dbf-46d5-a774-2a2e4dd9f314 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:13.546260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-21db5d07-5dbf-46d5-a774-2a2e4dd9f314 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:13.607580 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-21db5d07-5dbf-46d5-a774-2a2e4dd9f314 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:13.616643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-21db5d07-5dbf-46d5-a774-2a2e4dd9f314 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:13.618296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-21db5d07-5dbf-46d5-a774-2a2e4dd9f314 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:13.619400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-21db5d07-5dbf-46d5-a774-2a2e4dd9f314 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085520 Apr 07 13:19:13.619958 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 716/1552] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:13 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:14.170520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ec9b1845-71e4-423f-a937-f8dd25ed4e50 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:14.171152 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ec9b1845-71e4-423f-a937-f8dd25ed4e50 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:14.178155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ec9b1845-71e4-423f-a937-f8dd25ed4e50 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:14.179012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ec9b1845-71e4-423f-a937-f8dd25ed4e50 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:14.179808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ec9b1845-71e4-423f-a937-f8dd25ed4e50 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:14.180274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ec9b1845-71e4-423f-a937-f8dd25ed4e50 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:14.318821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ec9b1845-71e4-423f-a937-f8dd25ed4e50 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:14.330459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ec9b1845-71e4-423f-a937-f8dd25ed4e50 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.164074 Apr 07 13:19:14.331035 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 837/1553] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:14 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:14.443304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ecda2870-9caa-47a4-99e3-1942e1d76e84 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:14.444375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ecda2870-9caa-47a4-99e3-1942e1d76e84 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:14.451117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ecda2870-9caa-47a4-99e3-1942e1d76e84 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:14.451942 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ecda2870-9caa-47a4-99e3-1942e1d76e84 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:14.454041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ecda2870-9caa-47a4-99e3-1942e1d76e84 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:14.454506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ecda2870-9caa-47a4-99e3-1942e1d76e84 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:14.603395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ecda2870-9caa-47a4-99e3-1942e1d76e84 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:14.611631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ecda2870-9caa-47a4-99e3-1942e1d76e84 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.172369 Apr 07 13:19:14.612218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 717/1554] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:14 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:14.637518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e523d43f-57b0-474a-a007-83c70f9dbdc9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:14.638225 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e523d43f-57b0-474a-a007-83c70f9dbdc9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:14.644167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e523d43f-57b0-474a-a007-83c70f9dbdc9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:14.644658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e523d43f-57b0-474a-a007-83c70f9dbdc9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:14.645432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e523d43f-57b0-474a-a007-83c70f9dbdc9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:14.645872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e523d43f-57b0-474a-a007-83c70f9dbdc9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:14.705236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e523d43f-57b0-474a-a007-83c70f9dbdc9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:14.713988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e523d43f-57b0-474a-a007-83c70f9dbdc9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:14.715472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e523d43f-57b0-474a-a007-83c70f9dbdc9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:14.716678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e523d43f-57b0-474a-a007-83c70f9dbdc9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083075 Apr 07 13:19:14.717750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 838/1555] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:14 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:15.348665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-94b8c261-42fa-4532-a4a7-d9499fba3279 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:15.349284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-94b8c261-42fa-4532-a4a7-d9499fba3279 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:15.355199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94b8c261-42fa-4532-a4a7-d9499fba3279 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:15.355655 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94b8c261-42fa-4532-a4a7-d9499fba3279 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:15.356458 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94b8c261-42fa-4532-a4a7-d9499fba3279 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:15.356897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94b8c261-42fa-4532-a4a7-d9499fba3279 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:15.484559 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-94b8c261-42fa-4532-a4a7-d9499fba3279 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:15.492299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-94b8c261-42fa-4532-a4a7-d9499fba3279 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.147427 Apr 07 13:19:15.492864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 718/1556] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:15 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:15.629279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d23c801f-de8b-4962-b7a4-12c85383ff60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:15.629881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d23c801f-de8b-4962-b7a4-12c85383ff60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:15.636223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d23c801f-de8b-4962-b7a4-12c85383ff60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:15.636674 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d23c801f-de8b-4962-b7a4-12c85383ff60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:15.637433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d23c801f-de8b-4962-b7a4-12c85383ff60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:15.637865 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d23c801f-de8b-4962-b7a4-12c85383ff60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:15.734991 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b38457e8-1f35-44a7-8f98-34203d33c2f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:15.735650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b38457e8-1f35-44a7-8f98-34203d33c2f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:15.741568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b38457e8-1f35-44a7-8f98-34203d33c2f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:15.742025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b38457e8-1f35-44a7-8f98-34203d33c2f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:15.742804 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b38457e8-1f35-44a7-8f98-34203d33c2f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:15.743245 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b38457e8-1f35-44a7-8f98-34203d33c2f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:15.770351 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d23c801f-de8b-4962-b7a4-12c85383ff60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:15.778086 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d23c801f-de8b-4962-b7a4-12c85383ff60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152687 Apr 07 13:19:15.778645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 839/1557] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:15 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:15.813151 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b38457e8-1f35-44a7-8f98-34203d33c2f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:15.821540 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b38457e8-1f35-44a7-8f98-34203d33c2f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:15.823039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b38457e8-1f35-44a7-8f98-34203d33c2f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:15.824232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b38457e8-1f35-44a7-8f98-34203d33c2f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.093270 Apr 07 13:19:15.824798 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 719/1558] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:15 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:16.509854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ad5c222e-9a63-47a9-9570-c4dcd6c85acd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:16.510470 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ad5c222e-9a63-47a9-9570-c4dcd6c85acd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:16.516575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ad5c222e-9a63-47a9-9570-c4dcd6c85acd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:16.517030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ad5c222e-9a63-47a9-9570-c4dcd6c85acd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:16.517793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ad5c222e-9a63-47a9-9570-c4dcd6c85acd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:16.518235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ad5c222e-9a63-47a9-9570-c4dcd6c85acd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:16.648183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ad5c222e-9a63-47a9-9570-c4dcd6c85acd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:16.656781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ad5c222e-9a63-47a9-9570-c4dcd6c85acd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150804 Apr 07 13:19:16.657347 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 840/1559] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:16 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:16.795237 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6115109a-d845-474e-8540-4eedebfc68f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:16.795862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6115109a-d845-474e-8540-4eedebfc68f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:16.802631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6115109a-d845-474e-8540-4eedebfc68f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:16.803099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6115109a-d845-474e-8540-4eedebfc68f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:16.803869 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6115109a-d845-474e-8540-4eedebfc68f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:16.804348 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6115109a-d845-474e-8540-4eedebfc68f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:16.842996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-636d5824-b492-4af1-a5bb-3bfdd8fe2ec2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:16.843775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-636d5824-b492-4af1-a5bb-3bfdd8fe2ec2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:16.849895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-636d5824-b492-4af1-a5bb-3bfdd8fe2ec2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:16.850365 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-636d5824-b492-4af1-a5bb-3bfdd8fe2ec2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:16.851114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-636d5824-b492-4af1-a5bb-3bfdd8fe2ec2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:16.851547 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-636d5824-b492-4af1-a5bb-3bfdd8fe2ec2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:16.911588 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-636d5824-b492-4af1-a5bb-3bfdd8fe2ec2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:16.919757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-636d5824-b492-4af1-a5bb-3bfdd8fe2ec2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:16.921293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-636d5824-b492-4af1-a5bb-3bfdd8fe2ec2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:16.922439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-636d5824-b492-4af1-a5bb-3bfdd8fe2ec2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084132 Apr 07 13:19:16.923004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 841/1560] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:16 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:16.937403 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6115109a-d845-474e-8540-4eedebfc68f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:16.945338 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6115109a-d845-474e-8540-4eedebfc68f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153939 Apr 07 13:19:16.945893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 720/1561] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:16 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:17.674644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-719a04e1-63c3-4fb8-be3e-17cd66aa9e14 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:17.675170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-719a04e1-63c3-4fb8-be3e-17cd66aa9e14 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:17.681628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-719a04e1-63c3-4fb8-be3e-17cd66aa9e14 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:17.682074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-719a04e1-63c3-4fb8-be3e-17cd66aa9e14 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:17.682835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-719a04e1-63c3-4fb8-be3e-17cd66aa9e14 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:17.683268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-719a04e1-63c3-4fb8-be3e-17cd66aa9e14 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:17.815631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-719a04e1-63c3-4fb8-be3e-17cd66aa9e14 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:17.823330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-719a04e1-63c3-4fb8-be3e-17cd66aa9e14 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152672 Apr 07 13:19:17.823885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 842/1562] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:17 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:17.940807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2d9647af-9a92-4f78-a4b6-a051901b7d0c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:17.941364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2d9647af-9a92-4f78-a4b6-a051901b7d0c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:17.947617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d9647af-9a92-4f78-a4b6-a051901b7d0c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:17.948064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d9647af-9a92-4f78-a4b6-a051901b7d0c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:17.948863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d9647af-9a92-4f78-a4b6-a051901b7d0c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:17.949299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d9647af-9a92-4f78-a4b6-a051901b7d0c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:17.962871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c32f69b1-411b-4b79-a30f-9eb010fe725f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:17.963490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c32f69b1-411b-4b79-a30f-9eb010fe725f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:17.969309 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c32f69b1-411b-4b79-a30f-9eb010fe725f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:17.969763 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c32f69b1-411b-4b79-a30f-9eb010fe725f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:17.970545 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c32f69b1-411b-4b79-a30f-9eb010fe725f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:17.970986 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c32f69b1-411b-4b79-a30f-9eb010fe725f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:18.009983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2d9647af-9a92-4f78-a4b6-a051901b7d0c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:18.020894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2d9647af-9a92-4f78-a4b6-a051901b7d0c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:18.022415 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2d9647af-9a92-4f78-a4b6-a051901b7d0c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:18.023556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2d9647af-9a92-4f78-a4b6-a051901b7d0c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086819 Apr 07 13:19:18.024108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 721/1563] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:17 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:18.101669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c32f69b1-411b-4b79-a30f-9eb010fe725f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:18.110174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c32f69b1-411b-4b79-a30f-9eb010fe725f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151345 Apr 07 13:19:18.110744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 843/1564] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:17 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:18.841607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2bf0cc56-9034-4f86-8476-839340393361 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:18.842656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2bf0cc56-9034-4f86-8476-839340393361 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:18.848505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2bf0cc56-9034-4f86-8476-839340393361 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:18.848947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2bf0cc56-9034-4f86-8476-839340393361 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:18.849705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2bf0cc56-9034-4f86-8476-839340393361 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:18.850134 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2bf0cc56-9034-4f86-8476-839340393361 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:18.984117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2bf0cc56-9034-4f86-8476-839340393361 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:18.991937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2bf0cc56-9034-4f86-8476-839340393361 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154218 Apr 07 13:19:18.992539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 722/1565] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:18 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:19.041707 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2309173a-4b51-4d4a-a7ac-8a38f38bbeee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:19.042315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2309173a-4b51-4d4a-a7ac-8a38f38bbeee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:19.048600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2309173a-4b51-4d4a-a7ac-8a38f38bbeee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:19.049043 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2309173a-4b51-4d4a-a7ac-8a38f38bbeee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:19.049823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2309173a-4b51-4d4a-a7ac-8a38f38bbeee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:19.050253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2309173a-4b51-4d4a-a7ac-8a38f38bbeee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:19.112095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2309173a-4b51-4d4a-a7ac-8a38f38bbeee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:19.120340 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2309173a-4b51-4d4a-a7ac-8a38f38bbeee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:19.121846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2309173a-4b51-4d4a-a7ac-8a38f38bbeee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:19.123000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2309173a-4b51-4d4a-a7ac-8a38f38bbeee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085076 Apr 07 13:19:19.123585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 844/1566] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:19 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:19.126840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-62b18978-dfcf-4e67-831e-35e6f4d297ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:19.127458 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-62b18978-dfcf-4e67-831e-35e6f4d297ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:19.133289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-62b18978-dfcf-4e67-831e-35e6f4d297ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:19.133742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-62b18978-dfcf-4e67-831e-35e6f4d297ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:19.134515 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-62b18978-dfcf-4e67-831e-35e6f4d297ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:19.134954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-62b18978-dfcf-4e67-831e-35e6f4d297ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:19.264865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-62b18978-dfcf-4e67-831e-35e6f4d297ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:19.272645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-62b18978-dfcf-4e67-831e-35e6f4d297ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149828 Apr 07 13:19:19.273217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 723/1567] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:19 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:20.009089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4d310978-7d9c-499c-bb5e-10e503881e28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:20.009729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4d310978-7d9c-499c-bb5e-10e503881e28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:20.015740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d310978-7d9c-499c-bb5e-10e503881e28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:20.016225 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d310978-7d9c-499c-bb5e-10e503881e28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:20.016998 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d310978-7d9c-499c-bb5e-10e503881e28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:20.017433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d310978-7d9c-499c-bb5e-10e503881e28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:20.140780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a522adc9-b5f8-4a8a-81fb-d95fa0710d35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:20.141394 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a522adc9-b5f8-4a8a-81fb-d95fa0710d35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:20.144685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4d310978-7d9c-499c-bb5e-10e503881e28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:20.148059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a522adc9-b5f8-4a8a-81fb-d95fa0710d35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:20.148571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a522adc9-b5f8-4a8a-81fb-d95fa0710d35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:20.149478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a522adc9-b5f8-4a8a-81fb-d95fa0710d35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:20.149929 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a522adc9-b5f8-4a8a-81fb-d95fa0710d35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:20.153031 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4d310978-7d9c-499c-bb5e-10e503881e28 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.147758 Apr 07 13:19:20.153593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 845/1568] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:20 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:20.209455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a522adc9-b5f8-4a8a-81fb-d95fa0710d35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:20.219017 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a522adc9-b5f8-4a8a-81fb-d95fa0710d35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:20.221914 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a522adc9-b5f8-4a8a-81fb-d95fa0710d35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:20.224090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a522adc9-b5f8-4a8a-81fb-d95fa0710d35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086883 Apr 07 13:19:20.225054 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 724/1569] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:20 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:20.290048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a1d7a8be-9518-4d33-b197-fd7d9804ce39 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:20.290592 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a1d7a8be-9518-4d33-b197-fd7d9804ce39 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:20.297126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a1d7a8be-9518-4d33-b197-fd7d9804ce39 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:20.297585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a1d7a8be-9518-4d33-b197-fd7d9804ce39 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:20.298351 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a1d7a8be-9518-4d33-b197-fd7d9804ce39 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:20.298788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a1d7a8be-9518-4d33-b197-fd7d9804ce39 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:20.431512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a1d7a8be-9518-4d33-b197-fd7d9804ce39 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:20.439632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a1d7a8be-9518-4d33-b197-fd7d9804ce39 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153560 Apr 07 13:19:20.440226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 846/1570] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:20 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:21.172514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-651551ec-83cd-4252-b92a-93f808c3474c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:21.173251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-651551ec-83cd-4252-b92a-93f808c3474c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:21.181520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-651551ec-83cd-4252-b92a-93f808c3474c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:21.182205 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-651551ec-83cd-4252-b92a-93f808c3474c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:21.183427 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-651551ec-83cd-4252-b92a-93f808c3474c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:21.184098 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-651551ec-83cd-4252-b92a-93f808c3474c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:21.246694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-50729e7e-9813-428b-b184-9d0bacf64d22 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:21.247306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-50729e7e-9813-428b-b184-9d0bacf64d22 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:21.254473 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50729e7e-9813-428b-b184-9d0bacf64d22 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:21.254924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50729e7e-9813-428b-b184-9d0bacf64d22 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:21.255818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50729e7e-9813-428b-b184-9d0bacf64d22 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:21.256292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50729e7e-9813-428b-b184-9d0bacf64d22 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:21.319007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-50729e7e-9813-428b-b184-9d0bacf64d22 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:21.319610 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-651551ec-83cd-4252-b92a-93f808c3474c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:21.327390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-50729e7e-9813-428b-b184-9d0bacf64d22 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:21.327600 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-651551ec-83cd-4252-b92a-93f808c3474c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.159646 Apr 07 13:19:21.328172 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 725/1571] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:21 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:21.328922 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-50729e7e-9813-428b-b184-9d0bacf64d22 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:21.330061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-50729e7e-9813-428b-b184-9d0bacf64d22 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087263 Apr 07 13:19:21.330608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 847/1572] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:21 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:21.456390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e1f1cf52-1f6e-4490-8057-b1baaa9789f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:21.456938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e1f1cf52-1f6e-4490-8057-b1baaa9789f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:21.462732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1f1cf52-1f6e-4490-8057-b1baaa9789f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:21.463182 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1f1cf52-1f6e-4490-8057-b1baaa9789f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:21.463942 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1f1cf52-1f6e-4490-8057-b1baaa9789f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:21.464406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1f1cf52-1f6e-4490-8057-b1baaa9789f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:21.602199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e1f1cf52-1f6e-4490-8057-b1baaa9789f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:21.611653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e1f1cf52-1f6e-4490-8057-b1baaa9789f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158801 Apr 07 13:19:21.612507 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 726/1573] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:21 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:22.345063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a34e2335-2b88-4d1d-9400-863e20b60a57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:22.345614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a34e2335-2b88-4d1d-9400-863e20b60a57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:22.346467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-94567741-ecf1-4cf7-8ba8-71bfa5b37437 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:22.347194 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-94567741-ecf1-4cf7-8ba8-71bfa5b37437 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:22.351624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a34e2335-2b88-4d1d-9400-863e20b60a57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:22.352172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a34e2335-2b88-4d1d-9400-863e20b60a57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:22.352951 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a34e2335-2b88-4d1d-9400-863e20b60a57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:22.353390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a34e2335-2b88-4d1d-9400-863e20b60a57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:22.353717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94567741-ecf1-4cf7-8ba8-71bfa5b37437 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:22.354179 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94567741-ecf1-4cf7-8ba8-71bfa5b37437 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:22.354956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94567741-ecf1-4cf7-8ba8-71bfa5b37437 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:22.355544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94567741-ecf1-4cf7-8ba8-71bfa5b37437 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:22.417253 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-94567741-ecf1-4cf7-8ba8-71bfa5b37437 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:22.425831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-94567741-ecf1-4cf7-8ba8-71bfa5b37437 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:22.427325 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-94567741-ecf1-4cf7-8ba8-71bfa5b37437 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:22.428497 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-94567741-ecf1-4cf7-8ba8-71bfa5b37437 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085787 Apr 07 13:19:22.429063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 727/1574] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:22.485801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a34e2335-2b88-4d1d-9400-863e20b60a57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:22.493540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a34e2335-2b88-4d1d-9400-863e20b60a57 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152742 Apr 07 13:19:22.494107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 848/1575] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:22 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:22.629396 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-81286c86-a398-4241-9560-f5e0afc64812 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:22.630060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-81286c86-a398-4241-9560-f5e0afc64812 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:22.635944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81286c86-a398-4241-9560-f5e0afc64812 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:22.636428 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81286c86-a398-4241-9560-f5e0afc64812 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:22.637192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81286c86-a398-4241-9560-f5e0afc64812 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:22.637624 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81286c86-a398-4241-9560-f5e0afc64812 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:22.769814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-81286c86-a398-4241-9560-f5e0afc64812 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:22.777640 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-81286c86-a398-4241-9560-f5e0afc64812 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152041 Apr 07 13:19:22.778214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 728/1576] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:22 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:23.448246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5bd51a44-de6a-4769-8699-e254eb3f9552 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:23.448855 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5bd51a44-de6a-4769-8699-e254eb3f9552 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:23.455191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bd51a44-de6a-4769-8699-e254eb3f9552 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:23.455638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bd51a44-de6a-4769-8699-e254eb3f9552 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:23.456416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bd51a44-de6a-4769-8699-e254eb3f9552 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:23.456846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bd51a44-de6a-4769-8699-e254eb3f9552 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:23.510832 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f1f852d0-06df-4cb4-b0d2-6e3b2df33c0d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:23.511446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f1f852d0-06df-4cb4-b0d2-6e3b2df33c0d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:23.515045 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5bd51a44-de6a-4769-8699-e254eb3f9552 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:23.518055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1f852d0-06df-4cb4-b0d2-6e3b2df33c0d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:23.518510 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1f852d0-06df-4cb4-b0d2-6e3b2df33c0d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:23.519282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1f852d0-06df-4cb4-b0d2-6e3b2df33c0d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:23.519722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1f852d0-06df-4cb4-b0d2-6e3b2df33c0d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:23.523338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5bd51a44-de6a-4769-8699-e254eb3f9552 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:23.524839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5bd51a44-de6a-4769-8699-e254eb3f9552 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:23.525998 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5bd51a44-de6a-4769-8699-e254eb3f9552 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081685 Apr 07 13:19:23.526557 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 849/1577] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:23 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:23.650095 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f1f852d0-06df-4cb4-b0d2-6e3b2df33c0d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:23.658282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f1f852d0-06df-4cb4-b0d2-6e3b2df33c0d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151305 Apr 07 13:19:23.658843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 729/1578] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:23 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:23.796450 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-04068eeb-8533-4216-852d-3e23ead8cd19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:23.796988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-04068eeb-8533-4216-852d-3e23ead8cd19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:23.802946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04068eeb-8533-4216-852d-3e23ead8cd19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:23.803396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04068eeb-8533-4216-852d-3e23ead8cd19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:23.804171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04068eeb-8533-4216-852d-3e23ead8cd19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:23.804612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04068eeb-8533-4216-852d-3e23ead8cd19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:23.935299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-04068eeb-8533-4216-852d-3e23ead8cd19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:23.943084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-04068eeb-8533-4216-852d-3e23ead8cd19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151296 Apr 07 13:19:23.943639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 850/1579] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:23 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:24.545984 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cbbc60eb-fec7-49ca-9e29-e0d3965b770c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:24.546658 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cbbc60eb-fec7-49ca-9e29-e0d3965b770c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:24.552957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cbbc60eb-fec7-49ca-9e29-e0d3965b770c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:24.553405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cbbc60eb-fec7-49ca-9e29-e0d3965b770c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:24.554164 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cbbc60eb-fec7-49ca-9e29-e0d3965b770c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:24.554629 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cbbc60eb-fec7-49ca-9e29-e0d3965b770c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:24.614302 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cbbc60eb-fec7-49ca-9e29-e0d3965b770c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:24.622481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cbbc60eb-fec7-49ca-9e29-e0d3965b770c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:24.623977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cbbc60eb-fec7-49ca-9e29-e0d3965b770c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:24.625149 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cbbc60eb-fec7-49ca-9e29-e0d3965b770c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084140 Apr 07 13:19:24.625695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 730/1580] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:24 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:24.675222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e04fce66-e7cc-4c71-9fbf-fbde79c8cd3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:24.675852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e04fce66-e7cc-4c71-9fbf-fbde79c8cd3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:24.682107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e04fce66-e7cc-4c71-9fbf-fbde79c8cd3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:24.682568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e04fce66-e7cc-4c71-9fbf-fbde79c8cd3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:24.683314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e04fce66-e7cc-4c71-9fbf-fbde79c8cd3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:24.683750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e04fce66-e7cc-4c71-9fbf-fbde79c8cd3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:24.812414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e04fce66-e7cc-4c71-9fbf-fbde79c8cd3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:24.820375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e04fce66-e7cc-4c71-9fbf-fbde79c8cd3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148887 Apr 07 13:19:24.820958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 851/1581] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:24 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:24.959955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4ca9f363-32a6-4c84-b312-7e5c8ffd8a5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:24.960602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4ca9f363-32a6-4c84-b312-7e5c8ffd8a5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:24.966557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ca9f363-32a6-4c84-b312-7e5c8ffd8a5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:24.967644 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ca9f363-32a6-4c84-b312-7e5c8ffd8a5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:24.968452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ca9f363-32a6-4c84-b312-7e5c8ffd8a5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:24.968892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ca9f363-32a6-4c84-b312-7e5c8ffd8a5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:25.310307 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4ca9f363-32a6-4c84-b312-7e5c8ffd8a5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:25.318670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4ca9f363-32a6-4c84-b312-7e5c8ffd8a5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.362551 Apr 07 13:19:25.319229 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 731/1582] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:24 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:25.643273 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8fc6b992-e44c-4cf0-9253-95fc9b911c4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:25.643887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8fc6b992-e44c-4cf0-9253-95fc9b911c4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:25.650030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fc6b992-e44c-4cf0-9253-95fc9b911c4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:25.650487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fc6b992-e44c-4cf0-9253-95fc9b911c4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:25.651265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fc6b992-e44c-4cf0-9253-95fc9b911c4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:25.651700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fc6b992-e44c-4cf0-9253-95fc9b911c4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:25.711872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8fc6b992-e44c-4cf0-9253-95fc9b911c4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:25.720160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8fc6b992-e44c-4cf0-9253-95fc9b911c4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:25.721668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8fc6b992-e44c-4cf0-9253-95fc9b911c4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:25.722801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8fc6b992-e44c-4cf0-9253-95fc9b911c4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083514 Apr 07 13:19:25.723355 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 852/1583] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:25 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:25.837560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-85dafcfa-cd03-4b7c-8b73-989028636283 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:25.838080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-85dafcfa-cd03-4b7c-8b73-989028636283 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:25.844867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-85dafcfa-cd03-4b7c-8b73-989028636283 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:25.845309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-85dafcfa-cd03-4b7c-8b73-989028636283 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:25.846065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-85dafcfa-cd03-4b7c-8b73-989028636283 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:25.846496 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-85dafcfa-cd03-4b7c-8b73-989028636283 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:25.974533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-85dafcfa-cd03-4b7c-8b73-989028636283 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:25.982282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-85dafcfa-cd03-4b7c-8b73-989028636283 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148619 Apr 07 13:19:25.983461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 732/1584] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:25 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:26.336299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9e93c5a9-9371-4120-8811-938ce95de0a7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:26.336935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9e93c5a9-9371-4120-8811-938ce95de0a7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:26.343235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e93c5a9-9371-4120-8811-938ce95de0a7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:26.343674 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e93c5a9-9371-4120-8811-938ce95de0a7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:26.344446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e93c5a9-9371-4120-8811-938ce95de0a7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:26.344880 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e93c5a9-9371-4120-8811-938ce95de0a7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:26.477451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9e93c5a9-9371-4120-8811-938ce95de0a7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:26.485504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9e93c5a9-9371-4120-8811-938ce95de0a7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153058 Apr 07 13:19:26.486061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 853/1585] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:26 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:26.741069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-24dff75d-91fc-419c-b139-d9f224b8ad3f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:26.741673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-24dff75d-91fc-419c-b139-d9f224b8ad3f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:26.747541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-24dff75d-91fc-419c-b139-d9f224b8ad3f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:26.748544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-24dff75d-91fc-419c-b139-d9f224b8ad3f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:26.749481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-24dff75d-91fc-419c-b139-d9f224b8ad3f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:26.749918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-24dff75d-91fc-419c-b139-d9f224b8ad3f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:26.809461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-24dff75d-91fc-419c-b139-d9f224b8ad3f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:26.818588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-24dff75d-91fc-419c-b139-d9f224b8ad3f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:26.820411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-24dff75d-91fc-419c-b139-d9f224b8ad3f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:26.821235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-24dff75d-91fc-419c-b139-d9f224b8ad3f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084012 Apr 07 13:19:26.821778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 733/1586] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:26 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:27.000618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-abe43dfb-a7b1-435f-86cb-8a21df262f7a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:27.001143 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-abe43dfb-a7b1-435f-86cb-8a21df262f7a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:27.007333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-abe43dfb-a7b1-435f-86cb-8a21df262f7a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:27.007778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-abe43dfb-a7b1-435f-86cb-8a21df262f7a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:27.008559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-abe43dfb-a7b1-435f-86cb-8a21df262f7a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:27.008988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-abe43dfb-a7b1-435f-86cb-8a21df262f7a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:27.139715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-abe43dfb-a7b1-435f-86cb-8a21df262f7a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:27.147405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-abe43dfb-a7b1-435f-86cb-8a21df262f7a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151752 Apr 07 13:19:27.147963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 854/1587] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:26 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:27.503342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e04d2fe1-7467-4c70-9c11-681b355666bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:27.503956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e04d2fe1-7467-4c70-9c11-681b355666bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:27.510286 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e04d2fe1-7467-4c70-9c11-681b355666bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:27.510743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e04d2fe1-7467-4c70-9c11-681b355666bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:27.511508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e04d2fe1-7467-4c70-9c11-681b355666bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:27.511947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e04d2fe1-7467-4c70-9c11-681b355666bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:27.650383 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e04d2fe1-7467-4c70-9c11-681b355666bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:27.658829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e04d2fe1-7467-4c70-9c11-681b355666bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.159319 Apr 07 13:19:27.659399 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 734/1588] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:27 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:27.840114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-da0507d1-9e9f-47b2-a678-674bf2c91013 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:27.840673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-da0507d1-9e9f-47b2-a678-674bf2c91013 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:27.847207 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da0507d1-9e9f-47b2-a678-674bf2c91013 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:27.847658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da0507d1-9e9f-47b2-a678-674bf2c91013 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:27.848443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da0507d1-9e9f-47b2-a678-674bf2c91013 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:27.848877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da0507d1-9e9f-47b2-a678-674bf2c91013 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:27.915953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-da0507d1-9e9f-47b2-a678-674bf2c91013 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:27.924746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-da0507d1-9e9f-47b2-a678-674bf2c91013 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:27.926227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-da0507d1-9e9f-47b2-a678-674bf2c91013 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:27.927358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-da0507d1-9e9f-47b2-a678-674bf2c91013 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.091293 Apr 07 13:19:27.927912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 855/1589] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:27 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:28.165310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eb58fca1-016f-4bd9-b4e0-226ea4a402a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:28.165929 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-eb58fca1-016f-4bd9-b4e0-226ea4a402a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:28.171722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb58fca1-016f-4bd9-b4e0-226ea4a402a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:28.172197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb58fca1-016f-4bd9-b4e0-226ea4a402a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:28.172969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb58fca1-016f-4bd9-b4e0-226ea4a402a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:28.173408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eb58fca1-016f-4bd9-b4e0-226ea4a402a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:28.302293 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eb58fca1-016f-4bd9-b4e0-226ea4a402a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:28.309998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eb58fca1-016f-4bd9-b4e0-226ea4a402a3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148645 Apr 07 13:19:28.310567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 735/1590] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:28 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:28.675827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-acc7002d-d4b9-4235-8927-667e7d5dc21a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:28.676461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-acc7002d-d4b9-4235-8927-667e7d5dc21a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:28.682924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-acc7002d-d4b9-4235-8927-667e7d5dc21a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:28.683372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-acc7002d-d4b9-4235-8927-667e7d5dc21a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:28.684195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-acc7002d-d4b9-4235-8927-667e7d5dc21a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:28.684634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-acc7002d-d4b9-4235-8927-667e7d5dc21a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:28.816553 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-acc7002d-d4b9-4235-8927-667e7d5dc21a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:28.824468 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-acc7002d-d4b9-4235-8927-667e7d5dc21a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152351 Apr 07 13:19:28.825048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 856/1591] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:28 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:28.949373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-de918371-18d6-4ec5-861c-48c694cc5674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:28.950011 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-de918371-18d6-4ec5-861c-48c694cc5674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:28.957329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-de918371-18d6-4ec5-861c-48c694cc5674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:28.957808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-de918371-18d6-4ec5-861c-48c694cc5674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:28.958565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-de918371-18d6-4ec5-861c-48c694cc5674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:28.959004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-de918371-18d6-4ec5-861c-48c694cc5674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:29.021516 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-de918371-18d6-4ec5-861c-48c694cc5674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:29.029631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-de918371-18d6-4ec5-861c-48c694cc5674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:29.031752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-de918371-18d6-4ec5-861c-48c694cc5674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:29.032926 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-de918371-18d6-4ec5-861c-48c694cc5674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087546 Apr 07 13:19:29.033475 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 736/1592] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:28 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:29.328027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-71768598-c4c1-4434-920b-c74a94a7ca10 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:29.328575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-71768598-c4c1-4434-920b-c74a94a7ca10 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:29.335230 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-71768598-c4c1-4434-920b-c74a94a7ca10 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:29.335676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-71768598-c4c1-4434-920b-c74a94a7ca10 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:29.336459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-71768598-c4c1-4434-920b-c74a94a7ca10 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:29.336894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-71768598-c4c1-4434-920b-c74a94a7ca10 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:29.464782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-71768598-c4c1-4434-920b-c74a94a7ca10 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:29.473036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-71768598-c4c1-4434-920b-c74a94a7ca10 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148944 Apr 07 13:19:29.473598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 857/1593] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:29 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:29.843401 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1cdc9f29-47bf-4148-9308-3bb9f4255c9c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:29.843941 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1cdc9f29-47bf-4148-9308-3bb9f4255c9c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:29.849878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1cdc9f29-47bf-4148-9308-3bb9f4255c9c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:29.850339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1cdc9f29-47bf-4148-9308-3bb9f4255c9c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:29.851111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1cdc9f29-47bf-4148-9308-3bb9f4255c9c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:29.851552 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1cdc9f29-47bf-4148-9308-3bb9f4255c9c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:29.978623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1cdc9f29-47bf-4148-9308-3bb9f4255c9c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:29.986642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1cdc9f29-47bf-4148-9308-3bb9f4255c9c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.147417 Apr 07 13:19:29.987211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 737/1594] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:29 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:30.050670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-14bb821c-94d5-4f61-a749-46334b2ecd95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:30.051279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-14bb821c-94d5-4f61-a749-46334b2ecd95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:30.057511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14bb821c-94d5-4f61-a749-46334b2ecd95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:30.057961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14bb821c-94d5-4f61-a749-46334b2ecd95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:30.058721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14bb821c-94d5-4f61-a749-46334b2ecd95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:30.059156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14bb821c-94d5-4f61-a749-46334b2ecd95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:30.117828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-14bb821c-94d5-4f61-a749-46334b2ecd95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:30.126710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-14bb821c-94d5-4f61-a749-46334b2ecd95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:30.128233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-14bb821c-94d5-4f61-a749-46334b2ecd95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:30.129399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-14bb821c-94d5-4f61-a749-46334b2ecd95 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082534 Apr 07 13:19:30.129961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 858/1595] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:30 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:30.490376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-677d0d40-c84d-4af0-a8a3-234c29c43409 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:30.490917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-677d0d40-c84d-4af0-a8a3-234c29c43409 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:30.496829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-677d0d40-c84d-4af0-a8a3-234c29c43409 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:30.497280 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-677d0d40-c84d-4af0-a8a3-234c29c43409 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:30.498046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-677d0d40-c84d-4af0-a8a3-234c29c43409 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:30.498487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-677d0d40-c84d-4af0-a8a3-234c29c43409 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:30.627083 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-677d0d40-c84d-4af0-a8a3-234c29c43409 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:30.634817 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-677d0d40-c84d-4af0-a8a3-234c29c43409 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148486 Apr 07 13:19:30.635375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 738/1596] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:30 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:31.003655 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d3593ec5-24b3-473a-9668-38de476cd7c9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:31.004332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d3593ec5-24b3-473a-9668-38de476cd7c9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:31.010251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d3593ec5-24b3-473a-9668-38de476cd7c9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:31.010689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d3593ec5-24b3-473a-9668-38de476cd7c9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:31.011445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d3593ec5-24b3-473a-9668-38de476cd7c9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:31.011882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d3593ec5-24b3-473a-9668-38de476cd7c9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:31.144886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d3593ec5-24b3-473a-9668-38de476cd7c9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:31.146894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cf1e04bc-38b7-49ab-85c4-07705bfb52c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:31.147514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cf1e04bc-38b7-49ab-85c4-07705bfb52c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:31.152784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d3593ec5-24b3-473a-9668-38de476cd7c9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152962 Apr 07 13:19:31.153359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 859/1597] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:30 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:31.153744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf1e04bc-38b7-49ab-85c4-07705bfb52c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:31.154205 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf1e04bc-38b7-49ab-85c4-07705bfb52c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:31.155569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf1e04bc-38b7-49ab-85c4-07705bfb52c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:31.156352 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf1e04bc-38b7-49ab-85c4-07705bfb52c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:31.218766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cf1e04bc-38b7-49ab-85c4-07705bfb52c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:31.226901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cf1e04bc-38b7-49ab-85c4-07705bfb52c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:31.228431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cf1e04bc-38b7-49ab-85c4-07705bfb52c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:31.229574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cf1e04bc-38b7-49ab-85c4-07705bfb52c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086516 Apr 07 13:19:31.230134 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 739/1598] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:31 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:31.650880 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a99634df-c87f-4994-8cbb-96b73e68e9f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:31.651598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a99634df-c87f-4994-8cbb-96b73e68e9f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:31.658257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a99634df-c87f-4994-8cbb-96b73e68e9f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:31.658815 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a99634df-c87f-4994-8cbb-96b73e68e9f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:31.659658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a99634df-c87f-4994-8cbb-96b73e68e9f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:31.660453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a99634df-c87f-4994-8cbb-96b73e68e9f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:31.792252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a99634df-c87f-4994-8cbb-96b73e68e9f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:31.800530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a99634df-c87f-4994-8cbb-96b73e68e9f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153573 Apr 07 13:19:31.801089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 860/1599] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:31 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:32.170308 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5f0ffc96-fccc-499f-9d6c-c155a2e7825e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:32.171778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5f0ffc96-fccc-499f-9d6c-c155a2e7825e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:32.178154 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f0ffc96-fccc-499f-9d6c-c155a2e7825e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:32.178649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f0ffc96-fccc-499f-9d6c-c155a2e7825e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:32.179409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f0ffc96-fccc-499f-9d6c-c155a2e7825e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:32.179842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f0ffc96-fccc-499f-9d6c-c155a2e7825e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:32.248304 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ef89e685-981f-4082-9b7a-d00291e5d983 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:32.249041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ef89e685-981f-4082-9b7a-d00291e5d983 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:32.255339 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef89e685-981f-4082-9b7a-d00291e5d983 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:32.255886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef89e685-981f-4082-9b7a-d00291e5d983 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:32.256763 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef89e685-981f-4082-9b7a-d00291e5d983 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:32.257272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef89e685-981f-4082-9b7a-d00291e5d983 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:32.311565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5f0ffc96-fccc-499f-9d6c-c155a2e7825e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:32.320380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5f0ffc96-fccc-499f-9d6c-c155a2e7825e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153852 Apr 07 13:19:32.320779 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ef89e685-981f-4082-9b7a-d00291e5d983 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:32.321164 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 740/1600] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:32 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:32.330495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ef89e685-981f-4082-9b7a-d00291e5d983 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:32.331979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ef89e685-981f-4082-9b7a-d00291e5d983 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:32.333145 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ef89e685-981f-4082-9b7a-d00291e5d983 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088733 Apr 07 13:19:32.333683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 861/1601] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:32 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:32.817801 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-50c554d4-0e22-4629-96ea-d2163d6872fc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:32.818435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-50c554d4-0e22-4629-96ea-d2163d6872fc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:32.824518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-50c554d4-0e22-4629-96ea-d2163d6872fc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:32.824975 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-50c554d4-0e22-4629-96ea-d2163d6872fc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:32.825747 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-50c554d4-0e22-4629-96ea-d2163d6872fc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:32.826186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-50c554d4-0e22-4629-96ea-d2163d6872fc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:32.955572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-50c554d4-0e22-4629-96ea-d2163d6872fc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:32.963346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-50c554d4-0e22-4629-96ea-d2163d6872fc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149335 Apr 07 13:19:32.963915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 741/1602] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:32 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:33.339052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9d96272e-e8a5-4b5d-816f-2c895080ad34 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:33.339595 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9d96272e-e8a5-4b5d-816f-2c895080ad34 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:33.346119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9d96272e-e8a5-4b5d-816f-2c895080ad34 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:33.346572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9d96272e-e8a5-4b5d-816f-2c895080ad34 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:33.347423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9d96272e-e8a5-4b5d-816f-2c895080ad34 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:33.347869 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9d96272e-e8a5-4b5d-816f-2c895080ad34 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:33.351906 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0a7116fe-b34f-48c4-a9a8-eb54c6f2e3e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:33.352558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0a7116fe-b34f-48c4-a9a8-eb54c6f2e3e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:33.358940 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a7116fe-b34f-48c4-a9a8-eb54c6f2e3e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:33.359402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a7116fe-b34f-48c4-a9a8-eb54c6f2e3e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:33.360201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a7116fe-b34f-48c4-a9a8-eb54c6f2e3e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:33.360641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a7116fe-b34f-48c4-a9a8-eb54c6f2e3e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:33.422690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0a7116fe-b34f-48c4-a9a8-eb54c6f2e3e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:33.430878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0a7116fe-b34f-48c4-a9a8-eb54c6f2e3e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:33.432400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0a7116fe-b34f-48c4-a9a8-eb54c6f2e3e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:33.433668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0a7116fe-b34f-48c4-a9a8-eb54c6f2e3e6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085572 Apr 07 13:19:33.434301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 742/1603] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:33 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:33.477140 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9d96272e-e8a5-4b5d-816f-2c895080ad34 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:33.485305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9d96272e-e8a5-4b5d-816f-2c895080ad34 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150671 Apr 07 13:19:33.485866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 862/1604] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:33 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:33.836394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:19:33.836653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:19:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:19:33.980764 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fedca0e9-a691-48ae-8817-cd0c275a7441 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:33.981374 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fedca0e9-a691-48ae-8817-cd0c275a7441 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:33.988364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fedca0e9-a691-48ae-8817-cd0c275a7441 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:33.988814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fedca0e9-a691-48ae-8817-cd0c275a7441 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:33.989578 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fedca0e9-a691-48ae-8817-cd0c275a7441 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:33.990013 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fedca0e9-a691-48ae-8817-cd0c275a7441 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:34.118011 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fedca0e9-a691-48ae-8817-cd0c275a7441 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:34.125823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fedca0e9-a691-48ae-8817-cd0c275a7441 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148977 Apr 07 13:19:34.126378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 743/1605] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:33 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:34.452725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8b4618fc-8c8c-4cb5-9c9c-c924175326fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:34.453272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8b4618fc-8c8c-4cb5-9c9c-c924175326fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:34.459173 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8b4618fc-8c8c-4cb5-9c9c-c924175326fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:34.459620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8b4618fc-8c8c-4cb5-9c9c-c924175326fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:34.460417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8b4618fc-8c8c-4cb5-9c9c-c924175326fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:34.460855 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8b4618fc-8c8c-4cb5-9c9c-c924175326fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:34.502272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c67c7f32-3906-41cd-a1d7-7fbc601c1629 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:34.502924 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c67c7f32-3906-41cd-a1d7-7fbc601c1629 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:34.508965 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c67c7f32-3906-41cd-a1d7-7fbc601c1629 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:34.509424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c67c7f32-3906-41cd-a1d7-7fbc601c1629 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:34.510209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c67c7f32-3906-41cd-a1d7-7fbc601c1629 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:34.510677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c67c7f32-3906-41cd-a1d7-7fbc601c1629 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:34.519642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8b4618fc-8c8c-4cb5-9c9c-c924175326fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:34.527938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8b4618fc-8c8c-4cb5-9c9c-c924175326fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:34.529521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8b4618fc-8c8c-4cb5-9c9c-c924175326fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:34.531872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8b4618fc-8c8c-4cb5-9c9c-c924175326fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084185 Apr 07 13:19:34.532445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 863/1606] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:34 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:34.643284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c67c7f32-3906-41cd-a1d7-7fbc601c1629 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:34.651199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c67c7f32-3906-41cd-a1d7-7fbc601c1629 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152855 Apr 07 13:19:34.651762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 744/1607] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:34 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:35.143088 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f8a22f9f-c3a2-4abf-9a49-65b0bc2add86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:35.143694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f8a22f9f-c3a2-4abf-9a49-65b0bc2add86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:35.149510 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8a22f9f-c3a2-4abf-9a49-65b0bc2add86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:35.149958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8a22f9f-c3a2-4abf-9a49-65b0bc2add86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:35.150786 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8a22f9f-c3a2-4abf-9a49-65b0bc2add86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:35.151223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8a22f9f-c3a2-4abf-9a49-65b0bc2add86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:35.284894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f8a22f9f-c3a2-4abf-9a49-65b0bc2add86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:35.292751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f8a22f9f-c3a2-4abf-9a49-65b0bc2add86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153705 Apr 07 13:19:35.293305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 864/1608] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:35 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:35.551304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0bea848d-dfa0-4e7d-81fe-1684569f9bd8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:35.551849 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0bea848d-dfa0-4e7d-81fe-1684569f9bd8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:35.560035 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0bea848d-dfa0-4e7d-81fe-1684569f9bd8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:35.560646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0bea848d-dfa0-4e7d-81fe-1684569f9bd8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:35.562119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0bea848d-dfa0-4e7d-81fe-1684569f9bd8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:35.562629 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0bea848d-dfa0-4e7d-81fe-1684569f9bd8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:35.626544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0bea848d-dfa0-4e7d-81fe-1684569f9bd8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:35.634617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0bea848d-dfa0-4e7d-81fe-1684569f9bd8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:35.636100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0bea848d-dfa0-4e7d-81fe-1684569f9bd8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:35.637254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0bea848d-dfa0-4e7d-81fe-1684569f9bd8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.089963 Apr 07 13:19:35.637815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 745/1609] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:35 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:35.668852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-02b9d85d-096f-4027-b941-7acbf47e7d83 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:35.669490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-02b9d85d-096f-4027-b941-7acbf47e7d83 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:35.676627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02b9d85d-096f-4027-b941-7acbf47e7d83 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:35.677072 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02b9d85d-096f-4027-b941-7acbf47e7d83 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:35.677831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02b9d85d-096f-4027-b941-7acbf47e7d83 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:35.678258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02b9d85d-096f-4027-b941-7acbf47e7d83 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:35.809978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-02b9d85d-096f-4027-b941-7acbf47e7d83 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:35.817870 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-02b9d85d-096f-4027-b941-7acbf47e7d83 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152793 Apr 07 13:19:35.818426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 865/1610] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:35 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:36.310769 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1e1ea4a5-7810-4cd4-8314-3eac8c083f12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:36.311921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1e1ea4a5-7810-4cd4-8314-3eac8c083f12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:36.317853 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e1ea4a5-7810-4cd4-8314-3eac8c083f12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:36.318297 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e1ea4a5-7810-4cd4-8314-3eac8c083f12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:36.319055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e1ea4a5-7810-4cd4-8314-3eac8c083f12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:36.319484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e1ea4a5-7810-4cd4-8314-3eac8c083f12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:36.449657 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1e1ea4a5-7810-4cd4-8314-3eac8c083f12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:36.457960 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1e1ea4a5-7810-4cd4-8314-3eac8c083f12 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150994 Apr 07 13:19:36.458566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 746/1611] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:36 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:36.500699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:19:36.500929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:19:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:19:36.654852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-504f878b-9f0a-4196-a792-bd1a10baf85c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:36.655513 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-504f878b-9f0a-4196-a792-bd1a10baf85c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:36.661698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-504f878b-9f0a-4196-a792-bd1a10baf85c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:36.662156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-504f878b-9f0a-4196-a792-bd1a10baf85c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:36.662914 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-504f878b-9f0a-4196-a792-bd1a10baf85c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:36.663355 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-504f878b-9f0a-4196-a792-bd1a10baf85c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:36.721058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-504f878b-9f0a-4196-a792-bd1a10baf85c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:36.729109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-504f878b-9f0a-4196-a792-bd1a10baf85c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:36.730603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-504f878b-9f0a-4196-a792-bd1a10baf85c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:36.731728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-504f878b-9f0a-4196-a792-bd1a10baf85c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.080851 Apr 07 13:19:36.732315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 866/1612] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:36 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:36.835367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1eea85a8-b555-435d-a457-b8ebb5bce16b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:36.835931 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1eea85a8-b555-435d-a457-b8ebb5bce16b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:36.843558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1eea85a8-b555-435d-a457-b8ebb5bce16b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:36.844009 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1eea85a8-b555-435d-a457-b8ebb5bce16b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:36.844822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1eea85a8-b555-435d-a457-b8ebb5bce16b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:36.845256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1eea85a8-b555-435d-a457-b8ebb5bce16b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:36.981139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1eea85a8-b555-435d-a457-b8ebb5bce16b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:36.989973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1eea85a8-b555-435d-a457-b8ebb5bce16b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158518 Apr 07 13:19:36.990533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 747/1613] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:36 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:37.475068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-27b94259-6139-498b-894f-110d594de03d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:37.475701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-27b94259-6139-498b-894f-110d594de03d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:37.481578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27b94259-6139-498b-894f-110d594de03d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:37.482020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27b94259-6139-498b-894f-110d594de03d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:37.482892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27b94259-6139-498b-894f-110d594de03d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:37.483864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27b94259-6139-498b-894f-110d594de03d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:37.618543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-27b94259-6139-498b-894f-110d594de03d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:37.626757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-27b94259-6139-498b-894f-110d594de03d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.155501 Apr 07 13:19:37.627326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 867/1614] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:37 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:37.751029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6d4ea73f-5e38-46b1-894a-efb4f394561d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:37.751585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6d4ea73f-5e38-46b1-894a-efb4f394561d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:37.757374 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6d4ea73f-5e38-46b1-894a-efb4f394561d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:37.757818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6d4ea73f-5e38-46b1-894a-efb4f394561d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:37.758574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6d4ea73f-5e38-46b1-894a-efb4f394561d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:37.759010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6d4ea73f-5e38-46b1-894a-efb4f394561d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:37.823222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6d4ea73f-5e38-46b1-894a-efb4f394561d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:37.831821 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6d4ea73f-5e38-46b1-894a-efb4f394561d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:37.833343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6d4ea73f-5e38-46b1-894a-efb4f394561d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:37.834484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6d4ea73f-5e38-46b1-894a-efb4f394561d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088098 Apr 07 13:19:37.835034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 748/1615] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:37 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:38.006975 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-48c86ba4-5e04-4203-bcb0-91fd1aece0bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:38.007518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-48c86ba4-5e04-4203-bcb0-91fd1aece0bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:38.013724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-48c86ba4-5e04-4203-bcb0-91fd1aece0bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:38.014247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-48c86ba4-5e04-4203-bcb0-91fd1aece0bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:38.015079 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-48c86ba4-5e04-4203-bcb0-91fd1aece0bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:38.015517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-48c86ba4-5e04-4203-bcb0-91fd1aece0bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:38.143894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-48c86ba4-5e04-4203-bcb0-91fd1aece0bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:38.151884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-48c86ba4-5e04-4203-bcb0-91fd1aece0bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.148781 Apr 07 13:19:38.152486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 868/1616] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:38 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:38.644431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9c50b744-3e65-411b-8853-8800bd90caf6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:38.645073 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9c50b744-3e65-411b-8853-8800bd90caf6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:38.651374 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c50b744-3e65-411b-8853-8800bd90caf6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:38.651854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c50b744-3e65-411b-8853-8800bd90caf6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:38.652649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c50b744-3e65-411b-8853-8800bd90caf6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:38.653086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c50b744-3e65-411b-8853-8800bd90caf6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:38.782497 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9c50b744-3e65-411b-8853-8800bd90caf6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:38.790439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9c50b744-3e65-411b-8853-8800bd90caf6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149899 Apr 07 13:19:38.790998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 749/1617] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:38 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:38.852608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4a572cb9-e3b6-4ca0-b179-39f9841e412f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:38.853216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4a572cb9-e3b6-4ca0-b179-39f9841e412f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:38.859123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a572cb9-e3b6-4ca0-b179-39f9841e412f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:38.859571 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a572cb9-e3b6-4ca0-b179-39f9841e412f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:38.860363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a572cb9-e3b6-4ca0-b179-39f9841e412f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:38.860801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a572cb9-e3b6-4ca0-b179-39f9841e412f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:38.920211 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4a572cb9-e3b6-4ca0-b179-39f9841e412f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:38.928320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4a572cb9-e3b6-4ca0-b179-39f9841e412f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:38.929811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4a572cb9-e3b6-4ca0-b179-39f9841e412f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:38.930943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4a572cb9-e3b6-4ca0-b179-39f9841e412f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082225 Apr 07 13:19:38.931490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 869/1618] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:38 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:39.171389 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-054b4fd0-91d2-49c6-be1f-ac3e0e795142 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:39.171938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-054b4fd0-91d2-49c6-be1f-ac3e0e795142 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:39.177895 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-054b4fd0-91d2-49c6-be1f-ac3e0e795142 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:39.178349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-054b4fd0-91d2-49c6-be1f-ac3e0e795142 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:39.179112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-054b4fd0-91d2-49c6-be1f-ac3e0e795142 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:39.179550 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-054b4fd0-91d2-49c6-be1f-ac3e0e795142 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:39.307974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-054b4fd0-91d2-49c6-be1f-ac3e0e795142 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:39.315940 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-054b4fd0-91d2-49c6-be1f-ac3e0e795142 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149036 Apr 07 13:19:39.316532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 750/1619] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:39 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:39.807598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a77accac-b009-42a1-bc81-81b6d7e195ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:39.808258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a77accac-b009-42a1-bc81-81b6d7e195ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:39.815485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a77accac-b009-42a1-bc81-81b6d7e195ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:39.815929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a77accac-b009-42a1-bc81-81b6d7e195ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:39.816749 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a77accac-b009-42a1-bc81-81b6d7e195ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:39.817181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a77accac-b009-42a1-bc81-81b6d7e195ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:39.949303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e52d6368-cfaf-43fd-8047-75419726fa1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:39.949916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e52d6368-cfaf-43fd-8047-75419726fa1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:39.956221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e52d6368-cfaf-43fd-8047-75419726fa1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:39.956369 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a77accac-b009-42a1-bc81-81b6d7e195ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:39.956681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e52d6368-cfaf-43fd-8047-75419726fa1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:39.957494 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e52d6368-cfaf-43fd-8047-75419726fa1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:39.957937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e52d6368-cfaf-43fd-8047-75419726fa1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:39.964134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a77accac-b009-42a1-bc81-81b6d7e195ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.160420 Apr 07 13:19:39.964725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 870/1620] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:39 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:40.019545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e52d6368-cfaf-43fd-8047-75419726fa1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:40.027733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e52d6368-cfaf-43fd-8047-75419726fa1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:40.029261 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e52d6368-cfaf-43fd-8047-75419726fa1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:40.030490 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e52d6368-cfaf-43fd-8047-75419726fa1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085149 Apr 07 13:19:40.031046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 751/1621] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:39 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:40.333075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c53b54c4-ef31-4868-963d-f2ac1eee381f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:40.333602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c53b54c4-ef31-4868-963d-f2ac1eee381f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:40.339502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c53b54c4-ef31-4868-963d-f2ac1eee381f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:40.339947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c53b54c4-ef31-4868-963d-f2ac1eee381f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:40.340732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c53b54c4-ef31-4868-963d-f2ac1eee381f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:40.341160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c53b54c4-ef31-4868-963d-f2ac1eee381f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:40.473089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c53b54c4-ef31-4868-963d-f2ac1eee381f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:40.480827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c53b54c4-ef31-4868-963d-f2ac1eee381f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151696 Apr 07 13:19:40.481377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 871/1622] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:40 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:40.981240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-973b15fe-8fc5-4c53-a552-b5b516bfd16c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:40.981854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-973b15fe-8fc5-4c53-a552-b5b516bfd16c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:40.988167 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-973b15fe-8fc5-4c53-a552-b5b516bfd16c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:40.988638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-973b15fe-8fc5-4c53-a552-b5b516bfd16c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:40.989402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-973b15fe-8fc5-4c53-a552-b5b516bfd16c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:40.989843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-973b15fe-8fc5-4c53-a552-b5b516bfd16c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:41.049084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d83262d3-9587-44c0-b65b-ca899dfcbae0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:41.049791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d83262d3-9587-44c0-b65b-ca899dfcbae0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:41.056236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d83262d3-9587-44c0-b65b-ca899dfcbae0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:41.056764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d83262d3-9587-44c0-b65b-ca899dfcbae0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:41.057631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d83262d3-9587-44c0-b65b-ca899dfcbae0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:41.058067 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d83262d3-9587-44c0-b65b-ca899dfcbae0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:41.118445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d83262d3-9587-44c0-b65b-ca899dfcbae0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:41.127159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d83262d3-9587-44c0-b65b-ca899dfcbae0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:41.128689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d83262d3-9587-44c0-b65b-ca899dfcbae0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:41.129836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d83262d3-9587-44c0-b65b-ca899dfcbae0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085035 Apr 07 13:19:41.130387 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 872/1623] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:41 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:41.132019 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-973b15fe-8fc5-4c53-a552-b5b516bfd16c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:41.140681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-973b15fe-8fc5-4c53-a552-b5b516bfd16c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.163280 Apr 07 13:19:41.141233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 752/1624] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:40 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:41.498163 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-438f2b65-9808-4822-9a79-a7a19992d2ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:41.499455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-438f2b65-9808-4822-9a79-a7a19992d2ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:41.505169 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-438f2b65-9808-4822-9a79-a7a19992d2ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:41.505620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-438f2b65-9808-4822-9a79-a7a19992d2ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:41.506418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-438f2b65-9808-4822-9a79-a7a19992d2ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:41.506858 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-438f2b65-9808-4822-9a79-a7a19992d2ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:41.638848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-438f2b65-9808-4822-9a79-a7a19992d2ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:41.646480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-438f2b65-9808-4822-9a79-a7a19992d2ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152190 Apr 07 13:19:41.647038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 873/1625] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:41 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:42.148272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-02bbbcf9-9660-440e-87af-928da329b316 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:42.148888 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-02bbbcf9-9660-440e-87af-928da329b316 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:42.155773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-02bbbcf9-9660-440e-87af-928da329b316 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:42.156253 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-02bbbcf9-9660-440e-87af-928da329b316 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:42.157025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-02bbbcf9-9660-440e-87af-928da329b316 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:42.157472 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-02bbbcf9-9660-440e-87af-928da329b316 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:42.157786 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e7eb77df-8d3d-4d04-be72-aa8f61895b3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:42.158409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e7eb77df-8d3d-4d04-be72-aa8f61895b3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:42.164969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e7eb77df-8d3d-4d04-be72-aa8f61895b3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:42.165421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e7eb77df-8d3d-4d04-be72-aa8f61895b3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:42.166188 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e7eb77df-8d3d-4d04-be72-aa8f61895b3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:42.166626 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e7eb77df-8d3d-4d04-be72-aa8f61895b3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:42.218010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-02bbbcf9-9660-440e-87af-928da329b316 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:42.226521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-02bbbcf9-9660-440e-87af-928da329b316 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:42.228018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-02bbbcf9-9660-440e-87af-928da329b316 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:42.229198 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-02bbbcf9-9660-440e-87af-928da329b316 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084853 Apr 07 13:19:42.229763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 753/1626] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:42 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:42.296096 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e7eb77df-8d3d-4d04-be72-aa8f61895b3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:42.303793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e7eb77df-8d3d-4d04-be72-aa8f61895b3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150388 Apr 07 13:19:42.304381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 874/1627] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:42 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:42.663759 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e66d7dd6-b348-4b31-b23f-1c0d4ccce7c0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:42.664407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e66d7dd6-b348-4b31-b23f-1c0d4ccce7c0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:42.670385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e66d7dd6-b348-4b31-b23f-1c0d4ccce7c0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:42.670960 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e66d7dd6-b348-4b31-b23f-1c0d4ccce7c0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:42.671577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e66d7dd6-b348-4b31-b23f-1c0d4ccce7c0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:42.672009 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e66d7dd6-b348-4b31-b23f-1c0d4ccce7c0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:42.804616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e66d7dd6-b348-4b31-b23f-1c0d4ccce7c0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:42.813042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e66d7dd6-b348-4b31-b23f-1c0d4ccce7c0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153393 Apr 07 13:19:42.813611 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 754/1628] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:42 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:43.247305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c0e017d1-ea4b-419d-b69d-8a72bff13716 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:43.247887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c0e017d1-ea4b-419d-b69d-8a72bff13716 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:43.254527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c0e017d1-ea4b-419d-b69d-8a72bff13716 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:43.254973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c0e017d1-ea4b-419d-b69d-8a72bff13716 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:43.255721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c0e017d1-ea4b-419d-b69d-8a72bff13716 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:43.256162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c0e017d1-ea4b-419d-b69d-8a72bff13716 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:43.317807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c0e017d1-ea4b-419d-b69d-8a72bff13716 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:43.320598 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a16065e2-7cac-4f04-9663-3f32b23d1819 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:43.321223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a16065e2-7cac-4f04-9663-3f32b23d1819 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:43.326081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c0e017d1-ea4b-419d-b69d-8a72bff13716 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:43.328047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a16065e2-7cac-4f04-9663-3f32b23d1819 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:43.328285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c0e017d1-ea4b-419d-b69d-8a72bff13716 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:43.328533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a16065e2-7cac-4f04-9663-3f32b23d1819 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:43.329305 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a16065e2-7cac-4f04-9663-3f32b23d1819 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:43.329421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c0e017d1-ea4b-419d-b69d-8a72bff13716 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085964 Apr 07 13:19:43.329745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a16065e2-7cac-4f04-9663-3f32b23d1819 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:43.329949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 875/1629] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:43 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:43.409831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:19:43.410055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:19:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c (ip 10.222.0.15) !!! Apr 07 13:19:43.461009 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a16065e2-7cac-4f04-9663-3f32b23d1819 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:43.468812 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a16065e2-7cac-4f04-9663-3f32b23d1819 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152021 Apr 07 13:19:43.469373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 755/1630] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:43 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:43.830126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-810597f5-99f9-498b-9b9e-c76f2d31fb1a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:43.830739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-810597f5-99f9-498b-9b9e-c76f2d31fb1a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:43.836726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-810597f5-99f9-498b-9b9e-c76f2d31fb1a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:43.837120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-810597f5-99f9-498b-9b9e-c76f2d31fb1a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:43.837876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-810597f5-99f9-498b-9b9e-c76f2d31fb1a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:43.838314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-810597f5-99f9-498b-9b9e-c76f2d31fb1a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:43.967590 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-810597f5-99f9-498b-9b9e-c76f2d31fb1a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:43.975457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-810597f5-99f9-498b-9b9e-c76f2d31fb1a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149242 Apr 07 13:19:43.976020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 876/1631] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:43 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:44.347593 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c8888a02-0d04-4a87-8ce1-f97353bd7eaf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:44.348237 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c8888a02-0d04-4a87-8ce1-f97353bd7eaf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:44.354731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8888a02-0d04-4a87-8ce1-f97353bd7eaf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:44.355177 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8888a02-0d04-4a87-8ce1-f97353bd7eaf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:44.355969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8888a02-0d04-4a87-8ce1-f97353bd7eaf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:44.356439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8888a02-0d04-4a87-8ce1-f97353bd7eaf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:44.417033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c8888a02-0d04-4a87-8ce1-f97353bd7eaf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:44.426379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c8888a02-0d04-4a87-8ce1-f97353bd7eaf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:44.428005 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c8888a02-0d04-4a87-8ce1-f97353bd7eaf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:44.429194 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c8888a02-0d04-4a87-8ce1-f97353bd7eaf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085760 Apr 07 13:19:44.429748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 756/1632] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:44 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:44.485888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-089ff3ef-904f-4a47-9960-55ba4d1466f4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:44.486495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-089ff3ef-904f-4a47-9960-55ba4d1466f4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:44.492880 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-089ff3ef-904f-4a47-9960-55ba4d1466f4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:44.493325 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-089ff3ef-904f-4a47-9960-55ba4d1466f4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:44.494076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-089ff3ef-904f-4a47-9960-55ba4d1466f4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:44.494515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-089ff3ef-904f-4a47-9960-55ba4d1466f4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:44.624398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-089ff3ef-904f-4a47-9960-55ba4d1466f4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:44.632170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-089ff3ef-904f-4a47-9960-55ba4d1466f4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150676 Apr 07 13:19:44.632743 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 877/1633] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:44 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:44.993315 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-06e4193b-7f6b-4bcd-94ad-c204aec527f4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:44.993851 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-06e4193b-7f6b-4bcd-94ad-c204aec527f4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:44.999918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06e4193b-7f6b-4bcd-94ad-c204aec527f4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:45.000398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06e4193b-7f6b-4bcd-94ad-c204aec527f4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:45.001165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06e4193b-7f6b-4bcd-94ad-c204aec527f4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:45.001604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06e4193b-7f6b-4bcd-94ad-c204aec527f4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:45.132347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-06e4193b-7f6b-4bcd-94ad-c204aec527f4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:45.140839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-06e4193b-7f6b-4bcd-94ad-c204aec527f4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151440 Apr 07 13:19:45.141403 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 757/1634] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:44 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:45.447940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-889608aa-ce5c-45bb-9d92-8f1b59328f82 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:45.448614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-889608aa-ce5c-45bb-9d92-8f1b59328f82 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:45.454864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-889608aa-ce5c-45bb-9d92-8f1b59328f82 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:45.455307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-889608aa-ce5c-45bb-9d92-8f1b59328f82 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:45.456493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-889608aa-ce5c-45bb-9d92-8f1b59328f82 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:45.456935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-889608aa-ce5c-45bb-9d92-8f1b59328f82 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:45.517614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-889608aa-ce5c-45bb-9d92-8f1b59328f82 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:45.525860 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-889608aa-ce5c-45bb-9d92-8f1b59328f82 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:45.527346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-889608aa-ce5c-45bb-9d92-8f1b59328f82 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:45.528498 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-889608aa-ce5c-45bb-9d92-8f1b59328f82 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084412 Apr 07 13:19:45.529055 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 878/1635] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:45 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:45.649036 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2d411a7d-28d1-419a-8461-ba40ec8a6072 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:45.649655 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2d411a7d-28d1-419a-8461-ba40ec8a6072 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:45.655937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d411a7d-28d1-419a-8461-ba40ec8a6072 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:45.656419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d411a7d-28d1-419a-8461-ba40ec8a6072 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:45.657187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d411a7d-28d1-419a-8461-ba40ec8a6072 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:45.657627 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d411a7d-28d1-419a-8461-ba40ec8a6072 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:45.786956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2d411a7d-28d1-419a-8461-ba40ec8a6072 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:45.794859 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2d411a7d-28d1-419a-8461-ba40ec8a6072 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149659 Apr 07 13:19:45.795550 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 758/1636] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:45 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:46.157930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a4c248f8-7331-4eff-8e61-0ae3e3cb476e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:46.158540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a4c248f8-7331-4eff-8e61-0ae3e3cb476e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:46.164688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a4c248f8-7331-4eff-8e61-0ae3e3cb476e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:46.165134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a4c248f8-7331-4eff-8e61-0ae3e3cb476e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:46.165886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a4c248f8-7331-4eff-8e61-0ae3e3cb476e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:46.166309 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a4c248f8-7331-4eff-8e61-0ae3e3cb476e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:46.296385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a4c248f8-7331-4eff-8e61-0ae3e3cb476e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:46.304036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a4c248f8-7331-4eff-8e61-0ae3e3cb476e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149946 Apr 07 13:19:46.304623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 879/1637] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:46 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:46.547373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9c8b6ff2-3b21-434b-b063-9b1edcf91569 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:46.547900 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9c8b6ff2-3b21-434b-b063-9b1edcf91569 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:46.553753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c8b6ff2-3b21-434b-b063-9b1edcf91569 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:46.554206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c8b6ff2-3b21-434b-b063-9b1edcf91569 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:46.554970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c8b6ff2-3b21-434b-b063-9b1edcf91569 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:46.555405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c8b6ff2-3b21-434b-b063-9b1edcf91569 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:46.613615 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9c8b6ff2-3b21-434b-b063-9b1edcf91569 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:46.621693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9c8b6ff2-3b21-434b-b063-9b1edcf91569 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:46.623189 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9c8b6ff2-3b21-434b-b063-9b1edcf91569 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:46.625000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9c8b6ff2-3b21-434b-b063-9b1edcf91569 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081690 Apr 07 13:19:46.625551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 759/1638] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:46 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:46.812049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-56d49f52-69ca-479c-a705-38b8b02094d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:46.812610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-56d49f52-69ca-479c-a705-38b8b02094d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:46.818889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56d49f52-69ca-479c-a705-38b8b02094d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:46.819336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56d49f52-69ca-479c-a705-38b8b02094d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:46.820095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56d49f52-69ca-479c-a705-38b8b02094d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:46.820558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56d49f52-69ca-479c-a705-38b8b02094d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:46.951170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-56d49f52-69ca-479c-a705-38b8b02094d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:46.959850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-56d49f52-69ca-479c-a705-38b8b02094d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152208 Apr 07 13:19:46.960428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 880/1639] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:46 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:47.321576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b3d0c384-c489-490a-88b0-7296270822ce tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:47.322226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b3d0c384-c489-490a-88b0-7296270822ce tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:47.329644 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3d0c384-c489-490a-88b0-7296270822ce tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:47.330096 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3d0c384-c489-490a-88b0-7296270822ce tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:47.330865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3d0c384-c489-490a-88b0-7296270822ce tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:47.331304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3d0c384-c489-490a-88b0-7296270822ce tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:47.464132 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b3d0c384-c489-490a-88b0-7296270822ce tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:47.471934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b3d0c384-c489-490a-88b0-7296270822ce tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154178 Apr 07 13:19:47.472533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 760/1640] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:47 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:47.642683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1305e54d-964b-4d39-b825-7e7e97599293 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:47.643291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1305e54d-964b-4d39-b825-7e7e97599293 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:47.649133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1305e54d-964b-4d39-b825-7e7e97599293 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:47.649584 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1305e54d-964b-4d39-b825-7e7e97599293 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:47.650342 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1305e54d-964b-4d39-b825-7e7e97599293 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:47.650778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1305e54d-964b-4d39-b825-7e7e97599293 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:47.714847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1305e54d-964b-4d39-b825-7e7e97599293 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:47.723773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1305e54d-964b-4d39-b825-7e7e97599293 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:47.725297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1305e54d-964b-4d39-b825-7e7e97599293 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:47.726436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1305e54d-964b-4d39-b825-7e7e97599293 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088391 Apr 07 13:19:47.726996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 881/1641] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:47 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:47.977713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4b3059cb-87cb-4107-a880-bd9018b5a39f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:47.978325 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4b3059cb-87cb-4107-a880-bd9018b5a39f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:47.984935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b3059cb-87cb-4107-a880-bd9018b5a39f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:47.985386 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b3059cb-87cb-4107-a880-bd9018b5a39f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:47.986157 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b3059cb-87cb-4107-a880-bd9018b5a39f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:47.986594 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b3059cb-87cb-4107-a880-bd9018b5a39f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:48.116820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4b3059cb-87cb-4107-a880-bd9018b5a39f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:48.124553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4b3059cb-87cb-4107-a880-bd9018b5a39f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150693 Apr 07 13:19:48.125115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 761/1642] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:47 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:48.489000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c08e63ca-ccea-488b-8894-45d49ad36dec tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:48.489734 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c08e63ca-ccea-488b-8894-45d49ad36dec tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:48.496346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c08e63ca-ccea-488b-8894-45d49ad36dec tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:48.496793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c08e63ca-ccea-488b-8894-45d49ad36dec tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:48.497549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c08e63ca-ccea-488b-8894-45d49ad36dec tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:48.497985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c08e63ca-ccea-488b-8894-45d49ad36dec tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:48.627820 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c08e63ca-ccea-488b-8894-45d49ad36dec tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:48.635608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c08e63ca-ccea-488b-8894-45d49ad36dec tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150499 Apr 07 13:19:48.636184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 882/1643] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:48 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:48.744493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-163a8f91-1a71-4b6b-8909-5fd4185a88bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:48.745027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-163a8f91-1a71-4b6b-8909-5fd4185a88bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:48.752187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-163a8f91-1a71-4b6b-8909-5fd4185a88bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:48.752639 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-163a8f91-1a71-4b6b-8909-5fd4185a88bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:48.753399 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-163a8f91-1a71-4b6b-8909-5fd4185a88bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:48.753831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-163a8f91-1a71-4b6b-8909-5fd4185a88bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:48.812857 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-163a8f91-1a71-4b6b-8909-5fd4185a88bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:48.821189 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-163a8f91-1a71-4b6b-8909-5fd4185a88bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:48.822719 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-163a8f91-1a71-4b6b-8909-5fd4185a88bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:48.823899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-163a8f91-1a71-4b6b-8909-5fd4185a88bc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083363 Apr 07 13:19:48.824499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 762/1644] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:48 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:49.141823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4f24cc93-4668-4c98-8da6-e1e5f5d3dca3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:49.142444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4f24cc93-4668-4c98-8da6-e1e5f5d3dca3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:49.148271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f24cc93-4668-4c98-8da6-e1e5f5d3dca3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:49.148725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f24cc93-4668-4c98-8da6-e1e5f5d3dca3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:49.149487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f24cc93-4668-4c98-8da6-e1e5f5d3dca3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:49.149923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f24cc93-4668-4c98-8da6-e1e5f5d3dca3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:49.279051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4f24cc93-4668-4c98-8da6-e1e5f5d3dca3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:49.288218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4f24cc93-4668-4c98-8da6-e1e5f5d3dca3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150339 Apr 07 13:19:49.288780 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 883/1645] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:49 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:49.653403 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c9ee60df-9dc8-4fd5-b7ae-cb39d325bbe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:49.655119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c9ee60df-9dc8-4fd5-b7ae-cb39d325bbe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:49.661421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c9ee60df-9dc8-4fd5-b7ae-cb39d325bbe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:49.661875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c9ee60df-9dc8-4fd5-b7ae-cb39d325bbe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:49.662641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c9ee60df-9dc8-4fd5-b7ae-cb39d325bbe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:49.663080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c9ee60df-9dc8-4fd5-b7ae-cb39d325bbe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:49.797793 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c9ee60df-9dc8-4fd5-b7ae-cb39d325bbe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:49.805482 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c9ee60df-9dc8-4fd5-b7ae-cb39d325bbe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156314 Apr 07 13:19:49.806047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 763/1646] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:49 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:49.843429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3a90a0c8-2fb6-4379-8f5a-3adc7149c01b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:49.843972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3a90a0c8-2fb6-4379-8f5a-3adc7149c01b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:49.850171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3a90a0c8-2fb6-4379-8f5a-3adc7149c01b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:49.850829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3a90a0c8-2fb6-4379-8f5a-3adc7149c01b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:49.851593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3a90a0c8-2fb6-4379-8f5a-3adc7149c01b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:49.852029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3a90a0c8-2fb6-4379-8f5a-3adc7149c01b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:49.914357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3a90a0c8-2fb6-4379-8f5a-3adc7149c01b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:49.923219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3a90a0c8-2fb6-4379-8f5a-3adc7149c01b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:49.924722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3a90a0c8-2fb6-4379-8f5a-3adc7149c01b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:49.925881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3a90a0c8-2fb6-4379-8f5a-3adc7149c01b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087064 Apr 07 13:19:49.926431 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 884/1647] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:49 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:50.306330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d0f194c8-734f-4019-8c87-a79ced78edd3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:50.306943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d0f194c8-734f-4019-8c87-a79ced78edd3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:50.313800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0f194c8-734f-4019-8c87-a79ced78edd3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:50.314248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0f194c8-734f-4019-8c87-a79ced78edd3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:50.315011 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0f194c8-734f-4019-8c87-a79ced78edd3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:50.315443 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0f194c8-734f-4019-8c87-a79ced78edd3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:50.444647 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d0f194c8-734f-4019-8c87-a79ced78edd3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:50.453098 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d0f194c8-734f-4019-8c87-a79ced78edd3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150644 Apr 07 13:19:50.453675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 764/1648] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:50 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:50.822589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e9395799-1480-450d-9e8a-15bbd7359de1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:50.823201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e9395799-1480-450d-9e8a-15bbd7359de1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:50.829832 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e9395799-1480-450d-9e8a-15bbd7359de1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:50.830313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e9395799-1480-450d-9e8a-15bbd7359de1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:50.831128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e9395799-1480-450d-9e8a-15bbd7359de1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:50.831711 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e9395799-1480-450d-9e8a-15bbd7359de1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:50.944332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5151c978-08d8-49e6-87f9-8c6c9f9faba9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:50.944949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5151c978-08d8-49e6-87f9-8c6c9f9faba9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:50.951125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5151c978-08d8-49e6-87f9-8c6c9f9faba9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:50.952753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5151c978-08d8-49e6-87f9-8c6c9f9faba9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:50.953568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5151c978-08d8-49e6-87f9-8c6c9f9faba9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:50.954010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5151c978-08d8-49e6-87f9-8c6c9f9faba9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:50.966560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e9395799-1480-450d-9e8a-15bbd7359de1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:50.974512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e9395799-1480-450d-9e8a-15bbd7359de1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155723 Apr 07 13:19:50.975087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 885/1649] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:50 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:51.017992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5151c978-08d8-49e6-87f9-8c6c9f9faba9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:51.026289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5151c978-08d8-49e6-87f9-8c6c9f9faba9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:51.027781 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5151c978-08d8-49e6-87f9-8c6c9f9faba9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:51.028956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5151c978-08d8-49e6-87f9-8c6c9f9faba9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088545 Apr 07 13:19:51.029548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 765/1650] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:50 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:51.470819 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5e3e74c5-de9d-40dd-8e67-f070160c8180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:51.471424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5e3e74c5-de9d-40dd-8e67-f070160c8180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:51.477835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e3e74c5-de9d-40dd-8e67-f070160c8180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:51.478276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e3e74c5-de9d-40dd-8e67-f070160c8180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:51.479057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e3e74c5-de9d-40dd-8e67-f070160c8180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:51.479488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5e3e74c5-de9d-40dd-8e67-f070160c8180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:51.617938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5e3e74c5-de9d-40dd-8e67-f070160c8180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:51.625672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5e3e74c5-de9d-40dd-8e67-f070160c8180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.159045 Apr 07 13:19:51.626245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 886/1651] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:51 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:51.990818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-db0a7586-5c66-45d4-9771-802356c91400 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:51.991425 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-db0a7586-5c66-45d4-9771-802356c91400 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:51.997743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db0a7586-5c66-45d4-9771-802356c91400 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:51.998244 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db0a7586-5c66-45d4-9771-802356c91400 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:51.999071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db0a7586-5c66-45d4-9771-802356c91400 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:51.999452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db0a7586-5c66-45d4-9771-802356c91400 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:52.047065 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c03a4172-ab6a-4e14-8d29-9de72e00ee55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:52.047658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c03a4172-ab6a-4e14-8d29-9de72e00ee55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:52.053500 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c03a4172-ab6a-4e14-8d29-9de72e00ee55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:52.053954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c03a4172-ab6a-4e14-8d29-9de72e00ee55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:52.054726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c03a4172-ab6a-4e14-8d29-9de72e00ee55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:52.055167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c03a4172-ab6a-4e14-8d29-9de72e00ee55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:52.117173 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c03a4172-ab6a-4e14-8d29-9de72e00ee55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:52.125548 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c03a4172-ab6a-4e14-8d29-9de72e00ee55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:52.127033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c03a4172-ab6a-4e14-8d29-9de72e00ee55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:52.128203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c03a4172-ab6a-4e14-8d29-9de72e00ee55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085246 Apr 07 13:19:52.129101 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 887/1652] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:52 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:52.131252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-db0a7586-5c66-45d4-9771-802356c91400 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:52.139492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-db0a7586-5c66-45d4-9771-802356c91400 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152006 Apr 07 13:19:52.140040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 766/1653] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:51 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:52.644159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8768e54e-013b-43bf-922a-26b03225d6ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:52.644718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8768e54e-013b-43bf-922a-26b03225d6ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:52.650589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8768e54e-013b-43bf-922a-26b03225d6ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:52.651039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8768e54e-013b-43bf-922a-26b03225d6ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:52.651797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8768e54e-013b-43bf-922a-26b03225d6ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:52.652256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8768e54e-013b-43bf-922a-26b03225d6ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:52.784728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8768e54e-013b-43bf-922a-26b03225d6ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:52.792782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8768e54e-013b-43bf-922a-26b03225d6ea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152492 Apr 07 13:19:52.793343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 888/1654] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:52 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:53.146041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-245571f6-0ff8-4ef5-aa3d-2665b273ce47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:53.146662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-245571f6-0ff8-4ef5-aa3d-2665b273ce47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:53.153280 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-245571f6-0ff8-4ef5-aa3d-2665b273ce47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:53.153755 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-245571f6-0ff8-4ef5-aa3d-2665b273ce47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:53.155450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-245571f6-0ff8-4ef5-aa3d-2665b273ce47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:53.155916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-245571f6-0ff8-4ef5-aa3d-2665b273ce47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:53.156601 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a558d185-4b8b-4f92-be38-428a79e5b69a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:53.157224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a558d185-4b8b-4f92-be38-428a79e5b69a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:53.163577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a558d185-4b8b-4f92-be38-428a79e5b69a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:53.164031 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a558d185-4b8b-4f92-be38-428a79e5b69a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:53.164828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a558d185-4b8b-4f92-be38-428a79e5b69a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:53.165270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a558d185-4b8b-4f92-be38-428a79e5b69a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:53.215148 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-245571f6-0ff8-4ef5-aa3d-2665b273ce47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:53.223935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-245571f6-0ff8-4ef5-aa3d-2665b273ce47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:53.225469 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-245571f6-0ff8-4ef5-aa3d-2665b273ce47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:53.226631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-245571f6-0ff8-4ef5-aa3d-2665b273ce47 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084521 Apr 07 13:19:53.227201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 767/1655] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:53 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:53.296577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a558d185-4b8b-4f92-be38-428a79e5b69a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:53.304277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a558d185-4b8b-4f92-be38-428a79e5b69a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151970 Apr 07 13:19:53.305048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 889/1656] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:53 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:53.811978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a4387876-c8e6-45d1-8735-4f550a00d025 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:53.812629 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a4387876-c8e6-45d1-8735-4f550a00d025 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:53.818673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a4387876-c8e6-45d1-8735-4f550a00d025 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:53.819131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a4387876-c8e6-45d1-8735-4f550a00d025 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:53.819904 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a4387876-c8e6-45d1-8735-4f550a00d025 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:53.820386 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a4387876-c8e6-45d1-8735-4f550a00d025 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:53.954034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a4387876-c8e6-45d1-8735-4f550a00d025 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:53.961873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a4387876-c8e6-45d1-8735-4f550a00d025 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154405 Apr 07 13:19:53.962440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 768/1657] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:53 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:54.245252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4330c3f6-2f74-4da7-8d16-74b82e14450f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:54.245791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4330c3f6-2f74-4da7-8d16-74b82e14450f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:54.252620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4330c3f6-2f74-4da7-8d16-74b82e14450f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:54.253085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4330c3f6-2f74-4da7-8d16-74b82e14450f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:54.253827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4330c3f6-2f74-4da7-8d16-74b82e14450f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:54.254262 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4330c3f6-2f74-4da7-8d16-74b82e14450f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:54.315603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4330c3f6-2f74-4da7-8d16-74b82e14450f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:54.321117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bb2a0870-4f89-4624-ba7a-2f49685afa3f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:54.321730 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bb2a0870-4f89-4624-ba7a-2f49685afa3f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:54.324119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4330c3f6-2f74-4da7-8d16-74b82e14450f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:54.325627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4330c3f6-2f74-4da7-8d16-74b82e14450f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:54.326834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4330c3f6-2f74-4da7-8d16-74b82e14450f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085507 Apr 07 13:19:54.327386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 890/1658] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:54 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:54.328371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bb2a0870-4f89-4624-ba7a-2f49685afa3f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:54.328874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bb2a0870-4f89-4624-ba7a-2f49685afa3f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:54.329650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bb2a0870-4f89-4624-ba7a-2f49685afa3f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:54.330085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bb2a0870-4f89-4624-ba7a-2f49685afa3f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:54.461147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bb2a0870-4f89-4624-ba7a-2f49685afa3f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:54.469999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bb2a0870-4f89-4624-ba7a-2f49685afa3f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152684 Apr 07 13:19:54.470560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 769/1659] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:54 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:19:54.980054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7ccc12b5-d1cc-478d-90cd-78a3fec0aa48 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:54.980701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7ccc12b5-d1cc-478d-90cd-78a3fec0aa48 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:54.987222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ccc12b5-d1cc-478d-90cd-78a3fec0aa48 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:54.987671 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ccc12b5-d1cc-478d-90cd-78a3fec0aa48 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:54.988460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ccc12b5-d1cc-478d-90cd-78a3fec0aa48 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:54.988901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ccc12b5-d1cc-478d-90cd-78a3fec0aa48 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:55.118268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7ccc12b5-d1cc-478d-90cd-78a3fec0aa48 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:55.127028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7ccc12b5-d1cc-478d-90cd-78a3fec0aa48 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150772 Apr 07 13:19:55.127584 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 891/1660] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:54 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:55.345351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9bd5a19b-342b-4381-bd5a-f7f1a0131132 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:55.345965 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9bd5a19b-342b-4381-bd5a-f7f1a0131132 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:55.352307 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bd5a19b-342b-4381-bd5a-f7f1a0131132 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:55.352760 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bd5a19b-342b-4381-bd5a-f7f1a0131132 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:55.353526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bd5a19b-342b-4381-bd5a-f7f1a0131132 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:55.353963 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bd5a19b-342b-4381-bd5a-f7f1a0131132 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:55.411959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9bd5a19b-342b-4381-bd5a-f7f1a0131132 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:55.420633 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9bd5a19b-342b-4381-bd5a-f7f1a0131132 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:55.422135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9bd5a19b-342b-4381-bd5a-f7f1a0131132 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:55.423276 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9bd5a19b-342b-4381-bd5a-f7f1a0131132 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082308 Apr 07 13:19:55.423837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 770/1661] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:55 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:55.487542 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4d91e02d-85d1-45d0-8813-29058d874297 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:55.488175 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4d91e02d-85d1-45d0-8813-29058d874297 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:55.494326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d91e02d-85d1-45d0-8813-29058d874297 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:55.494772 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d91e02d-85d1-45d0-8813-29058d874297 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:55.495520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d91e02d-85d1-45d0-8813-29058d874297 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:55.495948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d91e02d-85d1-45d0-8813-29058d874297 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:55.627977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4d91e02d-85d1-45d0-8813-29058d874297 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:55.635847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4d91e02d-85d1-45d0-8813-29058d874297 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153071 Apr 07 13:19:55.636443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 892/1662] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:55 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:56.144720 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e0e0eee3-02c2-47d6-b60a-4b10c9860b8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:56.145343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e0e0eee3-02c2-47d6-b60a-4b10c9860b8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:56.151200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e0e0eee3-02c2-47d6-b60a-4b10c9860b8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:56.151650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e0e0eee3-02c2-47d6-b60a-4b10c9860b8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:56.152443 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e0e0eee3-02c2-47d6-b60a-4b10c9860b8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:56.152881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e0e0eee3-02c2-47d6-b60a-4b10c9860b8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:56.300771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e0e0eee3-02c2-47d6-b60a-4b10c9860b8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:56.308625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e0e0eee3-02c2-47d6-b60a-4b10c9860b8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.167746 Apr 07 13:19:56.309202 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 771/1663] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:56 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:56.441921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9e6facc9-5bf8-4144-83f4-b29b78a6a6ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:56.442443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9e6facc9-5bf8-4144-83f4-b29b78a6a6ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:56.448123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e6facc9-5bf8-4144-83f4-b29b78a6a6ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:56.448617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e6facc9-5bf8-4144-83f4-b29b78a6a6ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:56.449371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e6facc9-5bf8-4144-83f4-b29b78a6a6ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:56.449799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e6facc9-5bf8-4144-83f4-b29b78a6a6ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:56.511387 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9e6facc9-5bf8-4144-83f4-b29b78a6a6ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:56.520078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9e6facc9-5bf8-4144-83f4-b29b78a6a6ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:56.521600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9e6facc9-5bf8-4144-83f4-b29b78a6a6ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:56.522739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9e6facc9-5bf8-4144-83f4-b29b78a6a6ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084816 Apr 07 13:19:56.523304 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 893/1664] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:56 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:56.652714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d867b0bd-2da5-4b52-a950-87747fb51afe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:56.653367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d867b0bd-2da5-4b52-a950-87747fb51afe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:56.659689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d867b0bd-2da5-4b52-a950-87747fb51afe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:56.660431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d867b0bd-2da5-4b52-a950-87747fb51afe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:56.661199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d867b0bd-2da5-4b52-a950-87747fb51afe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:56.661643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d867b0bd-2da5-4b52-a950-87747fb51afe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:56.792450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d867b0bd-2da5-4b52-a950-87747fb51afe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:56.800955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d867b0bd-2da5-4b52-a950-87747fb51afe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152082 Apr 07 13:19:56.801531 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 772/1665] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:56 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:57.325751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3b495c73-c9b6-476a-a648-39381777d077 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:57.326362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3b495c73-c9b6-476a-a648-39381777d077 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:57.333141 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b495c73-c9b6-476a-a648-39381777d077 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:57.333594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b495c73-c9b6-476a-a648-39381777d077 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:57.334357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b495c73-c9b6-476a-a648-39381777d077 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:57.334799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b495c73-c9b6-476a-a648-39381777d077 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:57.463052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3b495c73-c9b6-476a-a648-39381777d077 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:57.471368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3b495c73-c9b6-476a-a648-39381777d077 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149447 Apr 07 13:19:57.471930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 894/1666] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:57 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:57.540957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bd496b1d-21bc-4830-bec3-ba73c96448c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:57.541571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bd496b1d-21bc-4830-bec3-ba73c96448c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:57.547432 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd496b1d-21bc-4830-bec3-ba73c96448c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:57.547883 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd496b1d-21bc-4830-bec3-ba73c96448c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:57.548673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd496b1d-21bc-4830-bec3-ba73c96448c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:57.549112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd496b1d-21bc-4830-bec3-ba73c96448c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:57.607306 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bd496b1d-21bc-4830-bec3-ba73c96448c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:57.615581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bd496b1d-21bc-4830-bec3-ba73c96448c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:57.617102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bd496b1d-21bc-4830-bec3-ba73c96448c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:57.618249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bd496b1d-21bc-4830-bec3-ba73c96448c0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081150 Apr 07 13:19:57.618807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 773/1667] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:57 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:19:57.818517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-12c622bc-e790-47f6-83b2-637c05be3bf9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:57.819131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-12c622bc-e790-47f6-83b2-637c05be3bf9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:57.825406 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-12c622bc-e790-47f6-83b2-637c05be3bf9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:57.825872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-12c622bc-e790-47f6-83b2-637c05be3bf9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:57.826622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-12c622bc-e790-47f6-83b2-637c05be3bf9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:57.828122 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-12c622bc-e790-47f6-83b2-637c05be3bf9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:57.958022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-12c622bc-e790-47f6-83b2-637c05be3bf9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:57.965759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-12c622bc-e790-47f6-83b2-637c05be3bf9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151120 Apr 07 13:19:57.966326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 895/1668] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:57 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:58.488512 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e868d272-3bb2-4b6b-a888-c64c45cd130d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:58.489133 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e868d272-3bb2-4b6b-a888-c64c45cd130d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:58.495484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e868d272-3bb2-4b6b-a888-c64c45cd130d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:58.495942 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e868d272-3bb2-4b6b-a888-c64c45cd130d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:58.496740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e868d272-3bb2-4b6b-a888-c64c45cd130d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:58.497185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e868d272-3bb2-4b6b-a888-c64c45cd130d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:58.630364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e868d272-3bb2-4b6b-a888-c64c45cd130d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:58.636997 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c548c5b7-b8d1-4e47-a1bc-3087ca3031c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:58.637678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c548c5b7-b8d1-4e47-a1bc-3087ca3031c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:58.638413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e868d272-3bb2-4b6b-a888-c64c45cd130d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.153737 Apr 07 13:19:58.638979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 774/1669] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:58 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:58.644349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c548c5b7-b8d1-4e47-a1bc-3087ca3031c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:58.644799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c548c5b7-b8d1-4e47-a1bc-3087ca3031c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:58.645551 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c548c5b7-b8d1-4e47-a1bc-3087ca3031c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:58.645975 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c548c5b7-b8d1-4e47-a1bc-3087ca3031c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:58.708288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c548c5b7-b8d1-4e47-a1bc-3087ca3031c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:58.716417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c548c5b7-b8d1-4e47-a1bc-3087ca3031c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:58.718402 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c548c5b7-b8d1-4e47-a1bc-3087ca3031c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:58.719538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c548c5b7-b8d1-4e47-a1bc-3087ca3031c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086423 Apr 07 13:19:58.720090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 896/1670] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:58 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:19:58.982764 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5308c8fd-195d-4717-b8f6-914945942e5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:58.984342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5308c8fd-195d-4717-b8f6-914945942e5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:58.990197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5308c8fd-195d-4717-b8f6-914945942e5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:58.990644 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5308c8fd-195d-4717-b8f6-914945942e5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:58.991399 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5308c8fd-195d-4717-b8f6-914945942e5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:58.991834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5308c8fd-195d-4717-b8f6-914945942e5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:59.121266 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5308c8fd-195d-4717-b8f6-914945942e5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:59.130176 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5308c8fd-195d-4717-b8f6-914945942e5f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151221 Apr 07 13:19:59.130744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 775/1671] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:58 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:59.656382 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4a953770-9109-4784-be45-e95250af5bcb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:59.656994 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4a953770-9109-4784-be45-e95250af5bcb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:59.663473 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a953770-9109-4784-be45-e95250af5bcb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:59.663929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a953770-9109-4784-be45-e95250af5bcb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:59.664721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a953770-9109-4784-be45-e95250af5bcb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:59.665158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a953770-9109-4784-be45-e95250af5bcb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:59.737988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8b4439e2-18f9-42da-a8e6-a0dfc5d959cc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:19:59.738778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8b4439e2-18f9-42da-a8e6-a0dfc5d959cc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:19:59.745268 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8b4439e2-18f9-42da-a8e6-a0dfc5d959cc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:59.745720 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8b4439e2-18f9-42da-a8e6-a0dfc5d959cc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:59.746725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8b4439e2-18f9-42da-a8e6-a0dfc5d959cc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:19:59.746917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8b4439e2-18f9-42da-a8e6-a0dfc5d959cc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:19:59.800478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4a953770-9109-4784-be45-e95250af5bcb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:59.808084 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8b4439e2-18f9-42da-a8e6-a0dfc5d959cc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:59.808458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4a953770-9109-4784-be45-e95250af5bcb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.156127 Apr 07 13:19:59.809027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 897/1672] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:19:59 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:19:59.816824 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8b4439e2-18f9-42da-a8e6-a0dfc5d959cc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:59.818349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8b4439e2-18f9-42da-a8e6-a0dfc5d959cc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:19:59.819524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8b4439e2-18f9-42da-a8e6-a0dfc5d959cc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085426 Apr 07 13:19:59.820085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 776/1673] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:19:59 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:20:00.148321 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4c724f7e-9ca4-4adc-9f32-61d6211a912d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:00.148940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4c724f7e-9ca4-4adc-9f32-61d6211a912d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:00.154840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c724f7e-9ca4-4adc-9f32-61d6211a912d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:00.156046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c724f7e-9ca4-4adc-9f32-61d6211a912d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:00.156837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c724f7e-9ca4-4adc-9f32-61d6211a912d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:00.157271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c724f7e-9ca4-4adc-9f32-61d6211a912d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:00.283783 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4c724f7e-9ca4-4adc-9f32-61d6211a912d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:00.291791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4c724f7e-9ca4-4adc-9f32-61d6211a912d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.147327 Apr 07 13:20:00.292376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 898/1674] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:00 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:00.825670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b6af08af-fd4e-448b-9693-4202dd43abd8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:00.826281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b6af08af-fd4e-448b-9693-4202dd43abd8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:00.832917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6af08af-fd4e-448b-9693-4202dd43abd8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:00.833316 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6af08af-fd4e-448b-9693-4202dd43abd8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:00.834379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6af08af-fd4e-448b-9693-4202dd43abd8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:00.834576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6af08af-fd4e-448b-9693-4202dd43abd8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:00.837546 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8708c5e6-2fd3-479f-b686-d89d898c8dd0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:00.838140 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8708c5e6-2fd3-479f-b686-d89d898c8dd0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:00.844598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8708c5e6-2fd3-479f-b686-d89d898c8dd0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:00.845010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8708c5e6-2fd3-479f-b686-d89d898c8dd0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:00.845782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8708c5e6-2fd3-479f-b686-d89d898c8dd0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:00.846217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8708c5e6-2fd3-479f-b686-d89d898c8dd0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:00.909449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8708c5e6-2fd3-479f-b686-d89d898c8dd0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:00.917933 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8708c5e6-2fd3-479f-b686-d89d898c8dd0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:00.919837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8708c5e6-2fd3-479f-b686-d89d898c8dd0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:00.920568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8708c5e6-2fd3-479f-b686-d89d898c8dd0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087335 Apr 07 13:20:00.921132 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 899/1675] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:00 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:20:00.970354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b6af08af-fd4e-448b-9693-4202dd43abd8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:00.978070 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b6af08af-fd4e-448b-9693-4202dd43abd8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.156292 Apr 07 13:20:00.978634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 777/1676] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:00 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:01.309194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-18cd5f03-3b23-4f00-9cf8-725f21d6ed2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:01.309803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-18cd5f03-3b23-4f00-9cf8-725f21d6ed2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:01.316519 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-18cd5f03-3b23-4f00-9cf8-725f21d6ed2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:01.316962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-18cd5f03-3b23-4f00-9cf8-725f21d6ed2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:01.317714 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-18cd5f03-3b23-4f00-9cf8-725f21d6ed2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:01.318140 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-18cd5f03-3b23-4f00-9cf8-725f21d6ed2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:01.446698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-18cd5f03-3b23-4f00-9cf8-725f21d6ed2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:01.454920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-18cd5f03-3b23-4f00-9cf8-725f21d6ed2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149502 Apr 07 13:20:01.455476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 900/1677] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:01 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:01.939235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7180a0f6-a0cf-4ec1-bd4a-f3055ca87c18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:01.939919 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7180a0f6-a0cf-4ec1-bd4a-f3055ca87c18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:01.946246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7180a0f6-a0cf-4ec1-bd4a-f3055ca87c18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:01.946700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7180a0f6-a0cf-4ec1-bd4a-f3055ca87c18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:01.947471 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7180a0f6-a0cf-4ec1-bd4a-f3055ca87c18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:01.947913 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7180a0f6-a0cf-4ec1-bd4a-f3055ca87c18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:01.994708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-36281ba7-73d8-4e40-881a-32d3d20e2b31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:01.995323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-36281ba7-73d8-4e40-881a-32d3d20e2b31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:02.002330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36281ba7-73d8-4e40-881a-32d3d20e2b31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:02.002786 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36281ba7-73d8-4e40-881a-32d3d20e2b31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:02.003743 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36281ba7-73d8-4e40-881a-32d3d20e2b31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:02.004206 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-36281ba7-73d8-4e40-881a-32d3d20e2b31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:02.007703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7180a0f6-a0cf-4ec1-bd4a-f3055ca87c18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:02.016165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7180a0f6-a0cf-4ec1-bd4a-f3055ca87c18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:02.017703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7180a0f6-a0cf-4ec1-bd4a-f3055ca87c18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:02.018888 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7180a0f6-a0cf-4ec1-bd4a-f3055ca87c18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084253 Apr 07 13:20:02.019446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 778/1678] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:01 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:02.132791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-36281ba7-73d8-4e40-881a-32d3d20e2b31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:02.140659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-36281ba7-73d8-4e40-881a-32d3d20e2b31 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149704 Apr 07 13:20:02.141223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 901/1679] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:01 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:20:02.472683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eaa10b6d-cee7-4d96-9789-e7e3b2178a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:02.473301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-eaa10b6d-cee7-4d96-9789-e7e3b2178a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:02.479206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eaa10b6d-cee7-4d96-9789-e7e3b2178a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:02.479683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eaa10b6d-cee7-4d96-9789-e7e3b2178a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:02.480480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eaa10b6d-cee7-4d96-9789-e7e3b2178a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:02.480914 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eaa10b6d-cee7-4d96-9789-e7e3b2178a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:02.613198 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eaa10b6d-cee7-4d96-9789-e7e3b2178a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:02.620955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eaa10b6d-cee7-4d96-9789-e7e3b2178a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153218 Apr 07 13:20:02.621520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 779/1680] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:02 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:03.037243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7357ea3a-9114-44d1-88c5-04076955b0c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:03.037853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7357ea3a-9114-44d1-88c5-04076955b0c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:03.044100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7357ea3a-9114-44d1-88c5-04076955b0c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:03.044586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7357ea3a-9114-44d1-88c5-04076955b0c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:03.045347 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7357ea3a-9114-44d1-88c5-04076955b0c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:03.046410 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7357ea3a-9114-44d1-88c5-04076955b0c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:03.107193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7357ea3a-9114-44d1-88c5-04076955b0c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:03.115988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7357ea3a-9114-44d1-88c5-04076955b0c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:03.117499 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7357ea3a-9114-44d1-88c5-04076955b0c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:03.118632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7357ea3a-9114-44d1-88c5-04076955b0c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085531 Apr 07 13:20:03.119186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 902/1681] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:03 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:03.158263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b380c62f-f3d0-4ba5-a711-70fd0b053a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:03.158880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b380c62f-f3d0-4ba5-a711-70fd0b053a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:03.165417 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b380c62f-f3d0-4ba5-a711-70fd0b053a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:03.165883 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b380c62f-f3d0-4ba5-a711-70fd0b053a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:03.166646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b380c62f-f3d0-4ba5-a711-70fd0b053a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:03.167080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b380c62f-f3d0-4ba5-a711-70fd0b053a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:03.296273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b380c62f-f3d0-4ba5-a711-70fd0b053a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:03.304048 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b380c62f-f3d0-4ba5-a711-70fd0b053a99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150386 Apr 07 13:20:03.304625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 780/1682] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:03 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:03.638181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-79071909-53c7-4913-8399-55c06aa8d5c8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:03.638799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-79071909-53c7-4913-8399-55c06aa8d5c8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:03.645409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79071909-53c7-4913-8399-55c06aa8d5c8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:03.645867 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79071909-53c7-4913-8399-55c06aa8d5c8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:03.646628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79071909-53c7-4913-8399-55c06aa8d5c8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:03.647063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79071909-53c7-4913-8399-55c06aa8d5c8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:03.776591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-79071909-53c7-4913-8399-55c06aa8d5c8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:03.786308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-79071909-53c7-4913-8399-55c06aa8d5c8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151838 Apr 07 13:20:03.786308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 903/1683] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:03 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:04.137012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e7798151-f4d9-4b74-9eda-be6bf1480fdc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:04.137621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e7798151-f4d9-4b74-9eda-be6bf1480fdc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:04.143983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e7798151-f4d9-4b74-9eda-be6bf1480fdc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:04.144461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e7798151-f4d9-4b74-9eda-be6bf1480fdc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:04.145219 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e7798151-f4d9-4b74-9eda-be6bf1480fdc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:04.145653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e7798151-f4d9-4b74-9eda-be6bf1480fdc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:04.204320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e7798151-f4d9-4b74-9eda-be6bf1480fdc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:04.212513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e7798151-f4d9-4b74-9eda-be6bf1480fdc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:04.214000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e7798151-f4d9-4b74-9eda-be6bf1480fdc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:04.215131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e7798151-f4d9-4b74-9eda-be6bf1480fdc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082241 Apr 07 13:20:04.215693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 781/1684] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:04 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:04.320985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d735caed-1316-4d40-b917-1de287d686d8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:04.321618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d735caed-1316-4d40-b917-1de287d686d8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:04.328259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d735caed-1316-4d40-b917-1de287d686d8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:04.328717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d735caed-1316-4d40-b917-1de287d686d8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:04.329482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d735caed-1316-4d40-b917-1de287d686d8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:04.329920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d735caed-1316-4d40-b917-1de287d686d8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:04.460199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d735caed-1316-4d40-b917-1de287d686d8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:04.468838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d735caed-1316-4d40-b917-1de287d686d8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151580 Apr 07 13:20:04.469403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 904/1685] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:04 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:04.804823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9923913c-6915-451f-97f1-9c485bd47032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:04.805364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9923913c-6915-451f-97f1-9c485bd47032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:04.811354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9923913c-6915-451f-97f1-9c485bd47032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:04.811806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9923913c-6915-451f-97f1-9c485bd47032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:04.812601 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9923913c-6915-451f-97f1-9c485bd47032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:04.813037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9923913c-6915-451f-97f1-9c485bd47032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:04.945918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9923913c-6915-451f-97f1-9c485bd47032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:04.954489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9923913c-6915-451f-97f1-9c485bd47032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154247 Apr 07 13:20:04.955056 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 782/1686] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:04 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:20:05.234432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f52f650f-f5f9-4ae9-b246-13f6a295118b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:05.235066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f52f650f-f5f9-4ae9-b246-13f6a295118b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:05.240945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f52f650f-f5f9-4ae9-b246-13f6a295118b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:05.241391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f52f650f-f5f9-4ae9-b246-13f6a295118b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:05.242154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f52f650f-f5f9-4ae9-b246-13f6a295118b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:05.242584 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f52f650f-f5f9-4ae9-b246-13f6a295118b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:05.304103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f52f650f-f5f9-4ae9-b246-13f6a295118b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:05.312311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f52f650f-f5f9-4ae9-b246-13f6a295118b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:05.313803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f52f650f-f5f9-4ae9-b246-13f6a295118b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:05.314935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f52f650f-f5f9-4ae9-b246-13f6a295118b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085520 Apr 07 13:20:05.315494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 905/1687] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:05 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:05.485679 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6b36a8a3-bb63-4238-82b0-69566199fee4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:05.486218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6b36a8a3-bb63-4238-82b0-69566199fee4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:05.492489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b36a8a3-bb63-4238-82b0-69566199fee4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:05.492933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b36a8a3-bb63-4238-82b0-69566199fee4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:05.493687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b36a8a3-bb63-4238-82b0-69566199fee4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:05.494119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b36a8a3-bb63-4238-82b0-69566199fee4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:05.622676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6b36a8a3-bb63-4238-82b0-69566199fee4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:05.631034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6b36a8a3-bb63-4238-82b0-69566199fee4 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149239 Apr 07 13:20:05.631591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 783/1688] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:05 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:05.971089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-02d831c0-a92c-47c5-bbe0-c5d489c88d09 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:05.971719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-02d831c0-a92c-47c5-bbe0-c5d489c88d09 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:05.979415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02d831c0-a92c-47c5-bbe0-c5d489c88d09 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:05.980088 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02d831c0-a92c-47c5-bbe0-c5d489c88d09 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:05.981308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02d831c0-a92c-47c5-bbe0-c5d489c88d09 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:05.981964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02d831c0-a92c-47c5-bbe0-c5d489c88d09 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:06.113338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-02d831c0-a92c-47c5-bbe0-c5d489c88d09 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:06.120963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-02d831c0-a92c-47c5-bbe0-c5d489c88d09 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153656 Apr 07 13:20:06.121527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 906/1689] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:05 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:06.333226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ecc8ec8f-d86d-4eda-aa8d-7e57bfdae9c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:06.333753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ecc8ec8f-d86d-4eda-aa8d-7e57bfdae9c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:06.339611 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ecc8ec8f-d86d-4eda-aa8d-7e57bfdae9c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:06.340061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ecc8ec8f-d86d-4eda-aa8d-7e57bfdae9c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:06.340852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ecc8ec8f-d86d-4eda-aa8d-7e57bfdae9c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:06.341289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ecc8ec8f-d86d-4eda-aa8d-7e57bfdae9c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:06.400747 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ecc8ec8f-d86d-4eda-aa8d-7e57bfdae9c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:06.408998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ecc8ec8f-d86d-4eda-aa8d-7e57bfdae9c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:06.410745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ecc8ec8f-d86d-4eda-aa8d-7e57bfdae9c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:06.411890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ecc8ec8f-d86d-4eda-aa8d-7e57bfdae9c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082678 Apr 07 13:20:06.412487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 784/1690] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:06 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:06.648979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b70fd054-bdff-4a91-82dc-384d51e7507a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:06.649597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b70fd054-bdff-4a91-82dc-384d51e7507a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:06.655914 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b70fd054-bdff-4a91-82dc-384d51e7507a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:06.656389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b70fd054-bdff-4a91-82dc-384d51e7507a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:06.657144 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b70fd054-bdff-4a91-82dc-384d51e7507a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:06.657581 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b70fd054-bdff-4a91-82dc-384d51e7507a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:06.787099 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b70fd054-bdff-4a91-82dc-384d51e7507a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:06.794763 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b70fd054-bdff-4a91-82dc-384d51e7507a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149604 Apr 07 13:20:06.795336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 907/1691] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:06 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:07.138975 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-72f21a1e-e37c-49a0-bc19-22e23a8503dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:07.140115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-72f21a1e-e37c-49a0-bc19-22e23a8503dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:07.146478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-72f21a1e-e37c-49a0-bc19-22e23a8503dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:07.146934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-72f21a1e-e37c-49a0-bc19-22e23a8503dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:07.147704 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-72f21a1e-e37c-49a0-bc19-22e23a8503dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:07.148165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-72f21a1e-e37c-49a0-bc19-22e23a8503dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:07.285975 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-72f21a1e-e37c-49a0-bc19-22e23a8503dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:07.293803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-72f21a1e-e37c-49a0-bc19-22e23a8503dc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158723 Apr 07 13:20:07.294364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 785/1692] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:07 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:07.430355 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-32371c4d-1fca-4816-911f-6f625dbac44b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:07.430876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-32371c4d-1fca-4816-911f-6f625dbac44b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:07.437885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32371c4d-1fca-4816-911f-6f625dbac44b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:07.438361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32371c4d-1fca-4816-911f-6f625dbac44b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:07.439121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32371c4d-1fca-4816-911f-6f625dbac44b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:07.439559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32371c4d-1fca-4816-911f-6f625dbac44b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:07.500795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-32371c4d-1fca-4816-911f-6f625dbac44b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:07.508964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-32371c4d-1fca-4816-911f-6f625dbac44b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:07.510454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-32371c4d-1fca-4816-911f-6f625dbac44b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:07.511585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-32371c4d-1fca-4816-911f-6f625dbac44b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085204 Apr 07 13:20:07.512147 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 908/1693] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:07 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:07.813342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5e067dda-23f7-4fcd-9e17-f5e8caafbbbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:07.813909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5e067dda-23f7-4fcd-9e17-f5e8caafbbbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:07.819777 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e067dda-23f7-4fcd-9e17-f5e8caafbbbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:07.820251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e067dda-23f7-4fcd-9e17-f5e8caafbbbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:07.821011 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e067dda-23f7-4fcd-9e17-f5e8caafbbbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:07.821444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e067dda-23f7-4fcd-9e17-f5e8caafbbbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:07.951624 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5e067dda-23f7-4fcd-9e17-f5e8caafbbbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:07.959878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5e067dda-23f7-4fcd-9e17-f5e8caafbbbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151819 Apr 07 13:20:07.960465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 786/1694] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:07 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:08.310408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c85a73e6-0ff0-40ef-8452-f15ffaf7769e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:08.311030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c85a73e6-0ff0-40ef-8452-f15ffaf7769e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:08.316979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c85a73e6-0ff0-40ef-8452-f15ffaf7769e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:08.317433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c85a73e6-0ff0-40ef-8452-f15ffaf7769e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:08.318195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c85a73e6-0ff0-40ef-8452-f15ffaf7769e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:08.318629 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c85a73e6-0ff0-40ef-8452-f15ffaf7769e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:08.447278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c85a73e6-0ff0-40ef-8452-f15ffaf7769e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:08.455585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c85a73e6-0ff0-40ef-8452-f15ffaf7769e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.148977 Apr 07 13:20:08.456386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 909/1695] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:08 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:08.529807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c03e5ef7-27e6-4f91-b424-28134768d478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:08.530504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c03e5ef7-27e6-4f91-b424-28134768d478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:08.537647 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c03e5ef7-27e6-4f91-b424-28134768d478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:08.538092 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c03e5ef7-27e6-4f91-b424-28134768d478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:08.538849 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c03e5ef7-27e6-4f91-b424-28134768d478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:08.539283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c03e5ef7-27e6-4f91-b424-28134768d478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:08.598960 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c03e5ef7-27e6-4f91-b424-28134768d478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:08.607246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c03e5ef7-27e6-4f91-b424-28134768d478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:08.608875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c03e5ef7-27e6-4f91-b424-28134768d478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:08.610099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c03e5ef7-27e6-4f91-b424-28134768d478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084145 Apr 07 13:20:08.610656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 787/1696] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:08 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:08.977966 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e57b8ce8-08c0-40cb-9e2e-28ed9101f4ef tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:08.978581 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e57b8ce8-08c0-40cb-9e2e-28ed9101f4ef tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:08.984561 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e57b8ce8-08c0-40cb-9e2e-28ed9101f4ef tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:08.985011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e57b8ce8-08c0-40cb-9e2e-28ed9101f4ef tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:08.985777 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e57b8ce8-08c0-40cb-9e2e-28ed9101f4ef tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:08.986209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e57b8ce8-08c0-40cb-9e2e-28ed9101f4ef tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:09.121666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e57b8ce8-08c0-40cb-9e2e-28ed9101f4ef tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:09.130426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e57b8ce8-08c0-40cb-9e2e-28ed9101f4ef tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.156313 Apr 07 13:20:09.130980 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 910/1697] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:08 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:09.472707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6bf87ca3-4f54-4646-ae4f-5583bb4d135e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:09.473250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6bf87ca3-4f54-4646-ae4f-5583bb4d135e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:09.479372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bf87ca3-4f54-4646-ae4f-5583bb4d135e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:09.479822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bf87ca3-4f54-4646-ae4f-5583bb4d135e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:09.481028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bf87ca3-4f54-4646-ae4f-5583bb4d135e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:09.481462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bf87ca3-4f54-4646-ae4f-5583bb4d135e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:09.615483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6bf87ca3-4f54-4646-ae4f-5583bb4d135e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:09.623288 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6bf87ca3-4f54-4646-ae4f-5583bb4d135e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154505 Apr 07 13:20:09.623854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 788/1698] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:09 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:09.628600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7f9aeb88-4b59-423d-b6d2-d1ac8e466e19 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:09.629207 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7f9aeb88-4b59-423d-b6d2-d1ac8e466e19 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:09.635424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f9aeb88-4b59-423d-b6d2-d1ac8e466e19 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:09.635872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f9aeb88-4b59-423d-b6d2-d1ac8e466e19 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:09.636646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f9aeb88-4b59-423d-b6d2-d1ac8e466e19 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:09.637076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f9aeb88-4b59-423d-b6d2-d1ac8e466e19 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:09.698823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7f9aeb88-4b59-423d-b6d2-d1ac8e466e19 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:09.707092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7f9aeb88-4b59-423d-b6d2-d1ac8e466e19 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:09.708603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7f9aeb88-4b59-423d-b6d2-d1ac8e466e19 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:09.709725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7f9aeb88-4b59-423d-b6d2-d1ac8e466e19 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085255 Apr 07 13:20:09.710298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 911/1699] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:09 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:20:10.148866 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e0939546-bf2f-4d74-bf85-14fa77d952ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:10.149476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e0939546-bf2f-4d74-bf85-14fa77d952ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:10.155345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e0939546-bf2f-4d74-bf85-14fa77d952ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:10.156591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e0939546-bf2f-4d74-bf85-14fa77d952ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:10.157161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e0939546-bf2f-4d74-bf85-14fa77d952ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:10.157594 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e0939546-bf2f-4d74-bf85-14fa77d952ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:10.291736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e0939546-bf2f-4d74-bf85-14fa77d952ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:10.299706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e0939546-bf2f-4d74-bf85-14fa77d952ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154699 Apr 07 13:20:10.300307 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 789/1700] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:10 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:10.641667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b4602c36-b607-49b6-be96-bf469b551072 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:10.642268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b4602c36-b607-49b6-be96-bf469b551072 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:10.648490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4602c36-b607-49b6-be96-bf469b551072 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:10.648935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4602c36-b607-49b6-be96-bf469b551072 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:10.649683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4602c36-b607-49b6-be96-bf469b551072 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:10.650111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4602c36-b607-49b6-be96-bf469b551072 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:10.728507 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c7cf03bd-3a13-4b20-8f6f-2618ab457bc7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:10.729128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c7cf03bd-3a13-4b20-8f6f-2618ab457bc7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:10.735519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7cf03bd-3a13-4b20-8f6f-2618ab457bc7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:10.735978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7cf03bd-3a13-4b20-8f6f-2618ab457bc7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:10.736780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7cf03bd-3a13-4b20-8f6f-2618ab457bc7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:10.737223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7cf03bd-3a13-4b20-8f6f-2618ab457bc7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:10.785072 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b4602c36-b607-49b6-be96-bf469b551072 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:10.793103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b4602c36-b607-49b6-be96-bf469b551072 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156217 Apr 07 13:20:10.793672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 912/1701] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:10 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:10.798330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c7cf03bd-3a13-4b20-8f6f-2618ab457bc7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:10.809701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c7cf03bd-3a13-4b20-8f6f-2618ab457bc7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:10.811210 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c7cf03bd-3a13-4b20-8f6f-2618ab457bc7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:10.812414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c7cf03bd-3a13-4b20-8f6f-2618ab457bc7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087754 Apr 07 13:20:10.812968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 790/1702] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:10 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:20:11.319290 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-72cf129b-6d95-4005-b9b0-02f02de0f187 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:11.319904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-72cf129b-6d95-4005-b9b0-02f02de0f187 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:11.325794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72cf129b-6d95-4005-b9b0-02f02de0f187 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:11.326241 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72cf129b-6d95-4005-b9b0-02f02de0f187 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:11.326996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72cf129b-6d95-4005-b9b0-02f02de0f187 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:11.328190 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72cf129b-6d95-4005-b9b0-02f02de0f187 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:11.458068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-72cf129b-6d95-4005-b9b0-02f02de0f187 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:11.465807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-72cf129b-6d95-4005-b9b0-02f02de0f187 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150390 Apr 07 13:20:11.466381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 913/1703] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:11 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:11.809746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2796a667-a0c7-4178-874a-55b129f8409e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:11.810379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2796a667-a0c7-4178-874a-55b129f8409e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:11.817718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2796a667-a0c7-4178-874a-55b129f8409e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:11.818465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2796a667-a0c7-4178-874a-55b129f8409e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:11.819433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2796a667-a0c7-4178-874a-55b129f8409e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:11.820113 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2796a667-a0c7-4178-874a-55b129f8409e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:11.833277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a18ec901-e3cf-4767-b7cb-bc837715aaca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:11.833832 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a18ec901-e3cf-4767-b7cb-bc837715aaca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:11.840180 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a18ec901-e3cf-4767-b7cb-bc837715aaca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:11.840639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a18ec901-e3cf-4767-b7cb-bc837715aaca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:11.841428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a18ec901-e3cf-4767-b7cb-bc837715aaca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:11.841868 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a18ec901-e3cf-4767-b7cb-bc837715aaca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:11.944267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a18ec901-e3cf-4767-b7cb-bc837715aaca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:11.952534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a18ec901-e3cf-4767-b7cb-bc837715aaca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:11.954737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a18ec901-e3cf-4767-b7cb-bc837715aaca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:11.955910 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a18ec901-e3cf-4767-b7cb-bc837715aaca tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.129237 Apr 07 13:20:11.956894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 914/1704] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:11 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:11.961492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2796a667-a0c7-4178-874a-55b129f8409e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:11.969965 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2796a667-a0c7-4178-874a-55b129f8409e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.163808 Apr 07 13:20:11.970538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 791/1705] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:11 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:12.482780 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-efbace44-0a8d-446e-8dfd-7390343adaee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:12.483310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-efbace44-0a8d-446e-8dfd-7390343adaee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:12.489972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-efbace44-0a8d-446e-8dfd-7390343adaee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:12.490462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-efbace44-0a8d-446e-8dfd-7390343adaee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:12.491227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-efbace44-0a8d-446e-8dfd-7390343adaee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:12.491661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-efbace44-0a8d-446e-8dfd-7390343adaee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:12.619841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-efbace44-0a8d-446e-8dfd-7390343adaee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:12.627652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-efbace44-0a8d-446e-8dfd-7390343adaee tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148733 Apr 07 13:20:12.628233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 915/1706] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:12 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:12.974324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-89b5df38-051b-4287-bfda-05a6e19cfdec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:12.974966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-89b5df38-051b-4287-bfda-05a6e19cfdec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:12.981317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-89b5df38-051b-4287-bfda-05a6e19cfdec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:12.981769 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-89b5df38-051b-4287-bfda-05a6e19cfdec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:12.982529 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-89b5df38-051b-4287-bfda-05a6e19cfdec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:12.982966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-89b5df38-051b-4287-bfda-05a6e19cfdec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:12.986545 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1353327f-0f37-49e4-b01f-2727def1cc62 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:12.987165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1353327f-0f37-49e4-b01f-2727def1cc62 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:12.993396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1353327f-0f37-49e4-b01f-2727def1cc62 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:12.993849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1353327f-0f37-49e4-b01f-2727def1cc62 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:12.994618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1353327f-0f37-49e4-b01f-2727def1cc62 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:12.995059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1353327f-0f37-49e4-b01f-2727def1cc62 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:13.042366 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-89b5df38-051b-4287-bfda-05a6e19cfdec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:13.050867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-89b5df38-051b-4287-bfda-05a6e19cfdec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:13.052435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-89b5df38-051b-4287-bfda-05a6e19cfdec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:13.053672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-89b5df38-051b-4287-bfda-05a6e19cfdec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083217 Apr 07 13:20:13.054446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 792/1707] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:12 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:13.127654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1353327f-0f37-49e4-b01f-2727def1cc62 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:13.135380 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1353327f-0f37-49e4-b01f-2727def1cc62 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152652 Apr 07 13:20:13.135941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 916/1708] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:12 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:20:13.645897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c7eaf226-1b3c-491d-bd7a-fe9294e5c64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:13.646514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c7eaf226-1b3c-491d-bd7a-fe9294e5c64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:13.652641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7eaf226-1b3c-491d-bd7a-fe9294e5c64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:13.653092 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7eaf226-1b3c-491d-bd7a-fe9294e5c64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:13.653849 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7eaf226-1b3c-491d-bd7a-fe9294e5c64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:13.654281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c7eaf226-1b3c-491d-bd7a-fe9294e5c64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:13.785918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c7eaf226-1b3c-491d-bd7a-fe9294e5c64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:13.793768 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c7eaf226-1b3c-491d-bd7a-fe9294e5c64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152363 Apr 07 13:20:13.794337 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 793/1709] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:13 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:14.071861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-20f52fe2-9899-4f87-b435-c0e183870b9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:14.072502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-20f52fe2-9899-4f87-b435-c0e183870b9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:14.078944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20f52fe2-9899-4f87-b435-c0e183870b9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:14.079396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20f52fe2-9899-4f87-b435-c0e183870b9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:14.080180 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20f52fe2-9899-4f87-b435-c0e183870b9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:14.080620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20f52fe2-9899-4f87-b435-c0e183870b9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:14.137434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-20f52fe2-9899-4f87-b435-c0e183870b9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:14.145608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-20f52fe2-9899-4f87-b435-c0e183870b9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:14.147136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-20f52fe2-9899-4f87-b435-c0e183870b9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:14.148301 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-20f52fe2-9899-4f87-b435-c0e183870b9e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.080317 Apr 07 13:20:14.148857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 917/1710] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:14 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:14.153424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ac5a3f45-e00d-4d51-b8bd-8675e0b3ee7d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:14.154143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ac5a3f45-e00d-4d51-b8bd-8675e0b3ee7d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:14.161276 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac5a3f45-e00d-4d51-b8bd-8675e0b3ee7d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:14.161734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac5a3f45-e00d-4d51-b8bd-8675e0b3ee7d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:14.162486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac5a3f45-e00d-4d51-b8bd-8675e0b3ee7d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:14.162919 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac5a3f45-e00d-4d51-b8bd-8675e0b3ee7d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:14.291464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ac5a3f45-e00d-4d51-b8bd-8675e0b3ee7d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:14.299905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ac5a3f45-e00d-4d51-b8bd-8675e0b3ee7d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150342 Apr 07 13:20:14.300515 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 794/1711] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:14 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:14.810989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0e4a5c3b-55b3-4043-910c-c7563ba1e806 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:14.811652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0e4a5c3b-55b3-4043-910c-c7563ba1e806 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:14.819623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0e4a5c3b-55b3-4043-910c-c7563ba1e806 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:14.820107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0e4a5c3b-55b3-4043-910c-c7563ba1e806 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:14.820907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0e4a5c3b-55b3-4043-910c-c7563ba1e806 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:14.821339 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0e4a5c3b-55b3-4043-910c-c7563ba1e806 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:14.961675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0e4a5c3b-55b3-4043-910c-c7563ba1e806 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:14.976353 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0e4a5c3b-55b3-4043-910c-c7563ba1e806 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.169333 Apr 07 13:20:14.976926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 918/1712] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:14 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:15.167617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ab93e6da-6c2d-42b2-9157-6a2bfbb2a0f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:15.168239 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ab93e6da-6c2d-42b2-9157-6a2bfbb2a0f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:15.175373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ab93e6da-6c2d-42b2-9157-6a2bfbb2a0f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:15.176188 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ab93e6da-6c2d-42b2-9157-6a2bfbb2a0f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:15.177216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ab93e6da-6c2d-42b2-9157-6a2bfbb2a0f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:15.177859 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ab93e6da-6c2d-42b2-9157-6a2bfbb2a0f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:15.242339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ab93e6da-6c2d-42b2-9157-6a2bfbb2a0f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:15.252215 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ab93e6da-6c2d-42b2-9157-6a2bfbb2a0f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:15.253758 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ab93e6da-6c2d-42b2-9157-6a2bfbb2a0f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:15.255316 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ab93e6da-6c2d-42b2-9157-6a2bfbb2a0f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.091863 Apr 07 13:20:15.255901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 795/1713] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:15 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:15.316753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f8d2b3fc-5a32-4ff2-a07f-536040a3d740 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:15.317368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f8d2b3fc-5a32-4ff2-a07f-536040a3d740 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:15.323699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8d2b3fc-5a32-4ff2-a07f-536040a3d740 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:15.324167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8d2b3fc-5a32-4ff2-a07f-536040a3d740 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:15.324947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8d2b3fc-5a32-4ff2-a07f-536040a3d740 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:15.325381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f8d2b3fc-5a32-4ff2-a07f-536040a3d740 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:15.473404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f8d2b3fc-5a32-4ff2-a07f-536040a3d740 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:15.481354 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f8d2b3fc-5a32-4ff2-a07f-536040a3d740 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.169111 Apr 07 13:20:15.481917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 919/1714] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:15 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:15.994201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bd176348-b95d-4f51-9137-7f6711ce8fa8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:15.994832 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bd176348-b95d-4f51-9137-7f6711ce8fa8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:16.001437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd176348-b95d-4f51-9137-7f6711ce8fa8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:16.001893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd176348-b95d-4f51-9137-7f6711ce8fa8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:16.002677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd176348-b95d-4f51-9137-7f6711ce8fa8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:16.003121 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd176348-b95d-4f51-9137-7f6711ce8fa8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:16.136195 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bd176348-b95d-4f51-9137-7f6711ce8fa8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:16.144603 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bd176348-b95d-4f51-9137-7f6711ce8fa8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154121 Apr 07 13:20:16.145176 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 796/1715] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:15 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:16.276909 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-068ed363-8611-46a9-90ac-78a0f85c4a78 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:16.277547 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-068ed363-8611-46a9-90ac-78a0f85c4a78 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:16.283660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-068ed363-8611-46a9-90ac-78a0f85c4a78 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:16.284114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-068ed363-8611-46a9-90ac-78a0f85c4a78 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:16.284898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-068ed363-8611-46a9-90ac-78a0f85c4a78 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:16.285589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-068ed363-8611-46a9-90ac-78a0f85c4a78 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:16.344098 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-068ed363-8611-46a9-90ac-78a0f85c4a78 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:16.352458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-068ed363-8611-46a9-90ac-78a0f85c4a78 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:16.353943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-068ed363-8611-46a9-90ac-78a0f85c4a78 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:16.355071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-068ed363-8611-46a9-90ac-78a0f85c4a78 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081946 Apr 07 13:20:16.355622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 920/1716] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:16 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:16.499366 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-21ff0c89-6e6a-497a-92c8-f094a6153e66 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:16.499908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-21ff0c89-6e6a-497a-92c8-f094a6153e66 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:16.506808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-21ff0c89-6e6a-497a-92c8-f094a6153e66 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:16.507272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-21ff0c89-6e6a-497a-92c8-f094a6153e66 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:16.508045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-21ff0c89-6e6a-497a-92c8-f094a6153e66 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:16.508514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-21ff0c89-6e6a-497a-92c8-f094a6153e66 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:16.638479 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-21ff0c89-6e6a-497a-92c8-f094a6153e66 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:16.646301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-21ff0c89-6e6a-497a-92c8-f094a6153e66 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150954 Apr 07 13:20:16.646864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 797/1717] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:16 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:17.161612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c10daeb0-b058-45db-a041-c7cb95e25f04 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:17.162232 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c10daeb0-b058-45db-a041-c7cb95e25f04 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:17.168210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c10daeb0-b058-45db-a041-c7cb95e25f04 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:17.168662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c10daeb0-b058-45db-a041-c7cb95e25f04 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:17.169428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c10daeb0-b058-45db-a041-c7cb95e25f04 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:17.169865 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c10daeb0-b058-45db-a041-c7cb95e25f04 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:17.296898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c10daeb0-b058-45db-a041-c7cb95e25f04 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:17.305432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c10daeb0-b058-45db-a041-c7cb95e25f04 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148599 Apr 07 13:20:17.305999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 921/1718] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:17 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:17.372845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0e7ed5e6-a680-4da1-9ee3-73360c44a64b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:17.373475 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0e7ed5e6-a680-4da1-9ee3-73360c44a64b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:17.379423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e7ed5e6-a680-4da1-9ee3-73360c44a64b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:17.379879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e7ed5e6-a680-4da1-9ee3-73360c44a64b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:17.380680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e7ed5e6-a680-4da1-9ee3-73360c44a64b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:17.381125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0e7ed5e6-a680-4da1-9ee3-73360c44a64b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:17.440870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0e7ed5e6-a680-4da1-9ee3-73360c44a64b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:17.449053 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0e7ed5e6-a680-4da1-9ee3-73360c44a64b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:17.450546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0e7ed5e6-a680-4da1-9ee3-73360c44a64b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:17.451738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0e7ed5e6-a680-4da1-9ee3-73360c44a64b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082739 Apr 07 13:20:17.452407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 798/1719] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:17 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:17.663757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4d12839c-44a0-4c12-ab3c-605bc238b3f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:17.664430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4d12839c-44a0-4c12-ab3c-605bc238b3f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:17.670716 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d12839c-44a0-4c12-ab3c-605bc238b3f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:17.671168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d12839c-44a0-4c12-ab3c-605bc238b3f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:17.671924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d12839c-44a0-4c12-ab3c-605bc238b3f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:17.672412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4d12839c-44a0-4c12-ab3c-605bc238b3f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:17.807874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4d12839c-44a0-4c12-ab3c-605bc238b3f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:17.816741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4d12839c-44a0-4c12-ab3c-605bc238b3f6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157011 Apr 07 13:20:17.817306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 922/1720] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:17 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:18.322658 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d81a18ae-a4f0-4ffe-9990-aabe6d8a58e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:18.323257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d81a18ae-a4f0-4ffe-9990-aabe6d8a58e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:18.329823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d81a18ae-a4f0-4ffe-9990-aabe6d8a58e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:18.330304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d81a18ae-a4f0-4ffe-9990-aabe6d8a58e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:18.331117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d81a18ae-a4f0-4ffe-9990-aabe6d8a58e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:18.331557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d81a18ae-a4f0-4ffe-9990-aabe6d8a58e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:18.462635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d81a18ae-a4f0-4ffe-9990-aabe6d8a58e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:18.470881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c54f78f1-a455-46c6-8d07-cb7e5d01e84f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:18.471578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c54f78f1-a455-46c6-8d07-cb7e5d01e84f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:18.471699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d81a18ae-a4f0-4ffe-9990-aabe6d8a58e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.152835 Apr 07 13:20:18.472224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 799/1721] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:18 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:18.477535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c54f78f1-a455-46c6-8d07-cb7e5d01e84f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:18.477987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c54f78f1-a455-46c6-8d07-cb7e5d01e84f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:18.478746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c54f78f1-a455-46c6-8d07-cb7e5d01e84f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:18.479178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c54f78f1-a455-46c6-8d07-cb7e5d01e84f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:18.540582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c54f78f1-a455-46c6-8d07-cb7e5d01e84f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:18.549533 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c54f78f1-a455-46c6-8d07-cb7e5d01e84f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:18.551015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c54f78f1-a455-46c6-8d07-cb7e5d01e84f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:18.552133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c54f78f1-a455-46c6-8d07-cb7e5d01e84f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085879 Apr 07 13:20:18.552696 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 923/1722] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:18 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:20:18.834209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2258f881-a47d-4be9-84a9-5dfa8049978a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:18.834747 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2258f881-a47d-4be9-84a9-5dfa8049978a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:18.840732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2258f881-a47d-4be9-84a9-5dfa8049978a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:18.841181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2258f881-a47d-4be9-84a9-5dfa8049978a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:18.841939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2258f881-a47d-4be9-84a9-5dfa8049978a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:18.842371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2258f881-a47d-4be9-84a9-5dfa8049978a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:18.978090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2258f881-a47d-4be9-84a9-5dfa8049978a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:18.986436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2258f881-a47d-4be9-84a9-5dfa8049978a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156154 Apr 07 13:20:18.986997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 800/1723] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:18 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:19.489293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-50aaa0d2-81ba-42cc-b640-f6b7c6b502ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:19.489826 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-50aaa0d2-81ba-42cc-b640-f6b7c6b502ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:19.496096 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50aaa0d2-81ba-42cc-b640-f6b7c6b502ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:19.496575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50aaa0d2-81ba-42cc-b640-f6b7c6b502ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:19.497331 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50aaa0d2-81ba-42cc-b640-f6b7c6b502ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:19.497760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50aaa0d2-81ba-42cc-b640-f6b7c6b502ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:19.570101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-07189438-450e-44db-a30a-526a9737c244 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:19.570718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-07189438-450e-44db-a30a-526a9737c244 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:19.577203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-07189438-450e-44db-a30a-526a9737c244 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:19.577433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-07189438-450e-44db-a30a-526a9737c244 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:19.579315 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-07189438-450e-44db-a30a-526a9737c244 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:19.579870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-07189438-450e-44db-a30a-526a9737c244 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:19.640255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-07189438-450e-44db-a30a-526a9737c244 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:19.642753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-50aaa0d2-81ba-42cc-b640-f6b7c6b502ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:19.649260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-07189438-450e-44db-a30a-526a9737c244 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:19.650358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-50aaa0d2-81ba-42cc-b640-f6b7c6b502ca tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.165612 Apr 07 13:20:19.650757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-07189438-450e-44db-a30a-526a9737c244 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:19.651501 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 924/1724] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:19 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:19.651956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-07189438-450e-44db-a30a-526a9737c244 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085800 Apr 07 13:20:19.652547 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 801/1725] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:19 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:20:20.003406 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a71bfff6-078b-45d3-a42b-f9a858ceec33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:20.004015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a71bfff6-078b-45d3-a42b-f9a858ceec33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:20.010479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a71bfff6-078b-45d3-a42b-f9a858ceec33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:20.011197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a71bfff6-078b-45d3-a42b-f9a858ceec33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:20.012318 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a71bfff6-078b-45d3-a42b-f9a858ceec33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:20.013006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a71bfff6-078b-45d3-a42b-f9a858ceec33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:20.154442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a71bfff6-078b-45d3-a42b-f9a858ceec33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:20.164868 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a71bfff6-078b-45d3-a42b-f9a858ceec33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.165287 Apr 07 13:20:20.165439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 925/1726] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:19 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:20.674323 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-556f561b-bedb-4255-9709-7c3d79369e61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:20.675650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-556f561b-bedb-4255-9709-7c3d79369e61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:20.679374 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-01fd3437-2931-471a-b1c0-93ec92ccad43 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:20.680067 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-01fd3437-2931-471a-b1c0-93ec92ccad43 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:20.686476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-556f561b-bedb-4255-9709-7c3d79369e61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:20.686964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-01fd3437-2931-471a-b1c0-93ec92ccad43 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:20.687199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-556f561b-bedb-4255-9709-7c3d79369e61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:20.687418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-01fd3437-2931-471a-b1c0-93ec92ccad43 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:20.688900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-01fd3437-2931-471a-b1c0-93ec92ccad43 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:20.689023 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-556f561b-bedb-4255-9709-7c3d79369e61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:20.689343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-01fd3437-2931-471a-b1c0-93ec92ccad43 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:20.689681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-556f561b-bedb-4255-9709-7c3d79369e61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:20.778778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-556f561b-bedb-4255-9709-7c3d79369e61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:20.792925 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-556f561b-bedb-4255-9709-7c3d79369e61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:20.795477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-556f561b-bedb-4255-9709-7c3d79369e61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:20.796707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-556f561b-bedb-4255-9709-7c3d79369e61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.129799 Apr 07 13:20:20.798324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 802/1727] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:20 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:20.829408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-01fd3437-2931-471a-b1c0-93ec92ccad43 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:20.838167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-01fd3437-2931-471a-b1c0-93ec92ccad43 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.162595 Apr 07 13:20:20.838735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 926/1728] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:20 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:20:21.182904 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-10598b23-5fe9-41b0-9f7d-e5ab1f3903cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:21.183525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-10598b23-5fe9-41b0-9f7d-e5ab1f3903cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:21.189700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-10598b23-5fe9-41b0-9f7d-e5ab1f3903cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:21.190177 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-10598b23-5fe9-41b0-9f7d-e5ab1f3903cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:21.190946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-10598b23-5fe9-41b0-9f7d-e5ab1f3903cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:21.191392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-10598b23-5fe9-41b0-9f7d-e5ab1f3903cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:21.322319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-10598b23-5fe9-41b0-9f7d-e5ab1f3903cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:21.331317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-10598b23-5fe9-41b0-9f7d-e5ab1f3903cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152360 Apr 07 13:20:21.331875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 803/1729] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:21 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:21.816181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fb81a605-a93b-4774-b02e-d4ad236175d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:21.816816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fb81a605-a93b-4774-b02e-d4ad236175d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:21.823152 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb81a605-a93b-4774-b02e-d4ad236175d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:21.823595 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb81a605-a93b-4774-b02e-d4ad236175d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:21.824470 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb81a605-a93b-4774-b02e-d4ad236175d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:21.824903 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb81a605-a93b-4774-b02e-d4ad236175d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:21.857596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b7d4e715-0f6b-4efc-976e-278e50a36021 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:21.858216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b7d4e715-0f6b-4efc-976e-278e50a36021 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:21.867666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7d4e715-0f6b-4efc-976e-278e50a36021 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:21.868339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7d4e715-0f6b-4efc-976e-278e50a36021 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:21.869524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7d4e715-0f6b-4efc-976e-278e50a36021 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:21.869972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7d4e715-0f6b-4efc-976e-278e50a36021 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:21.887026 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fb81a605-a93b-4774-b02e-d4ad236175d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:21.895549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fb81a605-a93b-4774-b02e-d4ad236175d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:21.897251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fb81a605-a93b-4774-b02e-d4ad236175d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:21.899219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fb81a605-a93b-4774-b02e-d4ad236175d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088002 Apr 07 13:20:21.899957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 927/1730] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:21 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:22.012770 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b7d4e715-0f6b-4efc-976e-278e50a36021 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:22.020815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b7d4e715-0f6b-4efc-976e-278e50a36021 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.167133 Apr 07 13:20:22.021378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 804/1731] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:21 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:20:22.350311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8b319195-7f2e-4501-a668-0a7d2379acf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:22.350846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8b319195-7f2e-4501-a668-0a7d2379acf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:22.356764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8b319195-7f2e-4501-a668-0a7d2379acf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:22.357212 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8b319195-7f2e-4501-a668-0a7d2379acf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:22.357973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8b319195-7f2e-4501-a668-0a7d2379acf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:22.358399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8b319195-7f2e-4501-a668-0a7d2379acf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:22.494617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8b319195-7f2e-4501-a668-0a7d2379acf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:22.502579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8b319195-7f2e-4501-a668-0a7d2379acf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157309 Apr 07 13:20:22.503142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 928/1732] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:22 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:22.921451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9861c599-67c2-48cf-8376-9ace24eec145 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:22.922548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9861c599-67c2-48cf-8376-9ace24eec145 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:22.928957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9861c599-67c2-48cf-8376-9ace24eec145 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:22.929401 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9861c599-67c2-48cf-8376-9ace24eec145 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:22.930171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9861c599-67c2-48cf-8376-9ace24eec145 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:22.930610 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9861c599-67c2-48cf-8376-9ace24eec145 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:22.992707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9861c599-67c2-48cf-8376-9ace24eec145 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:23.000816 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9861c599-67c2-48cf-8376-9ace24eec145 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:23.002354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9861c599-67c2-48cf-8376-9ace24eec145 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:23.003493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9861c599-67c2-48cf-8376-9ace24eec145 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086677 Apr 07 13:20:23.004051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 805/1733] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:23.038359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e6f2a40b-9c77-4256-8284-80008bc1292f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:23.038968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e6f2a40b-9c77-4256-8284-80008bc1292f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:23.045202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e6f2a40b-9c77-4256-8284-80008bc1292f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:23.045647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e6f2a40b-9c77-4256-8284-80008bc1292f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:23.046399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e6f2a40b-9c77-4256-8284-80008bc1292f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:23.046832 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e6f2a40b-9c77-4256-8284-80008bc1292f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:23.174570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e6f2a40b-9c77-4256-8284-80008bc1292f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:23.182255 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e6f2a40b-9c77-4256-8284-80008bc1292f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.147979 Apr 07 13:20:23.182814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 929/1734] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:23 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:23.520086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9961c8f7-7d05-49a5-84f6-6293444005a5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:23.520656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9961c8f7-7d05-49a5-84f6-6293444005a5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:23.526549 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9961c8f7-7d05-49a5-84f6-6293444005a5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:23.527003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9961c8f7-7d05-49a5-84f6-6293444005a5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:23.527767 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9961c8f7-7d05-49a5-84f6-6293444005a5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:23.528234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9961c8f7-7d05-49a5-84f6-6293444005a5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:23.655403 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9961c8f7-7d05-49a5-84f6-6293444005a5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:23.663584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9961c8f7-7d05-49a5-84f6-6293444005a5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.147431 Apr 07 13:20:23.664188 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 806/1735] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:23 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:24.022278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f71d74b1-d71c-4457-911a-64537cd38103 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:24.022883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f71d74b1-d71c-4457-911a-64537cd38103 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:24.028799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f71d74b1-d71c-4457-911a-64537cd38103 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:24.029241 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f71d74b1-d71c-4457-911a-64537cd38103 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:24.029992 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f71d74b1-d71c-4457-911a-64537cd38103 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:24.030453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f71d74b1-d71c-4457-911a-64537cd38103 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:24.092782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f71d74b1-d71c-4457-911a-64537cd38103 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:24.101256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f71d74b1-d71c-4457-911a-64537cd38103 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:24.102735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f71d74b1-d71c-4457-911a-64537cd38103 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:24.103854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f71d74b1-d71c-4457-911a-64537cd38103 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085477 Apr 07 13:20:24.104445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 930/1736] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:24 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:24.199015 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4451a2c0-756d-47f0-bb86-d924103a70e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:24.199634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4451a2c0-756d-47f0-bb86-d924103a70e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:24.206036 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4451a2c0-756d-47f0-bb86-d924103a70e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:24.206488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4451a2c0-756d-47f0-bb86-d924103a70e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:24.207271 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4451a2c0-756d-47f0-bb86-d924103a70e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:24.207714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4451a2c0-756d-47f0-bb86-d924103a70e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:24.337360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4451a2c0-756d-47f0-bb86-d924103a70e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:24.345444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4451a2c0-756d-47f0-bb86-d924103a70e8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.150213 Apr 07 13:20:24.346015 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 807/1737] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:24 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:24.681288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fabc2b7b-13ac-44ad-850f-47ca9114115b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:24.681898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fabc2b7b-13ac-44ad-850f-47ca9114115b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:24.687773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fabc2b7b-13ac-44ad-850f-47ca9114115b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:24.688247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fabc2b7b-13ac-44ad-850f-47ca9114115b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:24.689000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fabc2b7b-13ac-44ad-850f-47ca9114115b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:24.689429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fabc2b7b-13ac-44ad-850f-47ca9114115b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:24.817783 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fabc2b7b-13ac-44ad-850f-47ca9114115b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:24.825685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fabc2b7b-13ac-44ad-850f-47ca9114115b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.148188 Apr 07 13:20:24.826258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 931/1738] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:24 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:25.122712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0565c40f-9d49-4176-9a72-b482266eeff9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:25.123333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0565c40f-9d49-4176-9a72-b482266eeff9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:25.129855 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0565c40f-9d49-4176-9a72-b482266eeff9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:25.130311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0565c40f-9d49-4176-9a72-b482266eeff9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:25.131084 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0565c40f-9d49-4176-9a72-b482266eeff9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:25.131525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0565c40f-9d49-4176-9a72-b482266eeff9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:25.192974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0565c40f-9d49-4176-9a72-b482266eeff9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:25.201321 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0565c40f-9d49-4176-9a72-b482266eeff9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:25.202819 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0565c40f-9d49-4176-9a72-b482266eeff9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:25.204001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0565c40f-9d49-4176-9a72-b482266eeff9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085171 Apr 07 13:20:25.204595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 808/1739] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:25 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:25.362866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b57eb26f-a393-46fb-a089-75fde5229e0b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:25.363479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b57eb26f-a393-46fb-a089-75fde5229e0b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:25.369894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b57eb26f-a393-46fb-a089-75fde5229e0b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:25.370339 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b57eb26f-a393-46fb-a089-75fde5229e0b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:25.371089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b57eb26f-a393-46fb-a089-75fde5229e0b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:25.371519 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b57eb26f-a393-46fb-a089-75fde5229e0b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:25.499456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b57eb26f-a393-46fb-a089-75fde5229e0b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:25.509995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b57eb26f-a393-46fb-a089-75fde5229e0b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151256 Apr 07 13:20:25.510562 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 932/1740] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:25 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:25.842838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-94c52d31-5251-42d6-9889-fa72b95f2a5b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:25.843374 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-94c52d31-5251-42d6-9889-fa72b95f2a5b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:25.849819 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94c52d31-5251-42d6-9889-fa72b95f2a5b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:25.850271 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94c52d31-5251-42d6-9889-fa72b95f2a5b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:25.851161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94c52d31-5251-42d6-9889-fa72b95f2a5b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:25.851686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94c52d31-5251-42d6-9889-fa72b95f2a5b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:25.993551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-94c52d31-5251-42d6-9889-fa72b95f2a5b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:26.001553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-94c52d31-5251-42d6-9889-fa72b95f2a5b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.162645 Apr 07 13:20:26.002125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 809/1741] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:25 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:26.221897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3f7bcb3a-b3f7-4a10-8b7c-e574fe5ec3f4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:26.222508 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3f7bcb3a-b3f7-4a10-8b7c-e574fe5ec3f4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:26.228439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f7bcb3a-b3f7-4a10-8b7c-e574fe5ec3f4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:26.228889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f7bcb3a-b3f7-4a10-8b7c-e574fe5ec3f4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:26.229649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f7bcb3a-b3f7-4a10-8b7c-e574fe5ec3f4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:26.230082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f7bcb3a-b3f7-4a10-8b7c-e574fe5ec3f4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:26.292754 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3f7bcb3a-b3f7-4a10-8b7c-e574fe5ec3f4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:26.301543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3f7bcb3a-b3f7-4a10-8b7c-e574fe5ec3f4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:26.303033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3f7bcb3a-b3f7-4a10-8b7c-e574fe5ec3f4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:26.304185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3f7bcb3a-b3f7-4a10-8b7c-e574fe5ec3f4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086760 Apr 07 13:20:26.304734 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 933/1742] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:26 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:26.528959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3dcab7bf-c284-4064-b3ed-fd6cd4251741 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:26.529536 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3dcab7bf-c284-4064-b3ed-fd6cd4251741 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:26.536462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3dcab7bf-c284-4064-b3ed-fd6cd4251741 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:26.536931 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3dcab7bf-c284-4064-b3ed-fd6cd4251741 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:26.537686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3dcab7bf-c284-4064-b3ed-fd6cd4251741 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:26.538120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3dcab7bf-c284-4064-b3ed-fd6cd4251741 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:26.667677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3dcab7bf-c284-4064-b3ed-fd6cd4251741 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:26.676169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3dcab7bf-c284-4064-b3ed-fd6cd4251741 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151149 Apr 07 13:20:26.676732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 810/1743] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:26 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:27.018554 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-80d478cd-d61f-4570-bb81-11b0fa1e2f4c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:27.019159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-80d478cd-d61f-4570-bb81-11b0fa1e2f4c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:27.025546 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80d478cd-d61f-4570-bb81-11b0fa1e2f4c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:27.025996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80d478cd-d61f-4570-bb81-11b0fa1e2f4c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:27.026757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80d478cd-d61f-4570-bb81-11b0fa1e2f4c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:27.027191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80d478cd-d61f-4570-bb81-11b0fa1e2f4c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:27.156988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-80d478cd-d61f-4570-bb81-11b0fa1e2f4c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:27.166863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-80d478cd-d61f-4570-bb81-11b0fa1e2f4c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152720 Apr 07 13:20:27.167440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 934/1744] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:27 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:27.322455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-290f9c68-0137-45ad-a503-0f65f147efe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:27.323066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-290f9c68-0137-45ad-a503-0f65f147efe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:27.329668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-290f9c68-0137-45ad-a503-0f65f147efe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:27.330120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-290f9c68-0137-45ad-a503-0f65f147efe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:27.330880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-290f9c68-0137-45ad-a503-0f65f147efe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:27.331315 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-290f9c68-0137-45ad-a503-0f65f147efe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:27.392864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-290f9c68-0137-45ad-a503-0f65f147efe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:27.401062 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-290f9c68-0137-45ad-a503-0f65f147efe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:27.402551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-290f9c68-0137-45ad-a503-0f65f147efe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:27.403696 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-290f9c68-0137-45ad-a503-0f65f147efe1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085199 Apr 07 13:20:27.404274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 811/1745] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:27 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:27.693785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bbaa78d3-8cd1-4040-8ce4-b7f497cbb2c5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:27.694368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bbaa78d3-8cd1-4040-8ce4-b7f497cbb2c5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:27.700322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbaa78d3-8cd1-4040-8ce4-b7f497cbb2c5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:27.700776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbaa78d3-8cd1-4040-8ce4-b7f497cbb2c5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:27.701539 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbaa78d3-8cd1-4040-8ce4-b7f497cbb2c5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:27.701977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbaa78d3-8cd1-4040-8ce4-b7f497cbb2c5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:27.833259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bbaa78d3-8cd1-4040-8ce4-b7f497cbb2c5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:27.840987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bbaa78d3-8cd1-4040-8ce4-b7f497cbb2c5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.151140 Apr 07 13:20:27.841549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 935/1746] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:27 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:28.185848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-50765b96-7f62-426a-aa18-6eb9a6c98dad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:28.186461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-50765b96-7f62-426a-aa18-6eb9a6c98dad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:28.192974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-50765b96-7f62-426a-aa18-6eb9a6c98dad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:28.193423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-50765b96-7f62-426a-aa18-6eb9a6c98dad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:28.194177 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-50765b96-7f62-426a-aa18-6eb9a6c98dad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:28.194614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-50765b96-7f62-426a-aa18-6eb9a6c98dad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:28.326428 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-50765b96-7f62-426a-aa18-6eb9a6c98dad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:28.335208 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-50765b96-7f62-426a-aa18-6eb9a6c98dad tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153197 Apr 07 13:20:28.335770 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 812/1747] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:28 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:28.423062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e20267e0-66a1-4580-a302-07402dba50b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:28.423676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e20267e0-66a1-4580-a302-07402dba50b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:28.430147 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e20267e0-66a1-4580-a302-07402dba50b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:28.430595 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e20267e0-66a1-4580-a302-07402dba50b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:28.431377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e20267e0-66a1-4580-a302-07402dba50b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:28.431807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e20267e0-66a1-4580-a302-07402dba50b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:28.493444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e20267e0-66a1-4580-a302-07402dba50b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:28.502551 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e20267e0-66a1-4580-a302-07402dba50b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:28.504326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e20267e0-66a1-4580-a302-07402dba50b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:28.505472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e20267e0-66a1-4580-a302-07402dba50b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086921 Apr 07 13:20:28.506015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 936/1748] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:28 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:28.858606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-435b71ab-a762-4e47-9b58-706637d77a2c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:28.859218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-435b71ab-a762-4e47-9b58-706637d77a2c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:28.865292 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-435b71ab-a762-4e47-9b58-706637d77a2c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:28.865742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-435b71ab-a762-4e47-9b58-706637d77a2c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:28.866502 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-435b71ab-a762-4e47-9b58-706637d77a2c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:28.866930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-435b71ab-a762-4e47-9b58-706637d77a2c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:28.995198 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-435b71ab-a762-4e47-9b58-706637d77a2c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:29.003969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-435b71ab-a762-4e47-9b58-706637d77a2c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149224 Apr 07 13:20:29.004566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 813/1749] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:28 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:29.352576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-124d5a27-543d-4241-90da-9dcb293dfab1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:29.353194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-124d5a27-543d-4241-90da-9dcb293dfab1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:29.359057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-124d5a27-543d-4241-90da-9dcb293dfab1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:29.360125 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-124d5a27-543d-4241-90da-9dcb293dfab1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:29.361093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-124d5a27-543d-4241-90da-9dcb293dfab1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:29.361532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-124d5a27-543d-4241-90da-9dcb293dfab1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:29.491738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-124d5a27-543d-4241-90da-9dcb293dfab1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:29.499588 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-124d5a27-543d-4241-90da-9dcb293dfab1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150886 Apr 07 13:20:29.501146 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 937/1750] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:29 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:29.522622 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-888b8e21-ccf1-45f8-8e90-51f51d8ef534 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:29.523230 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-888b8e21-ccf1-45f8-8e90-51f51d8ef534 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:29.529398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-888b8e21-ccf1-45f8-8e90-51f51d8ef534 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:29.529844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-888b8e21-ccf1-45f8-8e90-51f51d8ef534 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:29.530601 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-888b8e21-ccf1-45f8-8e90-51f51d8ef534 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:29.531030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-888b8e21-ccf1-45f8-8e90-51f51d8ef534 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:29.593327 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-888b8e21-ccf1-45f8-8e90-51f51d8ef534 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:29.601966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-888b8e21-ccf1-45f8-8e90-51f51d8ef534 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:29.603506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-888b8e21-ccf1-45f8-8e90-51f51d8ef534 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:29.604652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-888b8e21-ccf1-45f8-8e90-51f51d8ef534 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085830 Apr 07 13:20:29.605218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 814/1751] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:29 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:30.021103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-626fc55e-0c1b-42d8-81f5-9beeb68bb514 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:30.021607 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-626fc55e-0c1b-42d8-81f5-9beeb68bb514 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:30.027482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-626fc55e-0c1b-42d8-81f5-9beeb68bb514 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:30.027922 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-626fc55e-0c1b-42d8-81f5-9beeb68bb514 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:30.028709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-626fc55e-0c1b-42d8-81f5-9beeb68bb514 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:30.029137 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-626fc55e-0c1b-42d8-81f5-9beeb68bb514 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:30.159089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-626fc55e-0c1b-42d8-81f5-9beeb68bb514 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:30.167068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-626fc55e-0c1b-42d8-81f5-9beeb68bb514 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149972 Apr 07 13:20:30.167621 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 938/1752] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:30 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:30.516760 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1cf10b02-9a09-4536-b08b-1996b94a0690 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:30.517376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1cf10b02-9a09-4536-b08b-1996b94a0690 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:30.523281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1cf10b02-9a09-4536-b08b-1996b94a0690 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:30.523835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1cf10b02-9a09-4536-b08b-1996b94a0690 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:30.524518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1cf10b02-9a09-4536-b08b-1996b94a0690 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:30.524959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1cf10b02-9a09-4536-b08b-1996b94a0690 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:30.622830 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-063c968a-fa3c-40af-80d0-4feee0d82d94 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:30.623437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-063c968a-fa3c-40af-80d0-4feee0d82d94 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:30.630216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-063c968a-fa3c-40af-80d0-4feee0d82d94 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:30.630647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-063c968a-fa3c-40af-80d0-4feee0d82d94 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:30.631403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-063c968a-fa3c-40af-80d0-4feee0d82d94 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:30.631839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-063c968a-fa3c-40af-80d0-4feee0d82d94 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:30.663580 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1cf10b02-9a09-4536-b08b-1996b94a0690 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:30.671507 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1cf10b02-9a09-4536-b08b-1996b94a0690 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158690 Apr 07 13:20:30.672970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 815/1753] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:30 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:30.694543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-063c968a-fa3c-40af-80d0-4feee0d82d94 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:30.702949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-063c968a-fa3c-40af-80d0-4feee0d82d94 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:30.704463 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-063c968a-fa3c-40af-80d0-4feee0d82d94 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:30.705664 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-063c968a-fa3c-40af-80d0-4feee0d82d94 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086652 Apr 07 13:20:30.706223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 939/1754] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:30 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:20:31.184439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d47fc7a9-6c65-4f3b-a2b2-0e5afd34f77c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:31.185053 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d47fc7a9-6c65-4f3b-a2b2-0e5afd34f77c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:31.191409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d47fc7a9-6c65-4f3b-a2b2-0e5afd34f77c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:31.191838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d47fc7a9-6c65-4f3b-a2b2-0e5afd34f77c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:31.192630 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d47fc7a9-6c65-4f3b-a2b2-0e5afd34f77c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:31.193064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d47fc7a9-6c65-4f3b-a2b2-0e5afd34f77c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:31.321989 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d47fc7a9-6c65-4f3b-a2b2-0e5afd34f77c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:31.330518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d47fc7a9-6c65-4f3b-a2b2-0e5afd34f77c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149915 Apr 07 13:20:31.331127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 816/1755] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:31 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:31.689555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4961c08a-405d-4955-ae62-2836d1513584 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:31.690184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4961c08a-405d-4955-ae62-2836d1513584 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:31.696486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4961c08a-405d-4955-ae62-2836d1513584 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:31.696932 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4961c08a-405d-4955-ae62-2836d1513584 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:31.697683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4961c08a-405d-4955-ae62-2836d1513584 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:31.698113 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4961c08a-405d-4955-ae62-2836d1513584 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:31.723811 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7ccaa70f-fb69-4818-b953-f1e8d905dea2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:31.724476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7ccaa70f-fb69-4818-b953-f1e8d905dea2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:31.731125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7ccaa70f-fb69-4818-b953-f1e8d905dea2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:31.731780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7ccaa70f-fb69-4818-b953-f1e8d905dea2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:31.732599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7ccaa70f-fb69-4818-b953-f1e8d905dea2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:31.733052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7ccaa70f-fb69-4818-b953-f1e8d905dea2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:31.805296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7ccaa70f-fb69-4818-b953-f1e8d905dea2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:31.815201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7ccaa70f-fb69-4818-b953-f1e8d905dea2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:31.816722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7ccaa70f-fb69-4818-b953-f1e8d905dea2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:31.817889 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7ccaa70f-fb69-4818-b953-f1e8d905dea2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.098998 Apr 07 13:20:31.819192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 817/1756] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:31 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:20:31.848693 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4961c08a-405d-4955-ae62-2836d1513584 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:31.856565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4961c08a-405d-4955-ae62-2836d1513584 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.171513 Apr 07 13:20:31.857129 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 940/1757] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:31 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:32.348465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-111e331d-7604-48b0-af65-d05538746180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:32.349079 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-111e331d-7604-48b0-af65-d05538746180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:32.354987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-111e331d-7604-48b0-af65-d05538746180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:32.355434 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-111e331d-7604-48b0-af65-d05538746180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:32.356218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-111e331d-7604-48b0-af65-d05538746180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:32.356653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-111e331d-7604-48b0-af65-d05538746180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:32.486452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-111e331d-7604-48b0-af65-d05538746180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:32.494104 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-111e331d-7604-48b0-af65-d05538746180 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149656 Apr 07 13:20:32.494685 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 818/1758] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:32 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:32.834785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b04ed8bf-2edb-47ab-bed5-b6db92929dcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:32.835393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b04ed8bf-2edb-47ab-bed5-b6db92929dcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:32.841668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b04ed8bf-2edb-47ab-bed5-b6db92929dcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:32.842121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b04ed8bf-2edb-47ab-bed5-b6db92929dcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:32.842875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b04ed8bf-2edb-47ab-bed5-b6db92929dcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:32.843310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b04ed8bf-2edb-47ab-bed5-b6db92929dcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:32.874027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-538e6508-14eb-45ba-a314-d6f71a877756 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:32.874634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-538e6508-14eb-45ba-a314-d6f71a877756 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:32.881700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-538e6508-14eb-45ba-a314-d6f71a877756 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:32.882142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-538e6508-14eb-45ba-a314-d6f71a877756 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:32.882908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-538e6508-14eb-45ba-a314-d6f71a877756 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:32.883341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-538e6508-14eb-45ba-a314-d6f71a877756 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:32.901977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b04ed8bf-2edb-47ab-bed5-b6db92929dcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:32.910812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b04ed8bf-2edb-47ab-bed5-b6db92929dcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:32.912312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b04ed8bf-2edb-47ab-bed5-b6db92929dcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:32.913443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b04ed8bf-2edb-47ab-bed5-b6db92929dcd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082552 Apr 07 13:20:32.913995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 941/1759] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:32 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:33.013654 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-538e6508-14eb-45ba-a314-d6f71a877756 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:33.021939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-538e6508-14eb-45ba-a314-d6f71a877756 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151722 Apr 07 13:20:33.022502 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 819/1760] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:32 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:20:33.512370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-60ca959e-72f3-4cd4-b94e-4c346019d548 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:33.512982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-60ca959e-72f3-4cd4-b94e-4c346019d548 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:33.519534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60ca959e-72f3-4cd4-b94e-4c346019d548 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:33.519979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60ca959e-72f3-4cd4-b94e-4c346019d548 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:33.520771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60ca959e-72f3-4cd4-b94e-4c346019d548 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:33.521217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60ca959e-72f3-4cd4-b94e-4c346019d548 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:33.654508 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-60ca959e-72f3-4cd4-b94e-4c346019d548 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:33.662931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-60ca959e-72f3-4cd4-b94e-4c346019d548 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154327 Apr 07 13:20:33.663503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 942/1761] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:33 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:33.932450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0dd10903-0e19-4e46-9a3a-1f4e79daf906 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:33.933063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0dd10903-0e19-4e46-9a3a-1f4e79daf906 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:33.939850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0dd10903-0e19-4e46-9a3a-1f4e79daf906 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:33.940333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0dd10903-0e19-4e46-9a3a-1f4e79daf906 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:33.941105 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0dd10903-0e19-4e46-9a3a-1f4e79daf906 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:33.941541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0dd10903-0e19-4e46-9a3a-1f4e79daf906 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:34.003219 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0dd10903-0e19-4e46-9a3a-1f4e79daf906 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:34.011378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0dd10903-0e19-4e46-9a3a-1f4e79daf906 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:34.012913 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0dd10903-0e19-4e46-9a3a-1f4e79daf906 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:34.014059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0dd10903-0e19-4e46-9a3a-1f4e79daf906 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085521 Apr 07 13:20:34.014621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 820/1762] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:33 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:34.039976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c3073543-4511-4a7f-a21b-1ef3a6acf04b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:34.040613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c3073543-4511-4a7f-a21b-1ef3a6acf04b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:34.047577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c3073543-4511-4a7f-a21b-1ef3a6acf04b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:34.048025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c3073543-4511-4a7f-a21b-1ef3a6acf04b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:34.048817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c3073543-4511-4a7f-a21b-1ef3a6acf04b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:34.049246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c3073543-4511-4a7f-a21b-1ef3a6acf04b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:34.177871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c3073543-4511-4a7f-a21b-1ef3a6acf04b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:34.185771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c3073543-4511-4a7f-a21b-1ef3a6acf04b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149461 Apr 07 13:20:34.186320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 943/1763] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:34 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:34.679902 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ec93e849-a664-46ce-b7c4-e9b35ba53916 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:34.680556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ec93e849-a664-46ce-b7c4-e9b35ba53916 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:34.686532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ec93e849-a664-46ce-b7c4-e9b35ba53916 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:34.686982 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ec93e849-a664-46ce-b7c4-e9b35ba53916 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:34.687889 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ec93e849-a664-46ce-b7c4-e9b35ba53916 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:34.688371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ec93e849-a664-46ce-b7c4-e9b35ba53916 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:34.816853 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ec93e849-a664-46ce-b7c4-e9b35ba53916 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:34.824675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ec93e849-a664-46ce-b7c4-e9b35ba53916 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.148524 Apr 07 13:20:34.825241 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 821/1764] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:34 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:20:35.031978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7010d10a-d703-4a3a-bf7c-c8af8f8be5c9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:35.032620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7010d10a-d703-4a3a-bf7c-c8af8f8be5c9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:35.038802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7010d10a-d703-4a3a-bf7c-c8af8f8be5c9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:35.039254 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7010d10a-d703-4a3a-bf7c-c8af8f8be5c9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:35.040014 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7010d10a-d703-4a3a-bf7c-c8af8f8be5c9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:35.040569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7010d10a-d703-4a3a-bf7c-c8af8f8be5c9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:35.098844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7010d10a-d703-4a3a-bf7c-c8af8f8be5c9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:35.106882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7010d10a-d703-4a3a-bf7c-c8af8f8be5c9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:35.108406 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7010d10a-d703-4a3a-bf7c-c8af8f8be5c9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:35.109668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7010d10a-d703-4a3a-bf7c-c8af8f8be5c9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081721 Apr 07 13:20:35.110230 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 944/1765] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:35 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:35.204283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6618268b-f686-4ea0-8428-348983ecdc9a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:35.204898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6618268b-f686-4ea0-8428-348983ecdc9a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:35.211109 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6618268b-f686-4ea0-8428-348983ecdc9a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:35.211554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6618268b-f686-4ea0-8428-348983ecdc9a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:35.212341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6618268b-f686-4ea0-8428-348983ecdc9a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:35.212784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6618268b-f686-4ea0-8428-348983ecdc9a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:35.341919 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6618268b-f686-4ea0-8428-348983ecdc9a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:35.349842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6618268b-f686-4ea0-8428-348983ecdc9a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150510 Apr 07 13:20:35.350406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 822/1766] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:35 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:35.842211 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bce51df7-c59c-4576-ae65-17e9c024bb6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:35.842748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bce51df7-c59c-4576-ae65-17e9c024bb6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:35.849718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bce51df7-c59c-4576-ae65-17e9c024bb6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:35.850168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bce51df7-c59c-4576-ae65-17e9c024bb6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:35.850923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bce51df7-c59c-4576-ae65-17e9c024bb6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:35.851386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bce51df7-c59c-4576-ae65-17e9c024bb6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:35.985104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bce51df7-c59c-4576-ae65-17e9c024bb6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:35.993085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bce51df7-c59c-4576-ae65-17e9c024bb6e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.154722 Apr 07 13:20:35.993661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 945/1767] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:35 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:36.126722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4a7d7fe2-06d5-463e-9e96-971d9d23bc29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:36.127344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4a7d7fe2-06d5-463e-9e96-971d9d23bc29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:36.133337 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4a7d7fe2-06d5-463e-9e96-971d9d23bc29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:36.133794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4a7d7fe2-06d5-463e-9e96-971d9d23bc29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:36.134556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4a7d7fe2-06d5-463e-9e96-971d9d23bc29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:36.134994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4a7d7fe2-06d5-463e-9e96-971d9d23bc29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:36.197641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4a7d7fe2-06d5-463e-9e96-971d9d23bc29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:36.206505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4a7d7fe2-06d5-463e-9e96-971d9d23bc29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:36.208001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4a7d7fe2-06d5-463e-9e96-971d9d23bc29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:36.209174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4a7d7fe2-06d5-463e-9e96-971d9d23bc29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086348 Apr 07 13:20:36.209735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 823/1768] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:36 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:36.366998 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9a90599c-915f-4477-9b8b-e03466636855 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:36.367611 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9a90599c-915f-4477-9b8b-e03466636855 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:36.373985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a90599c-915f-4477-9b8b-e03466636855 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:36.374434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a90599c-915f-4477-9b8b-e03466636855 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:36.375961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a90599c-915f-4477-9b8b-e03466636855 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:36.376432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a90599c-915f-4477-9b8b-e03466636855 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:36.655503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9a90599c-915f-4477-9b8b-e03466636855 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:36.663973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9a90599c-915f-4477-9b8b-e03466636855 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.300808 Apr 07 13:20:36.664563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 946/1769] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:36 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:37.010201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1434e432-9cc0-4672-a863-5597cd7f88f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:37.010796 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1434e432-9cc0-4672-a863-5597cd7f88f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:37.018234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1434e432-9cc0-4672-a863-5597cd7f88f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:37.018681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1434e432-9cc0-4672-a863-5597cd7f88f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:37.019440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1434e432-9cc0-4672-a863-5597cd7f88f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:37.019875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1434e432-9cc0-4672-a863-5597cd7f88f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:37.148130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1434e432-9cc0-4672-a863-5597cd7f88f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:37.156610 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1434e432-9cc0-4672-a863-5597cd7f88f7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.149581 Apr 07 13:20:37.157193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 824/1770] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:37 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:20:37.227440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b61e1d8c-723c-4303-bb04-9f9144451bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:37.228052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b61e1d8c-723c-4303-bb04-9f9144451bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:37.233982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b61e1d8c-723c-4303-bb04-9f9144451bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:37.234447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b61e1d8c-723c-4303-bb04-9f9144451bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:37.235210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b61e1d8c-723c-4303-bb04-9f9144451bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:37.235646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b61e1d8c-723c-4303-bb04-9f9144451bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:37.299733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b61e1d8c-723c-4303-bb04-9f9144451bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:37.308094 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b61e1d8c-723c-4303-bb04-9f9144451bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:37.309641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b61e1d8c-723c-4303-bb04-9f9144451bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:37.310770 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b61e1d8c-723c-4303-bb04-9f9144451bc1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087158 Apr 07 13:20:37.311329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 947/1771] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:37 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:37.681061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-71173fe9-ba43-4fd1-b63e-c5c226fd170a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:37.681662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-71173fe9-ba43-4fd1-b63e-c5c226fd170a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:37.687674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71173fe9-ba43-4fd1-b63e-c5c226fd170a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:37.688880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71173fe9-ba43-4fd1-b63e-c5c226fd170a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:37.689665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71173fe9-ba43-4fd1-b63e-c5c226fd170a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:37.690110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71173fe9-ba43-4fd1-b63e-c5c226fd170a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:37.823184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-71173fe9-ba43-4fd1-b63e-c5c226fd170a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:37.831592 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-71173fe9-ba43-4fd1-b63e-c5c226fd170a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154423 Apr 07 13:20:37.832177 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 825/1772] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:37 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:38.173056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a66d3389-8301-4fd8-be60-67272bc38a38 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:38.173666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a66d3389-8301-4fd8-be60-67272bc38a38 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:38.180125 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a66d3389-8301-4fd8-be60-67272bc38a38 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:38.180605 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a66d3389-8301-4fd8-be60-67272bc38a38 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:38.181415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a66d3389-8301-4fd8-be60-67272bc38a38 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:38.181853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a66d3389-8301-4fd8-be60-67272bc38a38 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:38.335155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c4b69f3e-dcad-45db-a96b-00679375c934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:38.336135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c4b69f3e-dcad-45db-a96b-00679375c934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:38.345604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c4b69f3e-dcad-45db-a96b-00679375c934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:38.346090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c4b69f3e-dcad-45db-a96b-00679375c934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:38.346955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c4b69f3e-dcad-45db-a96b-00679375c934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:38.347642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c4b69f3e-dcad-45db-a96b-00679375c934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:38.414591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c4b69f3e-dcad-45db-a96b-00679375c934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:38.423996 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c4b69f3e-dcad-45db-a96b-00679375c934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:38.425446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c4b69f3e-dcad-45db-a96b-00679375c934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:38.426631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c4b69f3e-dcad-45db-a96b-00679375c934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.095380 Apr 07 13:20:38.427206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 826/1773] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:38 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:38.605286 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a66d3389-8301-4fd8-be60-67272bc38a38 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:38.613577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a66d3389-8301-4fd8-be60-67272bc38a38 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1600 microversion: 2.1 time: 0.444569 Apr 07 13:20:38.614151 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 948/1774] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:38 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1600 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:38.849375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-23896d79-5c1a-4d34-824b-021e800e70ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:38.850004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-23896d79-5c1a-4d34-824b-021e800e70ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:38.856393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-23896d79-5c1a-4d34-824b-021e800e70ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:38.856847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-23896d79-5c1a-4d34-824b-021e800e70ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:38.857621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-23896d79-5c1a-4d34-824b-021e800e70ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:38.858051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-23896d79-5c1a-4d34-824b-021e800e70ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:38.994413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-23896d79-5c1a-4d34-824b-021e800e70ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:39.005483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-23896d79-5c1a-4d34-824b-021e800e70ae tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158020 Apr 07 13:20:39.008285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 827/1775] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:38 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:39.044477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-1af3fea8-f760-4ead-93ec-93f7427ebea0 req-204895a8-e1c9-4c0c-8200-18b9a5f2e4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "926785df-7955-4e58-a0ae-dc896b2b3f2c", "name": "network-vif-deleted", "tag": "3f362b45-57dc-4ae2-9d2e-6280d7bf36e2"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:20:39.052859 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-1af3fea8-f760-4ead-93ec-93f7427ebea0 req-204895a8-e1c9-4c0c-8200-18b9a5f2e4c6 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:39.053330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-1af3fea8-f760-4ead-93ec-93f7427ebea0 req-204895a8-e1c9-4c0c-8200-18b9a5f2e4c6 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:39.067023 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-1af3fea8-f760-4ead-93ec-93f7427ebea0 req-204895a8-e1c9-4c0c-8200-18b9a5f2e4c6 service nova] Creating event network-vif-deleted:3f362b45-57dc-4ae2-9d2e-6280d7bf36e2 for instance 926785df-7955-4e58-a0ae-dc896b2b3f2c on hv-cinder-83694 Apr 07 13:20:39.072976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-1af3fea8-f760-4ead-93ec-93f7427ebea0 req-204895a8-e1c9-4c0c-8200-18b9a5f2e4c6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032096 Apr 07 13:20:39.073573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 949/1776] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:20:39.445300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cd12475d-c9e5-4613-8a33-0e0ba389f8dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:39.445948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cd12475d-c9e5-4613-8a33-0e0ba389f8dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:39.452448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cd12475d-c9e5-4613-8a33-0e0ba389f8dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:39.452910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cd12475d-c9e5-4613-8a33-0e0ba389f8dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:39.453735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cd12475d-c9e5-4613-8a33-0e0ba389f8dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:39.454181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cd12475d-c9e5-4613-8a33-0e0ba389f8dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:39.513527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cd12475d-c9e5-4613-8a33-0e0ba389f8dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:39.521861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cd12475d-c9e5-4613-8a33-0e0ba389f8dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:39.523370 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cd12475d-c9e5-4613-8a33-0e0ba389f8dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:39.524553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cd12475d-c9e5-4613-8a33-0e0ba389f8dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083134 Apr 07 13:20:39.525112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 828/1777] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:39 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:39.631691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-aa31c346-a8c8-421e-a210-9cd61c5bf509 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:39.632414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-aa31c346-a8c8-421e-a210-9cd61c5bf509 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:39.638421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aa31c346-a8c8-421e-a210-9cd61c5bf509 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:39.638867 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aa31c346-a8c8-421e-a210-9cd61c5bf509 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:39.639617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aa31c346-a8c8-421e-a210-9cd61c5bf509 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:39.640042 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aa31c346-a8c8-421e-a210-9cd61c5bf509 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:39.702882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-aa31c346-a8c8-421e-a210-9cd61c5bf509 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:39.711294 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-aa31c346-a8c8-421e-a210-9cd61c5bf509 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.084265 Apr 07 13:20:39.711852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 950/1778] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:39 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:40.021450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e4c2018b-b152-4061-97ed-72e95c5322e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:40.022096 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e4c2018b-b152-4061-97ed-72e95c5322e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:40.028074 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4c2018b-b152-4061-97ed-72e95c5322e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:40.028565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4c2018b-b152-4061-97ed-72e95c5322e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:40.029356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4c2018b-b152-4061-97ed-72e95c5322e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:40.029795 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4c2018b-b152-4061-97ed-72e95c5322e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:40.163016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e4c2018b-b152-4061-97ed-72e95c5322e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:40.170678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e4c2018b-b152-4061-97ed-72e95c5322e2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153217 Apr 07 13:20:40.171470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 829/1779] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:40 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:40.543079 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e328298d-d6e2-4f01-a557-91f468dba261 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:40.543689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e328298d-d6e2-4f01-a557-91f468dba261 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:40.550148 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e328298d-d6e2-4f01-a557-91f468dba261 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:40.550597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e328298d-d6e2-4f01-a557-91f468dba261 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:40.551361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e328298d-d6e2-4f01-a557-91f468dba261 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:40.551795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e328298d-d6e2-4f01-a557-91f468dba261 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:40.610378 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e328298d-d6e2-4f01-a557-91f468dba261 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:40.618538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e328298d-d6e2-4f01-a557-91f468dba261 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:40.620027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e328298d-d6e2-4f01-a557-91f468dba261 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:40.621193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e328298d-d6e2-4f01-a557-91f468dba261 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081949 Apr 07 13:20:40.621749 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 951/1780] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:40 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:40.727399 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-791c7176-c838-47fc-8d99-950f26b1aa5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:40.728010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-791c7176-c838-47fc-8d99-950f26b1aa5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:40.734285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-791c7176-c838-47fc-8d99-950f26b1aa5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:40.734871 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-791c7176-c838-47fc-8d99-950f26b1aa5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:40.735644 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-791c7176-c838-47fc-8d99-950f26b1aa5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:40.736083 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-791c7176-c838-47fc-8d99-950f26b1aa5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:40.794407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-791c7176-c838-47fc-8d99-950f26b1aa5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:40.802158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-791c7176-c838-47fc-8d99-950f26b1aa5c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078550 Apr 07 13:20:40.802724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 830/1781] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:40 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:41.189204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4b2307c3-3a63-4b00-a60e-9a88502b6499 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:41.189825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4b2307c3-3a63-4b00-a60e-9a88502b6499 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:41.196117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b2307c3-3a63-4b00-a60e-9a88502b6499 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:41.196602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b2307c3-3a63-4b00-a60e-9a88502b6499 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:41.197371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b2307c3-3a63-4b00-a60e-9a88502b6499 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:41.197810 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b2307c3-3a63-4b00-a60e-9a88502b6499 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:41.335075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4b2307c3-3a63-4b00-a60e-9a88502b6499 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:41.342784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4b2307c3-3a63-4b00-a60e-9a88502b6499 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158282 Apr 07 13:20:41.343345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 952/1782] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:41 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:41.638822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1b1e5331-90d5-42dd-8026-1d42c139fe79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:41.639448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1b1e5331-90d5-42dd-8026-1d42c139fe79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:41.645490 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b1e5331-90d5-42dd-8026-1d42c139fe79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:41.645937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b1e5331-90d5-42dd-8026-1d42c139fe79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:41.646702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b1e5331-90d5-42dd-8026-1d42c139fe79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:41.647168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b1e5331-90d5-42dd-8026-1d42c139fe79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:41.706557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1b1e5331-90d5-42dd-8026-1d42c139fe79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:41.714624 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1b1e5331-90d5-42dd-8026-1d42c139fe79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:41.716108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1b1e5331-90d5-42dd-8026-1d42c139fe79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:41.717257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1b1e5331-90d5-42dd-8026-1d42c139fe79 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082365 Apr 07 13:20:41.717812 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 831/1783] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:41 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:41.818731 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-91c69ae4-37a5-421d-a923-49a2c888da36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:41.819351 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-91c69ae4-37a5-421d-a923-49a2c888da36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:41.825305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91c69ae4-37a5-421d-a923-49a2c888da36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:41.825757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91c69ae4-37a5-421d-a923-49a2c888da36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:41.826521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91c69ae4-37a5-421d-a923-49a2c888da36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:41.826962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91c69ae4-37a5-421d-a923-49a2c888da36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:41.897292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-91c69ae4-37a5-421d-a923-49a2c888da36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:41.905197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-91c69ae4-37a5-421d-a923-49a2c888da36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.090272 Apr 07 13:20:41.905756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 953/1784] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:41 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:42.360625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d66eecc7-01dd-4c84-8bc6-32e8f042e389 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:42.361261 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d66eecc7-01dd-4c84-8bc6-32e8f042e389 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:42.367515 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d66eecc7-01dd-4c84-8bc6-32e8f042e389 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:42.367963 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d66eecc7-01dd-4c84-8bc6-32e8f042e389 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:42.368749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d66eecc7-01dd-4c84-8bc6-32e8f042e389 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:42.369191 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d66eecc7-01dd-4c84-8bc6-32e8f042e389 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:42.506222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d66eecc7-01dd-4c84-8bc6-32e8f042e389 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:42.514154 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d66eecc7-01dd-4c84-8bc6-32e8f042e389 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157430 Apr 07 13:20:42.514715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 832/1785] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:42 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:42.735658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-13e1bcc8-b521-4a28-82ec-2c164bd36f8b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:42.736239 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-13e1bcc8-b521-4a28-82ec-2c164bd36f8b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:42.742498 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13e1bcc8-b521-4a28-82ec-2c164bd36f8b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:42.742944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13e1bcc8-b521-4a28-82ec-2c164bd36f8b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:42.743696 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13e1bcc8-b521-4a28-82ec-2c164bd36f8b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:42.744123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13e1bcc8-b521-4a28-82ec-2c164bd36f8b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:42.806900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-13e1bcc8-b521-4a28-82ec-2c164bd36f8b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:42.815740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-13e1bcc8-b521-4a28-82ec-2c164bd36f8b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:42.817254 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-13e1bcc8-b521-4a28-82ec-2c164bd36f8b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:42.818389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-13e1bcc8-b521-4a28-82ec-2c164bd36f8b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087064 Apr 07 13:20:42.818946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 954/1786] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:42 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:42.923600 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6b382be3-1e93-44d0-bc8f-3f3cbab64983 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:42.924256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6b382be3-1e93-44d0-bc8f-3f3cbab64983 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:42.930216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b382be3-1e93-44d0-bc8f-3f3cbab64983 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:42.930672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b382be3-1e93-44d0-bc8f-3f3cbab64983 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:42.931442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b382be3-1e93-44d0-bc8f-3f3cbab64983 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:42.931880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6b382be3-1e93-44d0-bc8f-3f3cbab64983 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:42.992525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6b382be3-1e93-44d0-bc8f-3f3cbab64983 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:43.001169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6b382be3-1e93-44d0-bc8f-3f3cbab64983 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.082021 Apr 07 13:20:43.001745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 833/1787] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:42 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:43.533322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4433e21a-d9b9-4d2e-b459-1520bff48189 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:43.533938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4433e21a-d9b9-4d2e-b459-1520bff48189 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:43.540024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4433e21a-d9b9-4d2e-b459-1520bff48189 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:43.540502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4433e21a-d9b9-4d2e-b459-1520bff48189 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:43.541258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4433e21a-d9b9-4d2e-b459-1520bff48189 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:43.541686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4433e21a-d9b9-4d2e-b459-1520bff48189 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:43.671682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4433e21a-d9b9-4d2e-b459-1520bff48189 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:43.680053 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4433e21a-d9b9-4d2e-b459-1520bff48189 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151595 Apr 07 13:20:43.680649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 955/1788] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:43 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:43.837201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dc575a72-399d-4700-b540-a4cb45fbf99d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:43.837732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dc575a72-399d-4700-b540-a4cb45fbf99d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:43.844670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dc575a72-399d-4700-b540-a4cb45fbf99d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:43.845124 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dc575a72-399d-4700-b540-a4cb45fbf99d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:43.845892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dc575a72-399d-4700-b540-a4cb45fbf99d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:43.846331 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dc575a72-399d-4700-b540-a4cb45fbf99d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:43.904440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dc575a72-399d-4700-b540-a4cb45fbf99d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:43.913400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dc575a72-399d-4700-b540-a4cb45fbf99d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:43.914904 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dc575a72-399d-4700-b540-a4cb45fbf99d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:43.916049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dc575a72-399d-4700-b540-a4cb45fbf99d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082856 Apr 07 13:20:43.916641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 834/1789] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:43 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:44.018632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f598be57-2236-47dc-be6c-a86227f02001 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:44.019253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f598be57-2236-47dc-be6c-a86227f02001 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:44.025500 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f598be57-2236-47dc-be6c-a86227f02001 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:44.025951 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f598be57-2236-47dc-be6c-a86227f02001 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:44.026708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f598be57-2236-47dc-be6c-a86227f02001 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:44.027144 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f598be57-2236-47dc-be6c-a86227f02001 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:44.086400 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f598be57-2236-47dc-be6c-a86227f02001 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:44.094448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f598be57-2236-47dc-be6c-a86227f02001 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080103 Apr 07 13:20:44.095158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 956/1790] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:44 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:44.697230 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5ea7eb79-6cd3-4622-8bfc-ccc768037cf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:44.697868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5ea7eb79-6cd3-4622-8bfc-ccc768037cf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:44.704428 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ea7eb79-6cd3-4622-8bfc-ccc768037cf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:44.704880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ea7eb79-6cd3-4622-8bfc-ccc768037cf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:44.705648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ea7eb79-6cd3-4622-8bfc-ccc768037cf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:44.706090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ea7eb79-6cd3-4622-8bfc-ccc768037cf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:44.836166 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5ea7eb79-6cd3-4622-8bfc-ccc768037cf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:44.844863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5ea7eb79-6cd3-4622-8bfc-ccc768037cf4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151438 Apr 07 13:20:44.845425 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 835/1791] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:44 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:44.934744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-140e0b09-9d6e-4333-99ff-cb63aa39a7b7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:44.935347 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-140e0b09-9d6e-4333-99ff-cb63aa39a7b7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:44.941596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-140e0b09-9d6e-4333-99ff-cb63aa39a7b7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:44.942037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-140e0b09-9d6e-4333-99ff-cb63aa39a7b7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:44.942789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-140e0b09-9d6e-4333-99ff-cb63aa39a7b7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:44.943217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-140e0b09-9d6e-4333-99ff-cb63aa39a7b7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:45.001135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-140e0b09-9d6e-4333-99ff-cb63aa39a7b7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:45.009455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-140e0b09-9d6e-4333-99ff-cb63aa39a7b7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:45.010954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-140e0b09-9d6e-4333-99ff-cb63aa39a7b7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:45.012122 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-140e0b09-9d6e-4333-99ff-cb63aa39a7b7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081226 Apr 07 13:20:45.012698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 957/1792] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:44 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:45.111034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bcbb13e9-cd66-4344-9905-3c00b0693b3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:45.111643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bcbb13e9-cd66-4344-9905-3c00b0693b3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:45.117517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bcbb13e9-cd66-4344-9905-3c00b0693b3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:45.117971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bcbb13e9-cd66-4344-9905-3c00b0693b3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:45.118758 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bcbb13e9-cd66-4344-9905-3c00b0693b3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:45.119173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bcbb13e9-cd66-4344-9905-3c00b0693b3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:45.177013 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bcbb13e9-cd66-4344-9905-3c00b0693b3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:45.184766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bcbb13e9-cd66-4344-9905-3c00b0693b3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.077585 Apr 07 13:20:45.185329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 836/1793] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:45 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:45.862520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-313dafba-34ae-4bb2-a5a9-7c6f5d61fc4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:45.863166 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-313dafba-34ae-4bb2-a5a9-7c6f5d61fc4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:45.869512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-313dafba-34ae-4bb2-a5a9-7c6f5d61fc4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:45.869963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-313dafba-34ae-4bb2-a5a9-7c6f5d61fc4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:45.870727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-313dafba-34ae-4bb2-a5a9-7c6f5d61fc4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:45.871163 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-313dafba-34ae-4bb2-a5a9-7c6f5d61fc4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:46.007921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-313dafba-34ae-4bb2-a5a9-7c6f5d61fc4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:46.015657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-313dafba-34ae-4bb2-a5a9-7c6f5d61fc4e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157413 Apr 07 13:20:46.016224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 958/1794] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:45 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:46.029923 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6adf57dc-2ff2-4dd4-a0c6-25f8a6c8e845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:46.030541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6adf57dc-2ff2-4dd4-a0c6-25f8a6c8e845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:46.037076 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6adf57dc-2ff2-4dd4-a0c6-25f8a6c8e845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:46.037535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6adf57dc-2ff2-4dd4-a0c6-25f8a6c8e845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:46.038301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6adf57dc-2ff2-4dd4-a0c6-25f8a6c8e845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:46.038739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6adf57dc-2ff2-4dd4-a0c6-25f8a6c8e845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:46.100110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6adf57dc-2ff2-4dd4-a0c6-25f8a6c8e845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:46.108366 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6adf57dc-2ff2-4dd4-a0c6-25f8a6c8e845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:46.110761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6adf57dc-2ff2-4dd4-a0c6-25f8a6c8e845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:46.111920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6adf57dc-2ff2-4dd4-a0c6-25f8a6c8e845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085908 Apr 07 13:20:46.112509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 837/1795] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:46 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:46.202534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-72da9e1b-4726-46f4-a146-b28bccb77cea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:46.203095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-72da9e1b-4726-46f4-a146-b28bccb77cea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:46.209033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72da9e1b-4726-46f4-a146-b28bccb77cea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:46.209483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72da9e1b-4726-46f4-a146-b28bccb77cea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:46.210247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72da9e1b-4726-46f4-a146-b28bccb77cea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:46.210681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-72da9e1b-4726-46f4-a146-b28bccb77cea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:46.269018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-72da9e1b-4726-46f4-a146-b28bccb77cea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:46.276681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-72da9e1b-4726-46f4-a146-b28bccb77cea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078051 Apr 07 13:20:46.277246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 959/1796] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:46 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:47.033065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-83c3653f-b377-4335-8a6d-9e1d1f6b8a7f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:47.033686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-83c3653f-b377-4335-8a6d-9e1d1f6b8a7f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:47.040277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83c3653f-b377-4335-8a6d-9e1d1f6b8a7f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:47.040736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83c3653f-b377-4335-8a6d-9e1d1f6b8a7f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:47.041506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83c3653f-b377-4335-8a6d-9e1d1f6b8a7f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:47.041947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83c3653f-b377-4335-8a6d-9e1d1f6b8a7f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:47.129554 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5716c200-de17-4f5f-9a92-75e0554bd92c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:47.130162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5716c200-de17-4f5f-9a92-75e0554bd92c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:47.136539 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5716c200-de17-4f5f-9a92-75e0554bd92c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:47.136990 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5716c200-de17-4f5f-9a92-75e0554bd92c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:47.137748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5716c200-de17-4f5f-9a92-75e0554bd92c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:47.138183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5716c200-de17-4f5f-9a92-75e0554bd92c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:47.174449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-83c3653f-b377-4335-8a6d-9e1d1f6b8a7f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:47.182755 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-83c3653f-b377-4335-8a6d-9e1d1f6b8a7f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154054 Apr 07 13:20:47.183345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 838/1797] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:47 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:47.197978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5716c200-de17-4f5f-9a92-75e0554bd92c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:47.206536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5716c200-de17-4f5f-9a92-75e0554bd92c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:47.208040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5716c200-de17-4f5f-9a92-75e0554bd92c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:47.209225 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5716c200-de17-4f5f-9a92-75e0554bd92c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083496 Apr 07 13:20:47.209781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 960/1798] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:47 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:20:47.294688 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e8259909-fb00-45a1-8740-ed2a8dce3bdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:47.295304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e8259909-fb00-45a1-8740-ed2a8dce3bdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:47.301933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e8259909-fb00-45a1-8740-ed2a8dce3bdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:47.302386 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e8259909-fb00-45a1-8740-ed2a8dce3bdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:47.303152 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e8259909-fb00-45a1-8740-ed2a8dce3bdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:47.303588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e8259909-fb00-45a1-8740-ed2a8dce3bdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:47.361769 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e8259909-fb00-45a1-8740-ed2a8dce3bdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:47.369405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e8259909-fb00-45a1-8740-ed2a8dce3bdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078477 Apr 07 13:20:47.369965 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 839/1799] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:47 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:48.199687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d7e26a74-d1c7-46cf-9796-d37a1e6a8fc0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:48.200257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d7e26a74-d1c7-46cf-9796-d37a1e6a8fc0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:48.206732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7e26a74-d1c7-46cf-9796-d37a1e6a8fc0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:48.207186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7e26a74-d1c7-46cf-9796-d37a1e6a8fc0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:48.207978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7e26a74-d1c7-46cf-9796-d37a1e6a8fc0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:48.208437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7e26a74-d1c7-46cf-9796-d37a1e6a8fc0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:48.226645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8fd718d7-ad36-4547-93b3-39286601a197 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:48.227257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8fd718d7-ad36-4547-93b3-39286601a197 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:48.233477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8fd718d7-ad36-4547-93b3-39286601a197 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:48.233927 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8fd718d7-ad36-4547-93b3-39286601a197 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:48.235470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8fd718d7-ad36-4547-93b3-39286601a197 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:48.235955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8fd718d7-ad36-4547-93b3-39286601a197 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:48.298948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8fd718d7-ad36-4547-93b3-39286601a197 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:48.307313 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8fd718d7-ad36-4547-93b3-39286601a197 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:48.308824 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8fd718d7-ad36-4547-93b3-39286601a197 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:48.309961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8fd718d7-ad36-4547-93b3-39286601a197 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087173 Apr 07 13:20:48.310526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 840/1800] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:48 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:20:48.347888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d7e26a74-d1c7-46cf-9796-d37a1e6a8fc0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:48.355624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d7e26a74-d1c7-46cf-9796-d37a1e6a8fc0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.159831 Apr 07 13:20:48.356199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 961/1801] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:48 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:48.385231 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f38fbf1f-9839-4d97-b8a7-45422a7e1c51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:48.385841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f38fbf1f-9839-4d97-b8a7-45422a7e1c51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:48.391699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f38fbf1f-9839-4d97-b8a7-45422a7e1c51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:48.392169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f38fbf1f-9839-4d97-b8a7-45422a7e1c51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:48.392930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f38fbf1f-9839-4d97-b8a7-45422a7e1c51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:48.393376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f38fbf1f-9839-4d97-b8a7-45422a7e1c51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:48.454332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f38fbf1f-9839-4d97-b8a7-45422a7e1c51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:48.462089 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f38fbf1f-9839-4d97-b8a7-45422a7e1c51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080585 Apr 07 13:20:48.462657 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 841/1802] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:48 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:49.329085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-38dfb8cc-1d2a-4e57-9151-afa5a2fecf8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:49.329702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-38dfb8cc-1d2a-4e57-9151-afa5a2fecf8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:49.336027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-38dfb8cc-1d2a-4e57-9151-afa5a2fecf8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:49.336514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-38dfb8cc-1d2a-4e57-9151-afa5a2fecf8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:49.337318 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-38dfb8cc-1d2a-4e57-9151-afa5a2fecf8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:49.337759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-38dfb8cc-1d2a-4e57-9151-afa5a2fecf8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:49.373342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dff390a4-8955-4a95-ad13-07debcf49b5e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:49.374096 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dff390a4-8955-4a95-ad13-07debcf49b5e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:49.381626 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dff390a4-8955-4a95-ad13-07debcf49b5e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:49.382076 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dff390a4-8955-4a95-ad13-07debcf49b5e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:49.382845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dff390a4-8955-4a95-ad13-07debcf49b5e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:49.383279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dff390a4-8955-4a95-ad13-07debcf49b5e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:49.397597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-38dfb8cc-1d2a-4e57-9151-afa5a2fecf8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:49.405913 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-38dfb8cc-1d2a-4e57-9151-afa5a2fecf8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:49.408082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-38dfb8cc-1d2a-4e57-9151-afa5a2fecf8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:49.409266 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-38dfb8cc-1d2a-4e57-9151-afa5a2fecf8d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084665 Apr 07 13:20:49.409823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 962/1803] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:49 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:49.479300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2716b739-5c80-442a-bf99-bf2d9000f54c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:49.479917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2716b739-5c80-442a-bf99-bf2d9000f54c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:49.485926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2716b739-5c80-442a-bf99-bf2d9000f54c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:49.486377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2716b739-5c80-442a-bf99-bf2d9000f54c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:49.487136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2716b739-5c80-442a-bf99-bf2d9000f54c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:49.487570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2716b739-5c80-442a-bf99-bf2d9000f54c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:49.517055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dff390a4-8955-4a95-ad13-07debcf49b5e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:49.524870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dff390a4-8955-4a95-ad13-07debcf49b5e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155414 Apr 07 13:20:49.527425 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 842/1804] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:49 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:20:49.546340 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2716b739-5c80-442a-bf99-bf2d9000f54c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:49.554285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2716b739-5c80-442a-bf99-bf2d9000f54c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078770 Apr 07 13:20:49.554848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 963/1805] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:49 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:20:50.427552 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c056ed21-689a-4d13-9957-fc81d5a2b1ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:50.428173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c056ed21-689a-4d13-9957-fc81d5a2b1ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:50.434419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c056ed21-689a-4d13-9957-fc81d5a2b1ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:50.434863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c056ed21-689a-4d13-9957-fc81d5a2b1ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:50.435615 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c056ed21-689a-4d13-9957-fc81d5a2b1ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:50.436044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c056ed21-689a-4d13-9957-fc81d5a2b1ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:50.496962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c056ed21-689a-4d13-9957-fc81d5a2b1ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:50.505427 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c056ed21-689a-4d13-9957-fc81d5a2b1ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:50.506921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c056ed21-689a-4d13-9957-fc81d5a2b1ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:50.508091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c056ed21-689a-4d13-9957-fc81d5a2b1ed tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084420 Apr 07 13:20:50.508687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 843/1806] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:50 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:50.542540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-91c55115-c6c1-47ac-83ac-49939fa1283a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:50.543145 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-91c55115-c6c1-47ac-83ac-49939fa1283a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:50.549393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91c55115-c6c1-47ac-83ac-49939fa1283a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:50.549840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91c55115-c6c1-47ac-83ac-49939fa1283a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:50.550597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91c55115-c6c1-47ac-83ac-49939fa1283a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:50.551030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91c55115-c6c1-47ac-83ac-49939fa1283a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:50.570481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b7d35917-8889-4bec-b331-a1603295c778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:50.571100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b7d35917-8889-4bec-b331-a1603295c778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:50.576976 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7d35917-8889-4bec-b331-a1603295c778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:50.577429 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7d35917-8889-4bec-b331-a1603295c778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:50.578772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7d35917-8889-4bec-b331-a1603295c778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:50.579213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7d35917-8889-4bec-b331-a1603295c778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:50.644527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b7d35917-8889-4bec-b331-a1603295c778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:50.652272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b7d35917-8889-4bec-b331-a1603295c778 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.085477 Apr 07 13:20:50.653053 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 844/1807] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:50 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:20:50.684639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-91c55115-c6c1-47ac-83ac-49939fa1283a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:50.692962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-91c55115-c6c1-47ac-83ac-49939fa1283a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154258 Apr 07 13:20:50.693530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 964/1808] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:50 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:51.526540 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-68b45fee-9890-40f0-aebc-ce379f58b714 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:51.527240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-68b45fee-9890-40f0-aebc-ce379f58b714 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:51.534090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68b45fee-9890-40f0-aebc-ce379f58b714 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:51.534548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68b45fee-9890-40f0-aebc-ce379f58b714 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:51.535590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68b45fee-9890-40f0-aebc-ce379f58b714 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:51.536033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68b45fee-9890-40f0-aebc-ce379f58b714 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:51.595871 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-68b45fee-9890-40f0-aebc-ce379f58b714 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:51.604171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-68b45fee-9890-40f0-aebc-ce379f58b714 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:51.605664 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-68b45fee-9890-40f0-aebc-ce379f58b714 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:51.606796 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-68b45fee-9890-40f0-aebc-ce379f58b714 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084146 Apr 07 13:20:51.607353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 845/1809] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:51 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:20:51.670277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-483b88e4-d8c9-4809-9ca6-9a459c53d2b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:51.670890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-483b88e4-d8c9-4809-9ca6-9a459c53d2b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:51.677805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-483b88e4-d8c9-4809-9ca6-9a459c53d2b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:51.678257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-483b88e4-d8c9-4809-9ca6-9a459c53d2b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:51.679019 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-483b88e4-d8c9-4809-9ca6-9a459c53d2b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:51.679482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-483b88e4-d8c9-4809-9ca6-9a459c53d2b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:51.709420 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5e19af9d-537e-48ef-94ec-df8833be554a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:51.710041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5e19af9d-537e-48ef-94ec-df8833be554a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:51.716001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e19af9d-537e-48ef-94ec-df8833be554a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:51.716490 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e19af9d-537e-48ef-94ec-df8833be554a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:51.717265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e19af9d-537e-48ef-94ec-df8833be554a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:51.717711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5e19af9d-537e-48ef-94ec-df8833be554a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:51.739885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-483b88e4-d8c9-4809-9ca6-9a459c53d2b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:51.747905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-483b88e4-d8c9-4809-9ca6-9a459c53d2b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081413 Apr 07 13:20:51.748539 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 965/1810] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:51 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:51.847836 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5e19af9d-537e-48ef-94ec-df8833be554a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:51.855561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5e19af9d-537e-48ef-94ec-df8833be554a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149883 Apr 07 13:20:51.856135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 846/1811] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:51 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:20:52.625427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0f177c80-29e5-4f6d-a54e-dab2be0f9315 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:52.626089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0f177c80-29e5-4f6d-a54e-dab2be0f9315 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:52.632083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0f177c80-29e5-4f6d-a54e-dab2be0f9315 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:52.632499 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0f177c80-29e5-4f6d-a54e-dab2be0f9315 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:52.633252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0f177c80-29e5-4f6d-a54e-dab2be0f9315 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:52.633686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0f177c80-29e5-4f6d-a54e-dab2be0f9315 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:52.691918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0f177c80-29e5-4f6d-a54e-dab2be0f9315 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:52.700131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0f177c80-29e5-4f6d-a54e-dab2be0f9315 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:52.701692 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0f177c80-29e5-4f6d-a54e-dab2be0f9315 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:52.703369 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0f177c80-29e5-4f6d-a54e-dab2be0f9315 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081506 Apr 07 13:20:52.703925 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 966/1812] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:52 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:20:52.765700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5db7462b-94ef-47b2-8c00-8eefee8c1057 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:52.766344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5db7462b-94ef-47b2-8c00-8eefee8c1057 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:52.772642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5db7462b-94ef-47b2-8c00-8eefee8c1057 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:52.773090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5db7462b-94ef-47b2-8c00-8eefee8c1057 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:52.773854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5db7462b-94ef-47b2-8c00-8eefee8c1057 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:52.774291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5db7462b-94ef-47b2-8c00-8eefee8c1057 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:52.834613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5db7462b-94ef-47b2-8c00-8eefee8c1057 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:52.842265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5db7462b-94ef-47b2-8c00-8eefee8c1057 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080899 Apr 07 13:20:52.842827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 847/1813] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:52 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:52.872838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b4650649-6ecb-4d8c-8e24-27c7b1f99714 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:52.873543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b4650649-6ecb-4d8c-8e24-27c7b1f99714 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:52.883606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4650649-6ecb-4d8c-8e24-27c7b1f99714 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:52.883996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4650649-6ecb-4d8c-8e24-27c7b1f99714 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:52.884802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4650649-6ecb-4d8c-8e24-27c7b1f99714 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:52.885266 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b4650649-6ecb-4d8c-8e24-27c7b1f99714 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:53.021316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b4650649-6ecb-4d8c-8e24-27c7b1f99714 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:53.029030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b4650649-6ecb-4d8c-8e24-27c7b1f99714 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.159951 Apr 07 13:20:53.029594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 967/1814] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:52 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:53.721832 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0f401ed3-976e-4585-ab20-8bd17146898f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:53.722439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0f401ed3-976e-4585-ab20-8bd17146898f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:53.728537 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f401ed3-976e-4585-ab20-8bd17146898f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:53.728987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f401ed3-976e-4585-ab20-8bd17146898f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:53.729754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f401ed3-976e-4585-ab20-8bd17146898f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:53.730186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f401ed3-976e-4585-ab20-8bd17146898f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:53.791566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0f401ed3-976e-4585-ab20-8bd17146898f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:53.800775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0f401ed3-976e-4585-ab20-8bd17146898f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:53.802262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0f401ed3-976e-4585-ab20-8bd17146898f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:53.803409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0f401ed3-976e-4585-ab20-8bd17146898f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086056 Apr 07 13:20:53.803970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 848/1815] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:53 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:53.860271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c95a54b1-b32e-43bf-a6db-c79b09f77d8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:53.860899 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c95a54b1-b32e-43bf-a6db-c79b09f77d8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:53.867288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c95a54b1-b32e-43bf-a6db-c79b09f77d8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:53.867739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c95a54b1-b32e-43bf-a6db-c79b09f77d8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:53.868541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c95a54b1-b32e-43bf-a6db-c79b09f77d8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:53.868984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c95a54b1-b32e-43bf-a6db-c79b09f77d8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:53.932247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c95a54b1-b32e-43bf-a6db-c79b09f77d8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:53.940192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c95a54b1-b32e-43bf-a6db-c79b09f77d8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.084542 Apr 07 13:20:53.940768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 968/1816] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:53 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:54.047020 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1953f1c8-115f-4683-8cac-e2afb507d13a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:54.047639 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1953f1c8-115f-4683-8cac-e2afb507d13a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:54.053596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1953f1c8-115f-4683-8cac-e2afb507d13a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:54.054050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1953f1c8-115f-4683-8cac-e2afb507d13a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:54.054813 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1953f1c8-115f-4683-8cac-e2afb507d13a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:54.055250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1953f1c8-115f-4683-8cac-e2afb507d13a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:54.185849 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1953f1c8-115f-4683-8cac-e2afb507d13a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:54.193651 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1953f1c8-115f-4683-8cac-e2afb507d13a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151131 Apr 07 13:20:54.194216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 849/1817] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:54 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:54.335363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:20:54.335577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:20:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:20:54.821443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-644d1a0f-f0c3-4426-bcfc-eff68d6634c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:54.821983 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-644d1a0f-f0c3-4426-bcfc-eff68d6634c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:54.828577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-644d1a0f-f0c3-4426-bcfc-eff68d6634c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:54.829023 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-644d1a0f-f0c3-4426-bcfc-eff68d6634c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:54.829776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-644d1a0f-f0c3-4426-bcfc-eff68d6634c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:54.830210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-644d1a0f-f0c3-4426-bcfc-eff68d6634c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:54.888804 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-644d1a0f-f0c3-4426-bcfc-eff68d6634c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:54.896989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-644d1a0f-f0c3-4426-bcfc-eff68d6634c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:54.898485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-644d1a0f-f0c3-4426-bcfc-eff68d6634c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:54.899617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-644d1a0f-f0c3-4426-bcfc-eff68d6634c8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082187 Apr 07 13:20:54.900206 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 969/1818] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:54 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:54.957399 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3eabd2c5-f0f9-4feb-9067-8a14cc35987e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:54.958022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3eabd2c5-f0f9-4feb-9067-8a14cc35987e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:54.964371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3eabd2c5-f0f9-4feb-9067-8a14cc35987e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:54.964831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3eabd2c5-f0f9-4feb-9067-8a14cc35987e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:54.965630 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3eabd2c5-f0f9-4feb-9067-8a14cc35987e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:54.966073 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3eabd2c5-f0f9-4feb-9067-8a14cc35987e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:55.024907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3eabd2c5-f0f9-4feb-9067-8a14cc35987e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:55.032694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3eabd2c5-f0f9-4feb-9067-8a14cc35987e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079237 Apr 07 13:20:55.033263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 850/1819] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:54 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:55.210726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4ab01a1c-13ad-4b9c-aaf6-6e8ed2b7a685 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:55.211358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4ab01a1c-13ad-4b9c-aaf6-6e8ed2b7a685 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:55.217261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4ab01a1c-13ad-4b9c-aaf6-6e8ed2b7a685 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:55.217709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4ab01a1c-13ad-4b9c-aaf6-6e8ed2b7a685 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:55.218957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4ab01a1c-13ad-4b9c-aaf6-6e8ed2b7a685 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:55.219578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4ab01a1c-13ad-4b9c-aaf6-6e8ed2b7a685 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:55.349635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4ab01a1c-13ad-4b9c-aaf6-6e8ed2b7a685 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:55.357329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4ab01a1c-13ad-4b9c-aaf6-6e8ed2b7a685 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150394 Apr 07 13:20:55.357888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 970/1820] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:55 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:55.917213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4ddadb79-77fc-4fce-8285-adf3fb63edee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:55.917834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4ddadb79-77fc-4fce-8285-adf3fb63edee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:55.924270 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ddadb79-77fc-4fce-8285-adf3fb63edee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:55.924728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ddadb79-77fc-4fce-8285-adf3fb63edee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:55.925498 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ddadb79-77fc-4fce-8285-adf3fb63edee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:55.925939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ddadb79-77fc-4fce-8285-adf3fb63edee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:55.985000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4ddadb79-77fc-4fce-8285-adf3fb63edee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:55.995350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4ddadb79-77fc-4fce-8285-adf3fb63edee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:55.996971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4ddadb79-77fc-4fce-8285-adf3fb63edee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:55.998212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4ddadb79-77fc-4fce-8285-adf3fb63edee tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084830 Apr 07 13:20:55.998774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 851/1821] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:55 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:56.050300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-16d712b1-bc0e-4dc9-96b6-97a096bc88c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:56.050925 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-16d712b1-bc0e-4dc9-96b6-97a096bc88c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:56.057283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16d712b1-bc0e-4dc9-96b6-97a096bc88c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:56.057737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16d712b1-bc0e-4dc9-96b6-97a096bc88c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:56.058508 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16d712b1-bc0e-4dc9-96b6-97a096bc88c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:56.058949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16d712b1-bc0e-4dc9-96b6-97a096bc88c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:56.117400 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-16d712b1-bc0e-4dc9-96b6-97a096bc88c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:56.125560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-16d712b1-bc0e-4dc9-96b6-97a096bc88c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079759 Apr 07 13:20:56.126114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 971/1822] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:56 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:56.374423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b5a0915e-62e9-45ef-b12b-60e590ec7c3a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:56.375045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b5a0915e-62e9-45ef-b12b-60e590ec7c3a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:56.381042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5a0915e-62e9-45ef-b12b-60e590ec7c3a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:56.381499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5a0915e-62e9-45ef-b12b-60e590ec7c3a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:56.382268 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5a0915e-62e9-45ef-b12b-60e590ec7c3a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:56.382705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5a0915e-62e9-45ef-b12b-60e590ec7c3a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:56.516225 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b5a0915e-62e9-45ef-b12b-60e590ec7c3a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:56.524021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b5a0915e-62e9-45ef-b12b-60e590ec7c3a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153459 Apr 07 13:20:56.524619 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 852/1823] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:56 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:57.017204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7c285e3e-9a41-46d3-afbe-87b9af4209a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:57.017811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7c285e3e-9a41-46d3-afbe-87b9af4209a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:57.023741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7c285e3e-9a41-46d3-afbe-87b9af4209a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:57.024229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7c285e3e-9a41-46d3-afbe-87b9af4209a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:57.024991 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7c285e3e-9a41-46d3-afbe-87b9af4209a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:57.025428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7c285e3e-9a41-46d3-afbe-87b9af4209a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:57.084893 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7c285e3e-9a41-46d3-afbe-87b9af4209a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:57.093028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7c285e3e-9a41-46d3-afbe-87b9af4209a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:57.094632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7c285e3e-9a41-46d3-afbe-87b9af4209a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:57.095769 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7c285e3e-9a41-46d3-afbe-87b9af4209a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083324 Apr 07 13:20:57.096354 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 972/1824] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:57 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:57.142254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b5244e66-a5b6-4e69-8d65-871c7a2ba3b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:57.142805 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b5244e66-a5b6-4e69-8d65-871c7a2ba3b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:57.149038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5244e66-a5b6-4e69-8d65-871c7a2ba3b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:57.149492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5244e66-a5b6-4e69-8d65-871c7a2ba3b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:57.150259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5244e66-a5b6-4e69-8d65-871c7a2ba3b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:57.150699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5244e66-a5b6-4e69-8d65-871c7a2ba3b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:57.213994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b5244e66-a5b6-4e69-8d65-871c7a2ba3b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:57.221985 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b5244e66-a5b6-4e69-8d65-871c7a2ba3b2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.083731 Apr 07 13:20:57.222557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 853/1825] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:57 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:57.542127 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d86c7249-c6d6-49ec-b8aa-eee10be905aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:57.542649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d86c7249-c6d6-49ec-b8aa-eee10be905aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:57.550801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d86c7249-c6d6-49ec-b8aa-eee10be905aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:57.552054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d86c7249-c6d6-49ec-b8aa-eee10be905aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:57.552836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d86c7249-c6d6-49ec-b8aa-eee10be905aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:57.554084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d86c7249-c6d6-49ec-b8aa-eee10be905aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:57.683883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d86c7249-c6d6-49ec-b8aa-eee10be905aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:57.691853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d86c7249-c6d6-49ec-b8aa-eee10be905aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153587 Apr 07 13:20:57.692450 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 973/1826] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:57 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:58.114065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c5c53bb5-f633-41f0-b944-fe23a9049df3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:58.114739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c5c53bb5-f633-41f0-b944-fe23a9049df3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:58.120662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c5c53bb5-f633-41f0-b944-fe23a9049df3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:58.121120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c5c53bb5-f633-41f0-b944-fe23a9049df3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:58.121891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c5c53bb5-f633-41f0-b944-fe23a9049df3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:58.122330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c5c53bb5-f633-41f0-b944-fe23a9049df3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:58.181179 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c5c53bb5-f633-41f0-b944-fe23a9049df3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:58.189900 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c5c53bb5-f633-41f0-b944-fe23a9049df3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:58.191435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c5c53bb5-f633-41f0-b944-fe23a9049df3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:58.192685 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c5c53bb5-f633-41f0-b944-fe23a9049df3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082836 Apr 07 13:20:58.193248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 854/1827] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:58 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:58.238030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-354e7568-bc50-4acc-832c-88464e0a3f3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:58.238635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-354e7568-bc50-4acc-832c-88464e0a3f3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:58.244860 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-354e7568-bc50-4acc-832c-88464e0a3f3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:58.245306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-354e7568-bc50-4acc-832c-88464e0a3f3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:58.246059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-354e7568-bc50-4acc-832c-88464e0a3f3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:58.246492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-354e7568-bc50-4acc-832c-88464e0a3f3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:58.309960 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-354e7568-bc50-4acc-832c-88464e0a3f3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:58.318336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-354e7568-bc50-4acc-832c-88464e0a3f3f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.084187 Apr 07 13:20:58.318889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 974/1828] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:58 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:58.708864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8777af79-3d78-4ca9-a3af-afcae5553cd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:58.709483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8777af79-3d78-4ca9-a3af-afcae5553cd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:58.715605 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8777af79-3d78-4ca9-a3af-afcae5553cd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:58.716052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8777af79-3d78-4ca9-a3af-afcae5553cd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:58.716853 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8777af79-3d78-4ca9-a3af-afcae5553cd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:58.717291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8777af79-3d78-4ca9-a3af-afcae5553cd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:58.852029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8777af79-3d78-4ca9-a3af-afcae5553cd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:58.860524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8777af79-3d78-4ca9-a3af-afcae5553cd5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155358 Apr 07 13:20:58.861250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 855/1829] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:58 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:59.212479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b1287bf4-87db-4641-9fe2-8e622615b516 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:59.213094 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b1287bf4-87db-4641-9fe2-8e622615b516 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:59.219516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b1287bf4-87db-4641-9fe2-8e622615b516 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:59.219970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b1287bf4-87db-4641-9fe2-8e622615b516 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:59.220772 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b1287bf4-87db-4641-9fe2-8e622615b516 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:59.221214 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b1287bf4-87db-4641-9fe2-8e622615b516 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:59.279305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b1287bf4-87db-4641-9fe2-8e622615b516 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:59.288457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b1287bf4-87db-4641-9fe2-8e622615b516 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:59.289953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b1287bf4-87db-4641-9fe2-8e622615b516 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:59.291095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b1287bf4-87db-4641-9fe2-8e622615b516 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082571 Apr 07 13:20:59.291647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 975/1830] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:20:59 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:20:59.334540 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fbc9a4f2-1f9e-42cb-9514-c2abd3eb2bab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:59.335185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fbc9a4f2-1f9e-42cb-9514-c2abd3eb2bab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:59.341569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fbc9a4f2-1f9e-42cb-9514-c2abd3eb2bab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:59.342016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fbc9a4f2-1f9e-42cb-9514-c2abd3eb2bab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:59.342772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fbc9a4f2-1f9e-42cb-9514-c2abd3eb2bab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:59.344059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fbc9a4f2-1f9e-42cb-9514-c2abd3eb2bab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:59.400997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fbc9a4f2-1f9e-42cb-9514-c2abd3eb2bab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:20:59.409435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fbc9a4f2-1f9e-42cb-9514-c2abd3eb2bab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078687 Apr 07 13:20:59.410421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 856/1831] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:59 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:20:59.876672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-39ea781b-aed3-4002-85a9-813bbb5f94d8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:20:59.877291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-39ea781b-aed3-4002-85a9-813bbb5f94d8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:20:59.883155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39ea781b-aed3-4002-85a9-813bbb5f94d8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:59.883617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39ea781b-aed3-4002-85a9-813bbb5f94d8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:20:59.884413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39ea781b-aed3-4002-85a9-813bbb5f94d8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:20:59.884855 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39ea781b-aed3-4002-85a9-813bbb5f94d8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:00.018498 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-39ea781b-aed3-4002-85a9-813bbb5f94d8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:00.026113 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-39ea781b-aed3-4002-85a9-813bbb5f94d8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153546 Apr 07 13:21:00.026668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 976/1832] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:20:59 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:00.309722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9d0277ff-575f-44a0-a4e0-7f97653f8f61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:00.310254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9d0277ff-575f-44a0-a4e0-7f97653f8f61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:00.316341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d0277ff-575f-44a0-a4e0-7f97653f8f61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:00.316795 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d0277ff-575f-44a0-a4e0-7f97653f8f61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:00.317560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d0277ff-575f-44a0-a4e0-7f97653f8f61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:00.318001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d0277ff-575f-44a0-a4e0-7f97653f8f61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:00.378826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9d0277ff-575f-44a0-a4e0-7f97653f8f61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:00.386977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9d0277ff-575f-44a0-a4e0-7f97653f8f61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:00.388515 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9d0277ff-575f-44a0-a4e0-7f97653f8f61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:00.389660 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9d0277ff-575f-44a0-a4e0-7f97653f8f61 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083951 Apr 07 13:21:00.390843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 857/1833] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:00 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:00.426293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-731a9c78-6189-4d48-9453-155dacb5c1cb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:00.426981 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-731a9c78-6189-4d48-9453-155dacb5c1cb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:00.433282 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-731a9c78-6189-4d48-9453-155dacb5c1cb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:00.433730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-731a9c78-6189-4d48-9453-155dacb5c1cb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:00.434491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-731a9c78-6189-4d48-9453-155dacb5c1cb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:00.434927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-731a9c78-6189-4d48-9453-155dacb5c1cb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:00.492944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-731a9c78-6189-4d48-9453-155dacb5c1cb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:00.501360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-731a9c78-6189-4d48-9453-155dacb5c1cb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078836 Apr 07 13:21:00.501922 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 977/1834] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:00 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:01.044910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a1d08114-4cd7-426a-8c42-bd489e19e1d2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:01.045518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a1d08114-4cd7-426a-8c42-bd489e19e1d2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:01.052373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a1d08114-4cd7-426a-8c42-bd489e19e1d2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:01.052825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a1d08114-4cd7-426a-8c42-bd489e19e1d2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:01.053586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a1d08114-4cd7-426a-8c42-bd489e19e1d2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:01.054020 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a1d08114-4cd7-426a-8c42-bd489e19e1d2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:01.191050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a1d08114-4cd7-426a-8c42-bd489e19e1d2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:01.198963 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a1d08114-4cd7-426a-8c42-bd489e19e1d2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157848 Apr 07 13:21:01.199525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 858/1835] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:01 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:01.408665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ff2750a7-f521-4622-9f83-3850fba07176 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:01.409199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ff2750a7-f521-4622-9f83-3850fba07176 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:01.415441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff2750a7-f521-4622-9f83-3850fba07176 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:01.415889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff2750a7-f521-4622-9f83-3850fba07176 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:01.416719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff2750a7-f521-4622-9f83-3850fba07176 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:01.417131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff2750a7-f521-4622-9f83-3850fba07176 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:01.479168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ff2750a7-f521-4622-9f83-3850fba07176 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:01.488240 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ff2750a7-f521-4622-9f83-3850fba07176 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:01.489682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ff2750a7-f521-4622-9f83-3850fba07176 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:01.490922 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ff2750a7-f521-4622-9f83-3850fba07176 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086635 Apr 07 13:21:01.491543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 978/1836] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:01 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:01.518502 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5df021c9-b17d-44b0-9dde-18a0d1bbbf09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:01.519111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5df021c9-b17d-44b0-9dde-18a0d1bbbf09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:01.525371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5df021c9-b17d-44b0-9dde-18a0d1bbbf09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:01.525825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5df021c9-b17d-44b0-9dde-18a0d1bbbf09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:01.526583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5df021c9-b17d-44b0-9dde-18a0d1bbbf09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:01.527015 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5df021c9-b17d-44b0-9dde-18a0d1bbbf09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:01.585970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5df021c9-b17d-44b0-9dde-18a0d1bbbf09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:01.594686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5df021c9-b17d-44b0-9dde-18a0d1bbbf09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080588 Apr 07 13:21:01.595292 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 859/1837] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:01 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:02.215822 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2f0d9c9a-14a4-4301-81ab-d0c9fc31909d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:02.216450 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2f0d9c9a-14a4-4301-81ab-d0c9fc31909d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:02.223289 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f0d9c9a-14a4-4301-81ab-d0c9fc31909d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:02.223735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f0d9c9a-14a4-4301-81ab-d0c9fc31909d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:02.224514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f0d9c9a-14a4-4301-81ab-d0c9fc31909d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:02.224944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f0d9c9a-14a4-4301-81ab-d0c9fc31909d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:02.355579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2f0d9c9a-14a4-4301-81ab-d0c9fc31909d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:02.363742 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2f0d9c9a-14a4-4301-81ab-d0c9fc31909d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151746 Apr 07 13:21:02.364338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 979/1838] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:02 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:02.509692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e4e12af9-ce98-4d76-922a-f1a1a9a8cab3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:02.510229 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e4e12af9-ce98-4d76-922a-f1a1a9a8cab3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:02.516259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4e12af9-ce98-4d76-922a-f1a1a9a8cab3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:02.516709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4e12af9-ce98-4d76-922a-f1a1a9a8cab3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:02.517469 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4e12af9-ce98-4d76-922a-f1a1a9a8cab3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:02.517905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4e12af9-ce98-4d76-922a-f1a1a9a8cab3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:02.576475 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e4e12af9-ce98-4d76-922a-f1a1a9a8cab3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:02.584819 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e4e12af9-ce98-4d76-922a-f1a1a9a8cab3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:02.586314 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e4e12af9-ce98-4d76-922a-f1a1a9a8cab3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:02.587556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e4e12af9-ce98-4d76-922a-f1a1a9a8cab3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081785 Apr 07 13:21:02.588113 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 860/1839] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:02 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:02.611087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1e41a370-5a71-45f3-8af1-d542867c7aaa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:02.611697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1e41a370-5a71-45f3-8af1-d542867c7aaa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:02.618025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e41a370-5a71-45f3-8af1-d542867c7aaa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:02.618474 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e41a370-5a71-45f3-8af1-d542867c7aaa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:02.619233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e41a370-5a71-45f3-8af1-d542867c7aaa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:02.619668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e41a370-5a71-45f3-8af1-d542867c7aaa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:02.678468 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1e41a370-5a71-45f3-8af1-d542867c7aaa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:02.686232 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1e41a370-5a71-45f3-8af1-d542867c7aaa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079489 Apr 07 13:21:02.687388 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 980/1840] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:02 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:03.380736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e0ea4479-ec79-40ae-a7ba-51327e6db243 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:03.381373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e0ea4479-ec79-40ae-a7ba-51327e6db243 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:03.387346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e0ea4479-ec79-40ae-a7ba-51327e6db243 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:03.387796 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e0ea4479-ec79-40ae-a7ba-51327e6db243 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:03.388585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e0ea4479-ec79-40ae-a7ba-51327e6db243 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:03.389023 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e0ea4479-ec79-40ae-a7ba-51327e6db243 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:03.519765 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e0ea4479-ec79-40ae-a7ba-51327e6db243 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:03.527525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e0ea4479-ec79-40ae-a7ba-51327e6db243 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150625 Apr 07 13:21:03.528087 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 861/1841] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:03 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:03.606157 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-554a23a5-b422-4208-8bfa-9377a2432b6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:03.606772 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-554a23a5-b422-4208-8bfa-9377a2432b6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:03.612647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-554a23a5-b422-4208-8bfa-9377a2432b6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:03.613214 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-554a23a5-b422-4208-8bfa-9377a2432b6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:03.613861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-554a23a5-b422-4208-8bfa-9377a2432b6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:03.614297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-554a23a5-b422-4208-8bfa-9377a2432b6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:03.673415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-554a23a5-b422-4208-8bfa-9377a2432b6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:03.681497 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-554a23a5-b422-4208-8bfa-9377a2432b6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:03.682979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-554a23a5-b422-4208-8bfa-9377a2432b6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:03.684102 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-554a23a5-b422-4208-8bfa-9377a2432b6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081825 Apr 07 13:21:03.684678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 981/1842] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:03 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:03.703361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f843a888-2f91-4395-b33d-532917fd8603 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:03.703977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f843a888-2f91-4395-b33d-532917fd8603 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:03.709832 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f843a888-2f91-4395-b33d-532917fd8603 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:03.710286 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f843a888-2f91-4395-b33d-532917fd8603 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:03.711051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f843a888-2f91-4395-b33d-532917fd8603 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:03.711489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f843a888-2f91-4395-b33d-532917fd8603 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:03.769751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f843a888-2f91-4395-b33d-532917fd8603 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:03.777458 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f843a888-2f91-4395-b33d-532917fd8603 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078610 Apr 07 13:21:03.778021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 862/1843] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:03 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:04.545172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-53f4cb96-23a9-4149-8601-ccfd5cfa1444 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:04.545784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-53f4cb96-23a9-4149-8601-ccfd5cfa1444 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:04.552302 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53f4cb96-23a9-4149-8601-ccfd5cfa1444 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:04.552746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53f4cb96-23a9-4149-8601-ccfd5cfa1444 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:04.553493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53f4cb96-23a9-4149-8601-ccfd5cfa1444 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:04.553924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53f4cb96-23a9-4149-8601-ccfd5cfa1444 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:04.686205 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-53f4cb96-23a9-4149-8601-ccfd5cfa1444 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:04.693997 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-53f4cb96-23a9-4149-8601-ccfd5cfa1444 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152957 Apr 07 13:21:04.694555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 982/1844] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:04 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:04.703172 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8765006f-f3c2-445d-9cc6-2268aaf0042d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:04.703692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8765006f-f3c2-445d-9cc6-2268aaf0042d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:04.709739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8765006f-f3c2-445d-9cc6-2268aaf0042d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:04.710188 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8765006f-f3c2-445d-9cc6-2268aaf0042d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:04.710954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8765006f-f3c2-445d-9cc6-2268aaf0042d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:04.711390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8765006f-f3c2-445d-9cc6-2268aaf0042d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:04.769854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8765006f-f3c2-445d-9cc6-2268aaf0042d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:04.777952 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8765006f-f3c2-445d-9cc6-2268aaf0042d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:04.779454 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8765006f-f3c2-445d-9cc6-2268aaf0042d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:04.781227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8765006f-f3c2-445d-9cc6-2268aaf0042d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082217 Apr 07 13:21:04.781784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 863/1845] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:04 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:04.793759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-89bf0691-a700-400b-8c76-5e2debf71e51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:04.794374 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-89bf0691-a700-400b-8c76-5e2debf71e51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:04.800330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89bf0691-a700-400b-8c76-5e2debf71e51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:04.800724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89bf0691-a700-400b-8c76-5e2debf71e51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:04.801518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89bf0691-a700-400b-8c76-5e2debf71e51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:04.801951 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89bf0691-a700-400b-8c76-5e2debf71e51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:04.860116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-89bf0691-a700-400b-8c76-5e2debf71e51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:04.867970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-89bf0691-a700-400b-8c76-5e2debf71e51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.077967 Apr 07 13:21:04.868575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 983/1846] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:04 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:05.710705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-63587d14-742a-46ef-aff2-7ea07c381a89 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:05.711322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-63587d14-742a-46ef-aff2-7ea07c381a89 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:05.718296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-63587d14-742a-46ef-aff2-7ea07c381a89 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:05.718815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-63587d14-742a-46ef-aff2-7ea07c381a89 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:05.719596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-63587d14-742a-46ef-aff2-7ea07c381a89 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:05.720041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-63587d14-742a-46ef-aff2-7ea07c381a89 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:05.799287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9b68aa59-5ba4-43d8-a2cb-98479d3bba89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:05.799904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9b68aa59-5ba4-43d8-a2cb-98479d3bba89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:05.806184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9b68aa59-5ba4-43d8-a2cb-98479d3bba89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:05.806630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9b68aa59-5ba4-43d8-a2cb-98479d3bba89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:05.807414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9b68aa59-5ba4-43d8-a2cb-98479d3bba89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:05.807834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9b68aa59-5ba4-43d8-a2cb-98479d3bba89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:05.853135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-63587d14-742a-46ef-aff2-7ea07c381a89 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:05.861094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-63587d14-742a-46ef-aff2-7ea07c381a89 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154277 Apr 07 13:21:05.861768 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 864/1847] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:05 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:05.867176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9b68aa59-5ba4-43d8-a2cb-98479d3bba89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:05.876453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9b68aa59-5ba4-43d8-a2cb-98479d3bba89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:05.877951 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9b68aa59-5ba4-43d8-a2cb-98479d3bba89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:05.879090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9b68aa59-5ba4-43d8-a2cb-98479d3bba89 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083803 Apr 07 13:21:05.879653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 984/1848] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:05 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:21:05.884906 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0d13168e-06f0-47b3-a3ca-a2b6413faa62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:05.885526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0d13168e-06f0-47b3-a3ca-a2b6413faa62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:05.891511 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d13168e-06f0-47b3-a3ca-a2b6413faa62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:05.891966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d13168e-06f0-47b3-a3ca-a2b6413faa62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:05.892790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d13168e-06f0-47b3-a3ca-a2b6413faa62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:05.893232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0d13168e-06f0-47b3-a3ca-a2b6413faa62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:05.950671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0d13168e-06f0-47b3-a3ca-a2b6413faa62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:05.958536 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0d13168e-06f0-47b3-a3ca-a2b6413faa62 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.077400 Apr 07 13:21:05.959108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 865/1849] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:05 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:06.878217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-afb245e3-fcc6-47c2-ae5b-f66bbd1bd699 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:06.878853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-afb245e3-fcc6-47c2-ae5b-f66bbd1bd699 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:06.885231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afb245e3-fcc6-47c2-ae5b-f66bbd1bd699 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:06.885682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afb245e3-fcc6-47c2-ae5b-f66bbd1bd699 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:06.886442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afb245e3-fcc6-47c2-ae5b-f66bbd1bd699 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:06.886906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afb245e3-fcc6-47c2-ae5b-f66bbd1bd699 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:06.896102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a61e23bd-a516-47ba-afd6-db49ae05fea4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:06.896797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a61e23bd-a516-47ba-afd6-db49ae05fea4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:06.903024 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a61e23bd-a516-47ba-afd6-db49ae05fea4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:06.903471 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a61e23bd-a516-47ba-afd6-db49ae05fea4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:06.904263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a61e23bd-a516-47ba-afd6-db49ae05fea4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:06.904699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a61e23bd-a516-47ba-afd6-db49ae05fea4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:06.968028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a61e23bd-a516-47ba-afd6-db49ae05fea4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:06.978761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a61e23bd-a516-47ba-afd6-db49ae05fea4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:06.980919 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a61e23bd-a516-47ba-afd6-db49ae05fea4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:06.982715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a61e23bd-a516-47ba-afd6-db49ae05fea4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.090222 Apr 07 13:21:06.984364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 866/1850] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:06 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:21:06.990419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-24b98c1c-4608-4f46-b261-844ba9c642d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:06.991472 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-24b98c1c-4608-4f46-b261-844ba9c642d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:06.998249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-24b98c1c-4608-4f46-b261-844ba9c642d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:06.998907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-24b98c1c-4608-4f46-b261-844ba9c642d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:07.000895 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-24b98c1c-4608-4f46-b261-844ba9c642d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:07.001522 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-24b98c1c-4608-4f46-b261-844ba9c642d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:07.023319 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-afb245e3-fcc6-47c2-ae5b-f66bbd1bd699 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:07.031291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-afb245e3-fcc6-47c2-ae5b-f66bbd1bd699 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157522 Apr 07 13:21:07.031869 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 985/1851] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:06 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:07.062111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-24b98c1c-4608-4f46-b261-844ba9c642d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:07.069804 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-24b98c1c-4608-4f46-b261-844ba9c642d6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.084249 Apr 07 13:21:07.070363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 867/1852] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:06 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:08.001946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d2bb80bd-640e-4062-b666-c81a1d7470c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:08.002564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d2bb80bd-640e-4062-b666-c81a1d7470c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:08.008769 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2bb80bd-640e-4062-b666-c81a1d7470c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:08.009213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2bb80bd-640e-4062-b666-c81a1d7470c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:08.010046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2bb80bd-640e-4062-b666-c81a1d7470c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:08.010497 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2bb80bd-640e-4062-b666-c81a1d7470c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:08.049290 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3a3c8cec-d799-4cf3-9b65-1d19bceb1362 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:08.049911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3a3c8cec-d799-4cf3-9b65-1d19bceb1362 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:08.056746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3a3c8cec-d799-4cf3-9b65-1d19bceb1362 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:08.057203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3a3c8cec-d799-4cf3-9b65-1d19bceb1362 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:08.057990 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3a3c8cec-d799-4cf3-9b65-1d19bceb1362 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:08.058591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3a3c8cec-d799-4cf3-9b65-1d19bceb1362 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:08.071227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d2bb80bd-640e-4062-b666-c81a1d7470c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:08.079649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d2bb80bd-640e-4062-b666-c81a1d7470c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:08.081119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d2bb80bd-640e-4062-b666-c81a1d7470c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:08.082255 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d2bb80bd-640e-4062-b666-c81a1d7470c7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084676 Apr 07 13:21:08.082811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 986/1853] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:07 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:08.087081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cbe8b694-233e-4ac2-b67a-591249ce3897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:08.087678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cbe8b694-233e-4ac2-b67a-591249ce3897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:08.094217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbe8b694-233e-4ac2-b67a-591249ce3897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:08.094665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbe8b694-233e-4ac2-b67a-591249ce3897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:08.095426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbe8b694-233e-4ac2-b67a-591249ce3897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:08.095858 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cbe8b694-233e-4ac2-b67a-591249ce3897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:08.154065 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cbe8b694-233e-4ac2-b67a-591249ce3897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:08.162583 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cbe8b694-233e-4ac2-b67a-591249ce3897 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078817 Apr 07 13:21:08.163145 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 987/1854] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:08 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:08.198024 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3a3c8cec-d799-4cf3-9b65-1d19bceb1362 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:08.207011 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3a3c8cec-d799-4cf3-9b65-1d19bceb1362 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.162555 Apr 07 13:21:08.207788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 868/1855] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:08 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:09.100397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-43fb6a34-a3c9-4c0a-8890-1339859f51ff tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:09.101004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-43fb6a34-a3c9-4c0a-8890-1339859f51ff tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:09.107143 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-43fb6a34-a3c9-4c0a-8890-1339859f51ff tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:09.107587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-43fb6a34-a3c9-4c0a-8890-1339859f51ff tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:09.109420 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-43fb6a34-a3c9-4c0a-8890-1339859f51ff tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:09.109864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-43fb6a34-a3c9-4c0a-8890-1339859f51ff tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:09.172061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-43fb6a34-a3c9-4c0a-8890-1339859f51ff tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:09.180183 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b274cecd-085a-49f5-85be-e953cf5b0928 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:09.180726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-43fb6a34-a3c9-4c0a-8890-1339859f51ff tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:09.180861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b274cecd-085a-49f5-85be-e953cf5b0928 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:09.181850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-43fb6a34-a3c9-4c0a-8890-1339859f51ff tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:09.182989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-43fb6a34-a3c9-4c0a-8890-1339859f51ff tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086551 Apr 07 13:21:09.183537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 988/1856] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:09 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:09.188234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b274cecd-085a-49f5-85be-e953cf5b0928 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:09.188687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b274cecd-085a-49f5-85be-e953cf5b0928 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:09.189453 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b274cecd-085a-49f5-85be-e953cf5b0928 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:09.189922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b274cecd-085a-49f5-85be-e953cf5b0928 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:09.224929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-89075d78-faa6-4d3d-b122-cfedb907a818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:09.225541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-89075d78-faa6-4d3d-b122-cfedb907a818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:09.231500 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89075d78-faa6-4d3d-b122-cfedb907a818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:09.231950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89075d78-faa6-4d3d-b122-cfedb907a818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:09.232756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89075d78-faa6-4d3d-b122-cfedb907a818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:09.233678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89075d78-faa6-4d3d-b122-cfedb907a818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:09.373324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-89075d78-faa6-4d3d-b122-cfedb907a818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:09.382143 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-89075d78-faa6-4d3d-b122-cfedb907a818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.161053 Apr 07 13:21:09.382730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 989/1857] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:09 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:09.463267 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b274cecd-085a-49f5-85be-e953cf5b0928 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:09.472361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b274cecd-085a-49f5-85be-e953cf5b0928 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.295969 Apr 07 13:21:09.472936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 869/1858] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:09 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:10.201747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-503da761-6fee-4adb-a026-546481a5f6ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:10.202603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-503da761-6fee-4adb-a026-546481a5f6ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:10.209764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-503da761-6fee-4adb-a026-546481a5f6ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:10.210410 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-503da761-6fee-4adb-a026-546481a5f6ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:10.211791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-503da761-6fee-4adb-a026-546481a5f6ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:10.212660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-503da761-6fee-4adb-a026-546481a5f6ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:10.272748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-503da761-6fee-4adb-a026-546481a5f6ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:10.281605 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-503da761-6fee-4adb-a026-546481a5f6ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:10.283100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-503da761-6fee-4adb-a026-546481a5f6ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:10.284261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-503da761-6fee-4adb-a026-546481a5f6ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086445 Apr 07 13:21:10.284821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 990/1859] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:10 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:10.399247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c4a65c25-0582-4378-96ca-1f5054a76461 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:10.399870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c4a65c25-0582-4378-96ca-1f5054a76461 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:10.406730 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c4a65c25-0582-4378-96ca-1f5054a76461 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:10.407184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c4a65c25-0582-4378-96ca-1f5054a76461 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:10.407956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c4a65c25-0582-4378-96ca-1f5054a76461 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:10.408426 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c4a65c25-0582-4378-96ca-1f5054a76461 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:10.495761 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fd3324e8-25f4-41f1-9641-1cc047c2953d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:10.496398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fd3324e8-25f4-41f1-9641-1cc047c2953d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:10.502969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd3324e8-25f4-41f1-9641-1cc047c2953d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:10.503556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd3324e8-25f4-41f1-9641-1cc047c2953d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:10.504360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd3324e8-25f4-41f1-9641-1cc047c2953d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:10.504801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd3324e8-25f4-41f1-9641-1cc047c2953d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:10.538425 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c4a65c25-0582-4378-96ca-1f5054a76461 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:10.547576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c4a65c25-0582-4378-96ca-1f5054a76461 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152128 Apr 07 13:21:10.548196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 870/1860] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:10 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:10.563237 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fd3324e8-25f4-41f1-9641-1cc047c2953d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:10.571062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fd3324e8-25f4-41f1-9641-1cc047c2953d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080313 Apr 07 13:21:10.571613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 991/1861] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:10 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:11.302956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-58e5b9e6-7204-45c9-b6f3-436bad9b3a8e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:11.303486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-58e5b9e6-7204-45c9-b6f3-436bad9b3a8e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:11.309631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-58e5b9e6-7204-45c9-b6f3-436bad9b3a8e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:11.310090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-58e5b9e6-7204-45c9-b6f3-436bad9b3a8e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:11.310867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-58e5b9e6-7204-45c9-b6f3-436bad9b3a8e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:11.311421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-58e5b9e6-7204-45c9-b6f3-436bad9b3a8e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:11.370708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-58e5b9e6-7204-45c9-b6f3-436bad9b3a8e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:11.378974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-58e5b9e6-7204-45c9-b6f3-436bad9b3a8e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:11.380517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-58e5b9e6-7204-45c9-b6f3-436bad9b3a8e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:11.381663 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-58e5b9e6-7204-45c9-b6f3-436bad9b3a8e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082685 Apr 07 13:21:11.382223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 871/1862] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:11 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:11.564794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c9b6df30-51e0-4381-bd1b-b449063b1671 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:11.565348 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c9b6df30-51e0-4381-bd1b-b449063b1671 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:11.571549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9b6df30-51e0-4381-bd1b-b449063b1671 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:11.572000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9b6df30-51e0-4381-bd1b-b449063b1671 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:11.572801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9b6df30-51e0-4381-bd1b-b449063b1671 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:11.573238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9b6df30-51e0-4381-bd1b-b449063b1671 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:11.588468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2d9b2b86-1953-41c9-83a0-9dfc065c2f6d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:11.589084 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2d9b2b86-1953-41c9-83a0-9dfc065c2f6d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:11.596577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d9b2b86-1953-41c9-83a0-9dfc065c2f6d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:11.597026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d9b2b86-1953-41c9-83a0-9dfc065c2f6d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:11.597795 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d9b2b86-1953-41c9-83a0-9dfc065c2f6d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:11.598230 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2d9b2b86-1953-41c9-83a0-9dfc065c2f6d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:11.661060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2d9b2b86-1953-41c9-83a0-9dfc065c2f6d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:11.668856 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2d9b2b86-1953-41c9-83a0-9dfc065c2f6d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.084280 Apr 07 13:21:11.669429 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 872/1863] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:11 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:11.709835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c9b6df30-51e0-4381-bd1b-b449063b1671 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:11.717549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c9b6df30-51e0-4381-bd1b-b449063b1671 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156862 Apr 07 13:21:11.718107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 992/1864] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:11 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:12.399382 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dbb98eae-879d-4dae-a465-04b7639034e3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:12.400009 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dbb98eae-879d-4dae-a465-04b7639034e3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:12.406030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dbb98eae-879d-4dae-a465-04b7639034e3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:12.406477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dbb98eae-879d-4dae-a465-04b7639034e3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:12.407238 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dbb98eae-879d-4dae-a465-04b7639034e3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:12.407674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dbb98eae-879d-4dae-a465-04b7639034e3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:12.465688 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dbb98eae-879d-4dae-a465-04b7639034e3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:12.475295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dbb98eae-879d-4dae-a465-04b7639034e3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:12.476821 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dbb98eae-879d-4dae-a465-04b7639034e3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:12.478197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dbb98eae-879d-4dae-a465-04b7639034e3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082705 Apr 07 13:21:12.478760 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 873/1865] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:12 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:21:12.611409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:21:12.611955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:21:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:21:12.684937 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2b43cf09-70d6-476c-aa3b-93fbe49a064b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:12.685469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2b43cf09-70d6-476c-aa3b-93fbe49a064b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:12.691968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2b43cf09-70d6-476c-aa3b-93fbe49a064b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:12.692452 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2b43cf09-70d6-476c-aa3b-93fbe49a064b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:12.693215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2b43cf09-70d6-476c-aa3b-93fbe49a064b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:12.693650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2b43cf09-70d6-476c-aa3b-93fbe49a064b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:12.735680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4adb561c-b790-49af-93ba-d6e3decd3f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:12.736320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4adb561c-b790-49af-93ba-d6e3decd3f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:12.742638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4adb561c-b790-49af-93ba-d6e3decd3f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:12.743086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4adb561c-b790-49af-93ba-d6e3decd3f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:12.743850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4adb561c-b790-49af-93ba-d6e3decd3f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:12.744315 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4adb561c-b790-49af-93ba-d6e3decd3f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:12.753778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2b43cf09-70d6-476c-aa3b-93fbe49a064b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:12.761613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2b43cf09-70d6-476c-aa3b-93fbe49a064b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080492 Apr 07 13:21:12.762173 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 993/1866] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:12 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:12.887093 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4adb561c-b790-49af-93ba-d6e3decd3f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:12.895464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4adb561c-b790-49af-93ba-d6e3decd3f9e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.164829 Apr 07 13:21:12.896058 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 874/1867] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:12 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:13.498165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3557f4ca-157b-48b1-a630-53866e032439 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:13.499630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3557f4ca-157b-48b1-a630-53866e032439 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:13.505246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3557f4ca-157b-48b1-a630-53866e032439 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:13.505695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3557f4ca-157b-48b1-a630-53866e032439 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:13.506448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3557f4ca-157b-48b1-a630-53866e032439 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:13.506883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3557f4ca-157b-48b1-a630-53866e032439 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:13.565670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3557f4ca-157b-48b1-a630-53866e032439 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:13.573876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3557f4ca-157b-48b1-a630-53866e032439 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:13.575394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3557f4ca-157b-48b1-a630-53866e032439 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:13.576538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3557f4ca-157b-48b1-a630-53866e032439 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082293 Apr 07 13:21:13.577722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 994/1868] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:13 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:13.777633 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e8247dbf-bbb0-4120-a307-f887d4131519 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:13.778217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e8247dbf-bbb0-4120-a307-f887d4131519 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:13.784663 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e8247dbf-bbb0-4120-a307-f887d4131519 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:13.785367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e8247dbf-bbb0-4120-a307-f887d4131519 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:13.786153 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e8247dbf-bbb0-4120-a307-f887d4131519 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:13.786596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e8247dbf-bbb0-4120-a307-f887d4131519 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:13.846493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e8247dbf-bbb0-4120-a307-f887d4131519 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:13.854430 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e8247dbf-bbb0-4120-a307-f887d4131519 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080731 Apr 07 13:21:13.855003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 875/1869] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:13 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:13.912685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-238f5452-a591-4663-b65f-b5872ac551fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:13.913307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-238f5452-a591-4663-b65f-b5872ac551fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:13.921182 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-238f5452-a591-4663-b65f-b5872ac551fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:13.921800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-238f5452-a591-4663-b65f-b5872ac551fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:13.922800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-238f5452-a591-4663-b65f-b5872ac551fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:13.923241 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-238f5452-a591-4663-b65f-b5872ac551fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:14.106530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:21:14.106766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:21:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:21:14.122542 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-238f5452-a591-4663-b65f-b5872ac551fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:14.130443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-238f5452-a591-4663-b65f-b5872ac551fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.221849 Apr 07 13:21:14.131016 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 995/1870] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:13 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:14.595454 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-130716c8-c33f-47c3-99e5-b15d3e697990 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:14.596067 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-130716c8-c33f-47c3-99e5-b15d3e697990 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:14.602051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-130716c8-c33f-47c3-99e5-b15d3e697990 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:14.602501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-130716c8-c33f-47c3-99e5-b15d3e697990 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:14.603265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-130716c8-c33f-47c3-99e5-b15d3e697990 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:14.603700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-130716c8-c33f-47c3-99e5-b15d3e697990 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:14.665034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-130716c8-c33f-47c3-99e5-b15d3e697990 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:14.673179 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-130716c8-c33f-47c3-99e5-b15d3e697990 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:14.674668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-130716c8-c33f-47c3-99e5-b15d3e697990 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:14.675840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-130716c8-c33f-47c3-99e5-b15d3e697990 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084869 Apr 07 13:21:14.676438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 876/1871] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:14 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:14.872004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7dde634d-08fe-42f3-930d-7d3a734b3a97 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:14.872654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7dde634d-08fe-42f3-930d-7d3a734b3a97 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:14.878766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7dde634d-08fe-42f3-930d-7d3a734b3a97 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:14.879210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7dde634d-08fe-42f3-930d-7d3a734b3a97 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:14.879985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7dde634d-08fe-42f3-930d-7d3a734b3a97 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:14.880454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7dde634d-08fe-42f3-930d-7d3a734b3a97 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:14.948121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7dde634d-08fe-42f3-930d-7d3a734b3a97 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:14.956645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7dde634d-08fe-42f3-930d-7d3a734b3a97 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.088359 Apr 07 13:21:14.957197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 996/1872] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:14 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:15.147129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6586a4a4-58be-4c82-8e07-a8acbff2554f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:15.148687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6586a4a4-58be-4c82-8e07-a8acbff2554f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:15.156748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6586a4a4-58be-4c82-8e07-a8acbff2554f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:15.157347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6586a4a4-58be-4c82-8e07-a8acbff2554f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:15.158631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6586a4a4-58be-4c82-8e07-a8acbff2554f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:15.159369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6586a4a4-58be-4c82-8e07-a8acbff2554f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:15.310469 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6586a4a4-58be-4c82-8e07-a8acbff2554f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:15.320632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6586a4a4-58be-4c82-8e07-a8acbff2554f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.177408 Apr 07 13:21:15.321261 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 877/1873] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:15 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:15.693675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-15b3378c-d43b-4aab-a0ef-9133aa4c13fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:15.694281 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-15b3378c-d43b-4aab-a0ef-9133aa4c13fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:15.700027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15b3378c-d43b-4aab-a0ef-9133aa4c13fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:15.700505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15b3378c-d43b-4aab-a0ef-9133aa4c13fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:15.701260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15b3378c-d43b-4aab-a0ef-9133aa4c13fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:15.701711 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-15b3378c-d43b-4aab-a0ef-9133aa4c13fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:15.761137 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-15b3378c-d43b-4aab-a0ef-9133aa4c13fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:15.769996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-15b3378c-d43b-4aab-a0ef-9133aa4c13fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:15.771464 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-15b3378c-d43b-4aab-a0ef-9133aa4c13fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:15.772621 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-15b3378c-d43b-4aab-a0ef-9133aa4c13fe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082880 Apr 07 13:21:15.773169 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 997/1874] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:15 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:15.974547 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fc30c4dd-00f3-4a40-bbe8-c5475dab67c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:15.975171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fc30c4dd-00f3-4a40-bbe8-c5475dab67c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:15.981174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc30c4dd-00f3-4a40-bbe8-c5475dab67c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:15.981623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc30c4dd-00f3-4a40-bbe8-c5475dab67c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:15.982445 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc30c4dd-00f3-4a40-bbe8-c5475dab67c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:15.983602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc30c4dd-00f3-4a40-bbe8-c5475dab67c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:16.044855 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fc30c4dd-00f3-4a40-bbe8-c5475dab67c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:16.053449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fc30c4dd-00f3-4a40-bbe8-c5475dab67c6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.083767 Apr 07 13:21:16.054014 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 878/1875] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:15 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:16.338000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-efc25611-dcd4-46d6-8a9a-e6ac01755f8f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:16.338556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-efc25611-dcd4-46d6-8a9a-e6ac01755f8f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:16.345793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-efc25611-dcd4-46d6-8a9a-e6ac01755f8f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:16.346234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-efc25611-dcd4-46d6-8a9a-e6ac01755f8f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:16.346987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-efc25611-dcd4-46d6-8a9a-e6ac01755f8f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:16.347417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-efc25611-dcd4-46d6-8a9a-e6ac01755f8f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:16.484323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-efc25611-dcd4-46d6-8a9a-e6ac01755f8f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:16.492057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-efc25611-dcd4-46d6-8a9a-e6ac01755f8f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157956 Apr 07 13:21:16.492671 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 998/1876] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:16 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:16.789921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bd38f5f8-317e-4a94-ad96-5ba60ba2fbc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:16.790584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bd38f5f8-317e-4a94-ad96-5ba60ba2fbc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:16.797303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd38f5f8-317e-4a94-ad96-5ba60ba2fbc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:16.797758 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd38f5f8-317e-4a94-ad96-5ba60ba2fbc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:16.798531 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd38f5f8-317e-4a94-ad96-5ba60ba2fbc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:16.798999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bd38f5f8-317e-4a94-ad96-5ba60ba2fbc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:16.857823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bd38f5f8-317e-4a94-ad96-5ba60ba2fbc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:16.865944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bd38f5f8-317e-4a94-ad96-5ba60ba2fbc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:16.867442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bd38f5f8-317e-4a94-ad96-5ba60ba2fbc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:16.868628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bd38f5f8-317e-4a94-ad96-5ba60ba2fbc0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082615 Apr 07 13:21:16.869369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 879/1877] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:16 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:17.070699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-32b57dc7-3f0d-4501-9cec-15ed8251f84c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:17.071304 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-32b57dc7-3f0d-4501-9cec-15ed8251f84c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:17.078313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32b57dc7-3f0d-4501-9cec-15ed8251f84c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:17.078757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32b57dc7-3f0d-4501-9cec-15ed8251f84c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:17.079514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32b57dc7-3f0d-4501-9cec-15ed8251f84c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:17.079946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32b57dc7-3f0d-4501-9cec-15ed8251f84c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:17.137393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-32b57dc7-3f0d-4501-9cec-15ed8251f84c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:17.145809 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-32b57dc7-3f0d-4501-9cec-15ed8251f84c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078971 Apr 07 13:21:17.146372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 999/1878] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:17 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:17.509331 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-090c191c-2cab-4439-856a-78a8ffa4f84a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:17.509943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-090c191c-2cab-4439-856a-78a8ffa4f84a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:17.516389 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-090c191c-2cab-4439-856a-78a8ffa4f84a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:17.516868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-090c191c-2cab-4439-856a-78a8ffa4f84a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:17.517630 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-090c191c-2cab-4439-856a-78a8ffa4f84a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:17.518064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-090c191c-2cab-4439-856a-78a8ffa4f84a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:17.650757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-090c191c-2cab-4439-856a-78a8ffa4f84a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:17.658436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-090c191c-2cab-4439-856a-78a8ffa4f84a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152996 Apr 07 13:21:17.658996 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 880/1879] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:17 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:17.886896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-16de7896-87d7-40fb-8176-52c8323cddfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:17.887487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-16de7896-87d7-40fb-8176-52c8323cddfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:17.893797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16de7896-87d7-40fb-8176-52c8323cddfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:17.894250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16de7896-87d7-40fb-8176-52c8323cddfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:17.895012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16de7896-87d7-40fb-8176-52c8323cddfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:17.895446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16de7896-87d7-40fb-8176-52c8323cddfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:17.954951 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-16de7896-87d7-40fb-8176-52c8323cddfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:17.963079 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-16de7896-87d7-40fb-8176-52c8323cddfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:17.964597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-16de7896-87d7-40fb-8176-52c8323cddfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:17.965730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-16de7896-87d7-40fb-8176-52c8323cddfe tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082713 Apr 07 13:21:17.966276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1000/1880] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:17 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:18.162206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1907b173-7945-40ec-a22e-a8b71b94829c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:18.162853 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1907b173-7945-40ec-a22e-a8b71b94829c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:18.169186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1907b173-7945-40ec-a22e-a8b71b94829c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:18.169639 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1907b173-7945-40ec-a22e-a8b71b94829c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:18.170424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1907b173-7945-40ec-a22e-a8b71b94829c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:18.170861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1907b173-7945-40ec-a22e-a8b71b94829c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:18.229706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1907b173-7945-40ec-a22e-a8b71b94829c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:18.237915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1907b173-7945-40ec-a22e-a8b71b94829c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079771 Apr 07 13:21:18.238500 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 881/1881] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:18 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:18.675815 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-50430d79-c561-482b-9910-807c2b3c6566 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:18.676469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-50430d79-c561-482b-9910-807c2b3c6566 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:18.682451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50430d79-c561-482b-9910-807c2b3c6566 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:18.682905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50430d79-c561-482b-9910-807c2b3c6566 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:18.683668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50430d79-c561-482b-9910-807c2b3c6566 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:18.684106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50430d79-c561-482b-9910-807c2b3c6566 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:18.817507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-50430d79-c561-482b-9910-807c2b3c6566 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:18.825167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-50430d79-c561-482b-9910-807c2b3c6566 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153186 Apr 07 13:21:18.825723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1001/1882] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:18 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:18.985185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ec43421f-4e09-47fb-a3c6-15576a32add8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:18.985799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ec43421f-4e09-47fb-a3c6-15576a32add8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:18.991764 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ec43421f-4e09-47fb-a3c6-15576a32add8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:18.992246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ec43421f-4e09-47fb-a3c6-15576a32add8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:18.993007 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ec43421f-4e09-47fb-a3c6-15576a32add8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:18.993439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ec43421f-4e09-47fb-a3c6-15576a32add8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:19.052773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ec43421f-4e09-47fb-a3c6-15576a32add8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:19.060825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ec43421f-4e09-47fb-a3c6-15576a32add8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:19.063318 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ec43421f-4e09-47fb-a3c6-15576a32add8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:19.064496 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ec43421f-4e09-47fb-a3c6-15576a32add8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084241 Apr 07 13:21:19.065050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 882/1883] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:18 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:19.253700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d4208bb0-5cc4-42af-8c30-3738149d6170 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:19.254244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d4208bb0-5cc4-42af-8c30-3738149d6170 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:19.260599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4208bb0-5cc4-42af-8c30-3738149d6170 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:19.261210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4208bb0-5cc4-42af-8c30-3738149d6170 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:19.262061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4208bb0-5cc4-42af-8c30-3738149d6170 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:19.262712 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4208bb0-5cc4-42af-8c30-3738149d6170 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:19.323020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d4208bb0-5cc4-42af-8c30-3738149d6170 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:19.330950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d4208bb0-5cc4-42af-8c30-3738149d6170 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081101 Apr 07 13:21:19.331514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1002/1884] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:19 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:19.843278 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ef35d981-e24c-4b84-abee-a294f7ba5eaa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:19.843819 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ef35d981-e24c-4b84-abee-a294f7ba5eaa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:19.850199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef35d981-e24c-4b84-abee-a294f7ba5eaa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:19.850648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef35d981-e24c-4b84-abee-a294f7ba5eaa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:19.851409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef35d981-e24c-4b84-abee-a294f7ba5eaa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:19.851847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef35d981-e24c-4b84-abee-a294f7ba5eaa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:19.984786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ef35d981-e24c-4b84-abee-a294f7ba5eaa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:19.992847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ef35d981-e24c-4b84-abee-a294f7ba5eaa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153472 Apr 07 13:21:19.993533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 883/1885] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:19 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:20.082355 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a8674d8c-eede-4deb-bddf-10173541751c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:20.082963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a8674d8c-eede-4deb-bddf-10173541751c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:20.088796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a8674d8c-eede-4deb-bddf-10173541751c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:20.089245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a8674d8c-eede-4deb-bddf-10173541751c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:20.089996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a8674d8c-eede-4deb-bddf-10173541751c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:20.090424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a8674d8c-eede-4deb-bddf-10173541751c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:20.149261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a8674d8c-eede-4deb-bddf-10173541751c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:20.158203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a8674d8c-eede-4deb-bddf-10173541751c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:20.159682 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a8674d8c-eede-4deb-bddf-10173541751c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:20.161124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a8674d8c-eede-4deb-bddf-10173541751c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082592 Apr 07 13:21:20.161668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1003/1886] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:20 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:20.348810 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d48a9493-1113-4487-a7f3-a1709307cdda tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:20.349422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d48a9493-1113-4487-a7f3-a1709307cdda tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:20.355451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d48a9493-1113-4487-a7f3-a1709307cdda tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:20.355898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d48a9493-1113-4487-a7f3-a1709307cdda tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:20.356681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d48a9493-1113-4487-a7f3-a1709307cdda tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:20.357110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d48a9493-1113-4487-a7f3-a1709307cdda tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:20.417967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d48a9493-1113-4487-a7f3-a1709307cdda tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:20.425787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d48a9493-1113-4487-a7f3-a1709307cdda tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080822 Apr 07 13:21:20.426345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 884/1887] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:20 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:21.010398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-79ef5aa9-7061-4f21-89eb-f88db7e7efb2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:21.011006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-79ef5aa9-7061-4f21-89eb-f88db7e7efb2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:21.018139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79ef5aa9-7061-4f21-89eb-f88db7e7efb2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:21.018585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79ef5aa9-7061-4f21-89eb-f88db7e7efb2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:21.019336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79ef5aa9-7061-4f21-89eb-f88db7e7efb2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:21.019767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-79ef5aa9-7061-4f21-89eb-f88db7e7efb2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:21.150963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-79ef5aa9-7061-4f21-89eb-f88db7e7efb2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:21.159201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-79ef5aa9-7061-4f21-89eb-f88db7e7efb2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152632 Apr 07 13:21:21.159834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1004/1888] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:21 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:21.178561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e2e12d2c-a9df-4234-a217-15d88ee78e4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:21.179169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e2e12d2c-a9df-4234-a217-15d88ee78e4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:21.185378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e2e12d2c-a9df-4234-a217-15d88ee78e4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:21.185912 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e2e12d2c-a9df-4234-a217-15d88ee78e4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:21.187694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e2e12d2c-a9df-4234-a217-15d88ee78e4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:21.188130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e2e12d2c-a9df-4234-a217-15d88ee78e4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:21.245666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e2e12d2c-a9df-4234-a217-15d88ee78e4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:21.254695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e2e12d2c-a9df-4234-a217-15d88ee78e4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:21.256208 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e2e12d2c-a9df-4234-a217-15d88ee78e4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:21.257356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e2e12d2c-a9df-4234-a217-15d88ee78e4e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082591 Apr 07 13:21:21.257909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 885/1889] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:21 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:21:21.442706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7a217370-93eb-4437-9039-0655996babbc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:21.443276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7a217370-93eb-4437-9039-0655996babbc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:21.449255 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7a217370-93eb-4437-9039-0655996babbc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:21.449705 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7a217370-93eb-4437-9039-0655996babbc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:21.450462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7a217370-93eb-4437-9039-0655996babbc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:21.450895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7a217370-93eb-4437-9039-0655996babbc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:21.509024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7a217370-93eb-4437-9039-0655996babbc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:21.516948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7a217370-93eb-4437-9039-0655996babbc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078152 Apr 07 13:21:21.517523 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1005/1890] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:21 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:22.176816 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-105d2bc2-991e-4f5c-a7d5-731a35188201 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:22.177342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-105d2bc2-991e-4f5c-a7d5-731a35188201 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:22.183627 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-105d2bc2-991e-4f5c-a7d5-731a35188201 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:22.184233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-105d2bc2-991e-4f5c-a7d5-731a35188201 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:22.184841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-105d2bc2-991e-4f5c-a7d5-731a35188201 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:22.185273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-105d2bc2-991e-4f5c-a7d5-731a35188201 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:22.276012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cb33c46a-7393-4717-9954-7f1914130d38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:22.276694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cb33c46a-7393-4717-9954-7f1914130d38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:22.282594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cb33c46a-7393-4717-9954-7f1914130d38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:22.283049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cb33c46a-7393-4717-9954-7f1914130d38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:22.283822 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cb33c46a-7393-4717-9954-7f1914130d38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:22.284310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cb33c46a-7393-4717-9954-7f1914130d38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:22.319329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-105d2bc2-991e-4f5c-a7d5-731a35188201 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:22.328253 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-105d2bc2-991e-4f5c-a7d5-731a35188201 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155120 Apr 07 13:21:22.328843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 886/1891] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:22 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:22.343688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cb33c46a-7393-4717-9954-7f1914130d38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:22.351854 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cb33c46a-7393-4717-9954-7f1914130d38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:22.353381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cb33c46a-7393-4717-9954-7f1914130d38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:22.354512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cb33c46a-7393-4717-9954-7f1914130d38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082509 Apr 07 13:21:22.355061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1006/1892] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:21:22.534089 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-47e6a748-42db-42ef-8c1c-8644ead1eb2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:22.534627 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-47e6a748-42db-42ef-8c1c-8644ead1eb2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:22.541621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-47e6a748-42db-42ef-8c1c-8644ead1eb2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:22.542080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-47e6a748-42db-42ef-8c1c-8644ead1eb2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:22.542856 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-47e6a748-42db-42ef-8c1c-8644ead1eb2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:22.543299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-47e6a748-42db-42ef-8c1c-8644ead1eb2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:22.604113 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-47e6a748-42db-42ef-8c1c-8644ead1eb2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:22.612467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-47e6a748-42db-42ef-8c1c-8644ead1eb2e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.082262 Apr 07 13:21:22.613040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 887/1893] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:22 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:23.346174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-04aa98c5-57ca-42d2-8ccf-a36d27e0cfff tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:23.346733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-04aa98c5-57ca-42d2-8ccf-a36d27e0cfff tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:23.352920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04aa98c5-57ca-42d2-8ccf-a36d27e0cfff tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:23.353365 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04aa98c5-57ca-42d2-8ccf-a36d27e0cfff tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:23.354119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04aa98c5-57ca-42d2-8ccf-a36d27e0cfff tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:23.354549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04aa98c5-57ca-42d2-8ccf-a36d27e0cfff tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:23.372209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4e20fe4a-0143-46f6-9fe8-1db7dc2d2742 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:23.372827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4e20fe4a-0143-46f6-9fe8-1db7dc2d2742 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:23.379270 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4e20fe4a-0143-46f6-9fe8-1db7dc2d2742 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:23.379867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4e20fe4a-0143-46f6-9fe8-1db7dc2d2742 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:23.380513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4e20fe4a-0143-46f6-9fe8-1db7dc2d2742 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:23.380952 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4e20fe4a-0143-46f6-9fe8-1db7dc2d2742 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:23.441155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4e20fe4a-0143-46f6-9fe8-1db7dc2d2742 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:23.450110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4e20fe4a-0143-46f6-9fe8-1db7dc2d2742 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:23.453127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4e20fe4a-0143-46f6-9fe8-1db7dc2d2742 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:23.454309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4e20fe4a-0143-46f6-9fe8-1db7dc2d2742 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086026 Apr 07 13:21:23.454884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 888/1894] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:23 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:21:23.496200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-04aa98c5-57ca-42d2-8ccf-a36d27e0cfff tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:23.504136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-04aa98c5-57ca-42d2-8ccf-a36d27e0cfff tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.162597 Apr 07 13:21:23.504755 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1007/1895] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:23 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:23.629382 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-30f64b0b-a838-4042-9e6a-367dbb6d54ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:23.630092 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-30f64b0b-a838-4042-9e6a-367dbb6d54ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:23.636079 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-30f64b0b-a838-4042-9e6a-367dbb6d54ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:23.636570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-30f64b0b-a838-4042-9e6a-367dbb6d54ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:23.637342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-30f64b0b-a838-4042-9e6a-367dbb6d54ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:23.637787 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-30f64b0b-a838-4042-9e6a-367dbb6d54ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:23.697435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-30f64b0b-a838-4042-9e6a-367dbb6d54ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:23.705211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-30f64b0b-a838-4042-9e6a-367dbb6d54ec tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079679 Apr 07 13:21:23.705774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 889/1896] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:23 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:24.473862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2454fed5-3e10-4477-982d-b483c3ba184d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:24.475033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2454fed5-3e10-4477-982d-b483c3ba184d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:24.484697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2454fed5-3e10-4477-982d-b483c3ba184d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:24.485837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2454fed5-3e10-4477-982d-b483c3ba184d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:24.486696 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2454fed5-3e10-4477-982d-b483c3ba184d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:24.487182 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2454fed5-3e10-4477-982d-b483c3ba184d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:24.521436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6e8b5bf3-d595-4e2e-8904-58964b2cf293 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:24.522040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6e8b5bf3-d595-4e2e-8904-58964b2cf293 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:24.528390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6e8b5bf3-d595-4e2e-8904-58964b2cf293 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:24.528845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6e8b5bf3-d595-4e2e-8904-58964b2cf293 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:24.529647 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6e8b5bf3-d595-4e2e-8904-58964b2cf293 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:24.530666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6e8b5bf3-d595-4e2e-8904-58964b2cf293 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:24.546604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2454fed5-3e10-4477-982d-b483c3ba184d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:24.554818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2454fed5-3e10-4477-982d-b483c3ba184d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:24.556336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2454fed5-3e10-4477-982d-b483c3ba184d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:24.557461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2454fed5-3e10-4477-982d-b483c3ba184d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088605 Apr 07 13:21:24.558010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1008/1897] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:24 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:24.664443 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6e8b5bf3-d595-4e2e-8904-58964b2cf293 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:24.672242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6e8b5bf3-d595-4e2e-8904-58964b2cf293 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154503 Apr 07 13:21:24.672809 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 890/1898] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:24 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:24.721657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d537e75d-fe09-4b6a-8c00-dc7485c2f05d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:24.722274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d537e75d-fe09-4b6a-8c00-dc7485c2f05d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:24.728159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d537e75d-fe09-4b6a-8c00-dc7485c2f05d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:24.728573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d537e75d-fe09-4b6a-8c00-dc7485c2f05d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:24.729336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d537e75d-fe09-4b6a-8c00-dc7485c2f05d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:24.729774 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d537e75d-fe09-4b6a-8c00-dc7485c2f05d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:24.788525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d537e75d-fe09-4b6a-8c00-dc7485c2f05d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:24.796393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d537e75d-fe09-4b6a-8c00-dc7485c2f05d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078419 Apr 07 13:21:24.796950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1009/1899] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:24 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:25.575700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fdd4e82e-fa1f-4ff8-8ad5-1ad1f239c8e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:25.577917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fdd4e82e-fa1f-4ff8-8ad5-1ad1f239c8e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:25.584333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdd4e82e-fa1f-4ff8-8ad5-1ad1f239c8e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:25.584780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdd4e82e-fa1f-4ff8-8ad5-1ad1f239c8e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:25.585574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdd4e82e-fa1f-4ff8-8ad5-1ad1f239c8e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:25.586008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdd4e82e-fa1f-4ff8-8ad5-1ad1f239c8e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:25.645773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fdd4e82e-fa1f-4ff8-8ad5-1ad1f239c8e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:25.653900 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fdd4e82e-fa1f-4ff8-8ad5-1ad1f239c8e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:25.656173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fdd4e82e-fa1f-4ff8-8ad5-1ad1f239c8e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:25.657351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fdd4e82e-fa1f-4ff8-8ad5-1ad1f239c8e8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085566 Apr 07 13:21:25.657907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 891/1900] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:25 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:25.689649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8e4bb169-cd7e-4980-a185-169db81b325f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:25.690291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8e4bb169-cd7e-4980-a185-169db81b325f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:25.696505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8e4bb169-cd7e-4980-a185-169db81b325f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:25.696949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8e4bb169-cd7e-4980-a185-169db81b325f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:25.697703 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8e4bb169-cd7e-4980-a185-169db81b325f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:25.698135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8e4bb169-cd7e-4980-a185-169db81b325f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:25.813457 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3b284497-4091-4021-829e-7a96105ac85e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:25.814074 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3b284497-4091-4021-829e-7a96105ac85e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:25.819862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3b284497-4091-4021-829e-7a96105ac85e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:25.820354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3b284497-4091-4021-829e-7a96105ac85e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:25.821165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3b284497-4091-4021-829e-7a96105ac85e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:25.821604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3b284497-4091-4021-829e-7a96105ac85e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:25.833919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8e4bb169-cd7e-4980-a185-169db81b325f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:25.841796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8e4bb169-cd7e-4980-a185-169db81b325f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156429 Apr 07 13:21:25.844226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1010/1901] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:25 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:25.881069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3b284497-4091-4021-829e-7a96105ac85e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:25.888991 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3b284497-4091-4021-829e-7a96105ac85e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079590 Apr 07 13:21:25.890059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 892/1902] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:25 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:26.676062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-05637774-dcda-4e69-a7ec-291baa37a607 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:26.676708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-05637774-dcda-4e69-a7ec-291baa37a607 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:26.682565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-05637774-dcda-4e69-a7ec-291baa37a607 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:26.683012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-05637774-dcda-4e69-a7ec-291baa37a607 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:26.683767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-05637774-dcda-4e69-a7ec-291baa37a607 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:26.684232 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-05637774-dcda-4e69-a7ec-291baa37a607 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:26.746292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-05637774-dcda-4e69-a7ec-291baa37a607 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:26.754630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-05637774-dcda-4e69-a7ec-291baa37a607 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:26.756113 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-05637774-dcda-4e69-a7ec-291baa37a607 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:26.757276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-05637774-dcda-4e69-a7ec-291baa37a607 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085150 Apr 07 13:21:26.757832 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1011/1903] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:26 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:26.860323 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ddb853b9-e8b3-40e5-8dda-d324b750436b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:26.860950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ddb853b9-e8b3-40e5-8dda-d324b750436b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:26.867258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ddb853b9-e8b3-40e5-8dda-d324b750436b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:26.867706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ddb853b9-e8b3-40e5-8dda-d324b750436b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:26.868513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ddb853b9-e8b3-40e5-8dda-d324b750436b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:26.868951 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ddb853b9-e8b3-40e5-8dda-d324b750436b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:26.906923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-84a104f0-f20b-412f-a47e-4c6a5fec8e49 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:26.907532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-84a104f0-f20b-412f-a47e-4c6a5fec8e49 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:26.913561 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-84a104f0-f20b-412f-a47e-4c6a5fec8e49 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:26.914014 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-84a104f0-f20b-412f-a47e-4c6a5fec8e49 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:26.914779 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-84a104f0-f20b-412f-a47e-4c6a5fec8e49 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:26.915210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-84a104f0-f20b-412f-a47e-4c6a5fec8e49 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:26.973410 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-84a104f0-f20b-412f-a47e-4c6a5fec8e49 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:26.981122 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-84a104f0-f20b-412f-a47e-4c6a5fec8e49 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078616 Apr 07 13:21:26.981684 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1012/1904] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:26 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:27.005164 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ddb853b9-e8b3-40e5-8dda-d324b750436b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:27.012911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ddb853b9-e8b3-40e5-8dda-d324b750436b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157137 Apr 07 13:21:27.013478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 893/1905] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:26 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:27.774988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-33129e98-475a-474f-8f24-2b2bc40f01e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:27.775580 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-33129e98-475a-474f-8f24-2b2bc40f01e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:27.782833 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33129e98-475a-474f-8f24-2b2bc40f01e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:27.783288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33129e98-475a-474f-8f24-2b2bc40f01e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:27.784041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33129e98-475a-474f-8f24-2b2bc40f01e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:27.784507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-33129e98-475a-474f-8f24-2b2bc40f01e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:27.848990 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-33129e98-475a-474f-8f24-2b2bc40f01e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:27.857192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-33129e98-475a-474f-8f24-2b2bc40f01e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:27.859722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-33129e98-475a-474f-8f24-2b2bc40f01e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:27.860887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-33129e98-475a-474f-8f24-2b2bc40f01e2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.090059 Apr 07 13:21:27.861443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1013/1906] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:27 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:27.999094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-01d56294-cc07-4ae3-a95c-8576fe3ddfdc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:27.999728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-01d56294-cc07-4ae3-a95c-8576fe3ddfdc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:28.006005 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-01d56294-cc07-4ae3-a95c-8576fe3ddfdc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:28.006457 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-01d56294-cc07-4ae3-a95c-8576fe3ddfdc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:28.007224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-01d56294-cc07-4ae3-a95c-8576fe3ddfdc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:28.007659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-01d56294-cc07-4ae3-a95c-8576fe3ddfdc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:28.029936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8bca0a6f-6bdf-4c21-a096-cda637a49dba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:28.031081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8bca0a6f-6bdf-4c21-a096-cda637a49dba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:28.037139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8bca0a6f-6bdf-4c21-a096-cda637a49dba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:28.037584 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8bca0a6f-6bdf-4c21-a096-cda637a49dba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:28.038350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8bca0a6f-6bdf-4c21-a096-cda637a49dba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:28.038783 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8bca0a6f-6bdf-4c21-a096-cda637a49dba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:28.068375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-01d56294-cc07-4ae3-a95c-8576fe3ddfdc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:28.076253 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-01d56294-cc07-4ae3-a95c-8576fe3ddfdc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081628 Apr 07 13:21:28.076906 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 894/1907] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:27 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:28.175680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8bca0a6f-6bdf-4c21-a096-cda637a49dba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:28.183502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8bca0a6f-6bdf-4c21-a096-cda637a49dba tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157442 Apr 07 13:21:28.184066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1014/1908] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:28 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:28.878861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-af905d54-d333-475f-bc22-bb2ba7a678f5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:28.879472 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-af905d54-d333-475f-bc22-bb2ba7a678f5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:28.885325 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-af905d54-d333-475f-bc22-bb2ba7a678f5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:28.885773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-af905d54-d333-475f-bc22-bb2ba7a678f5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:28.886553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-af905d54-d333-475f-bc22-bb2ba7a678f5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:28.886985 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-af905d54-d333-475f-bc22-bb2ba7a678f5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:28.947212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-af905d54-d333-475f-bc22-bb2ba7a678f5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:28.956255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-af905d54-d333-475f-bc22-bb2ba7a678f5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:28.957761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-af905d54-d333-475f-bc22-bb2ba7a678f5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:28.958912 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-af905d54-d333-475f-bc22-bb2ba7a678f5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084153 Apr 07 13:21:28.959469 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 895/1909] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:28 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:29.093829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e84e9ce2-fa37-476c-a472-e945bedc770f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:29.094520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e84e9ce2-fa37-476c-a472-e945bedc770f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:29.101039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e84e9ce2-fa37-476c-a472-e945bedc770f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:29.101492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e84e9ce2-fa37-476c-a472-e945bedc770f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:29.102253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e84e9ce2-fa37-476c-a472-e945bedc770f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:29.102693 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e84e9ce2-fa37-476c-a472-e945bedc770f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:29.164077 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e84e9ce2-fa37-476c-a472-e945bedc770f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:29.171890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e84e9ce2-fa37-476c-a472-e945bedc770f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.082024 Apr 07 13:21:29.172489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1015/1910] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:29 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:29.202279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b0bade8a-6908-4813-9133-dc706ae51a46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:29.202901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b0bade8a-6908-4813-9133-dc706ae51a46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:29.209186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0bade8a-6908-4813-9133-dc706ae51a46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:29.209646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0bade8a-6908-4813-9133-dc706ae51a46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:29.210414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0bade8a-6908-4813-9133-dc706ae51a46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:29.210852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0bade8a-6908-4813-9133-dc706ae51a46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:29.344233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b0bade8a-6908-4813-9133-dc706ae51a46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:29.351904 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b0bade8a-6908-4813-9133-dc706ae51a46 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154146 Apr 07 13:21:29.352528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 896/1911] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:29 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:29.976956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7fb77d7f-322b-4fcf-a0b4-8b1d520fce50 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:29.977599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7fb77d7f-322b-4fcf-a0b4-8b1d520fce50 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:29.983650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fb77d7f-322b-4fcf-a0b4-8b1d520fce50 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:29.984094 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fb77d7f-322b-4fcf-a0b4-8b1d520fce50 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:29.984877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fb77d7f-322b-4fcf-a0b4-8b1d520fce50 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:29.985312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fb77d7f-322b-4fcf-a0b4-8b1d520fce50 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:30.043014 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7fb77d7f-322b-4fcf-a0b4-8b1d520fce50 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:30.051870 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7fb77d7f-322b-4fcf-a0b4-8b1d520fce50 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:30.053397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7fb77d7f-322b-4fcf-a0b4-8b1d520fce50 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:30.054528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7fb77d7f-322b-4fcf-a0b4-8b1d520fce50 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081609 Apr 07 13:21:30.055072 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1016/1912] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:29 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:30.189446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9bb98a0c-6b5e-4a84-aea5-b45c5ebbb64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:30.190094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9bb98a0c-6b5e-4a84-aea5-b45c5ebbb64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:30.195964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bb98a0c-6b5e-4a84-aea5-b45c5ebbb64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:30.196460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bb98a0c-6b5e-4a84-aea5-b45c5ebbb64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:30.197229 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bb98a0c-6b5e-4a84-aea5-b45c5ebbb64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:30.197672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bb98a0c-6b5e-4a84-aea5-b45c5ebbb64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:30.255118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9bb98a0c-6b5e-4a84-aea5-b45c5ebbb64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:30.262821 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9bb98a0c-6b5e-4a84-aea5-b45c5ebbb64c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.077911 Apr 07 13:21:30.263389 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 897/1913] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:30 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:30.369258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-61f1b03e-df51-4cfb-a164-3be52d4baa2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:30.369871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-61f1b03e-df51-4cfb-a164-3be52d4baa2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:30.376940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-61f1b03e-df51-4cfb-a164-3be52d4baa2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:30.377391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-61f1b03e-df51-4cfb-a164-3be52d4baa2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:30.378153 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-61f1b03e-df51-4cfb-a164-3be52d4baa2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:30.378586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-61f1b03e-df51-4cfb-a164-3be52d4baa2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:30.509478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-61f1b03e-df51-4cfb-a164-3be52d4baa2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:30.517386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-61f1b03e-df51-4cfb-a164-3be52d4baa2f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151911 Apr 07 13:21:30.517950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1017/1914] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:30 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:31.073112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-50e3889d-ed1b-4e4b-8628-f13854a0ebde tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:31.073734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-50e3889d-ed1b-4e4b-8628-f13854a0ebde tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:31.080282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-50e3889d-ed1b-4e4b-8628-f13854a0ebde tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:31.080741 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-50e3889d-ed1b-4e4b-8628-f13854a0ebde tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:31.081512 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-50e3889d-ed1b-4e4b-8628-f13854a0ebde tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:31.081955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-50e3889d-ed1b-4e4b-8628-f13854a0ebde tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:31.140451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-50e3889d-ed1b-4e4b-8628-f13854a0ebde tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:31.148623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-50e3889d-ed1b-4e4b-8628-f13854a0ebde tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:31.150124 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-50e3889d-ed1b-4e4b-8628-f13854a0ebde tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:31.151277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-50e3889d-ed1b-4e4b-8628-f13854a0ebde tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082067 Apr 07 13:21:31.151843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 898/1915] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:31 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:31.279751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6a8dbf1b-5102-4bf3-87af-7e58a708097a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:31.280329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6a8dbf1b-5102-4bf3-87af-7e58a708097a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:31.286448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a8dbf1b-5102-4bf3-87af-7e58a708097a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:31.286903 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a8dbf1b-5102-4bf3-87af-7e58a708097a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:31.287670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a8dbf1b-5102-4bf3-87af-7e58a708097a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:31.288112 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a8dbf1b-5102-4bf3-87af-7e58a708097a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:31.345588 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6a8dbf1b-5102-4bf3-87af-7e58a708097a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:31.353234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6a8dbf1b-5102-4bf3-87af-7e58a708097a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.077485 Apr 07 13:21:31.353794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1018/1916] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:31 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:31.534514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b7572a46-c0ff-4895-9077-852868a8826a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:31.535067 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b7572a46-c0ff-4895-9077-852868a8826a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:31.541697 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7572a46-c0ff-4895-9077-852868a8826a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:31.542149 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7572a46-c0ff-4895-9077-852868a8826a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:31.542911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7572a46-c0ff-4895-9077-852868a8826a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:31.543352 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7572a46-c0ff-4895-9077-852868a8826a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:31.676862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b7572a46-c0ff-4895-9077-852868a8826a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:31.684573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b7572a46-c0ff-4895-9077-852868a8826a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153969 Apr 07 13:21:31.685140 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 899/1917] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:31 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:32.170376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7488d584-c04c-4fef-8412-516ceb16fc97 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:32.171053 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7488d584-c04c-4fef-8412-516ceb16fc97 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:32.177428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7488d584-c04c-4fef-8412-516ceb16fc97 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:32.177878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7488d584-c04c-4fef-8412-516ceb16fc97 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:32.178643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7488d584-c04c-4fef-8412-516ceb16fc97 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:32.179078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7488d584-c04c-4fef-8412-516ceb16fc97 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:32.244010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7488d584-c04c-4fef-8412-516ceb16fc97 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:32.253007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7488d584-c04c-4fef-8412-516ceb16fc97 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:32.254509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7488d584-c04c-4fef-8412-516ceb16fc97 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:32.255652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7488d584-c04c-4fef-8412-516ceb16fc97 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.089259 Apr 07 13:21:32.256370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1019/1918] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:32 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:32.369332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-77270cc2-0985-4964-a108-0505cbe0e729 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:32.369956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-77270cc2-0985-4964-a108-0505cbe0e729 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:32.375947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77270cc2-0985-4964-a108-0505cbe0e729 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:32.376545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77270cc2-0985-4964-a108-0505cbe0e729 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:32.377328 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77270cc2-0985-4964-a108-0505cbe0e729 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:32.377771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77270cc2-0985-4964-a108-0505cbe0e729 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:32.436610 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-77270cc2-0985-4964-a108-0505cbe0e729 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:32.444338 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-77270cc2-0985-4964-a108-0505cbe0e729 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078809 Apr 07 13:21:32.444900 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 900/1919] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:32 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:32.702875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-91c9fd77-6d99-4b19-8067-e5d54d6d89cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:32.703493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-91c9fd77-6d99-4b19-8067-e5d54d6d89cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:32.709398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91c9fd77-6d99-4b19-8067-e5d54d6d89cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:32.709849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91c9fd77-6d99-4b19-8067-e5d54d6d89cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:32.710619 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91c9fd77-6d99-4b19-8067-e5d54d6d89cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:32.711035 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-91c9fd77-6d99-4b19-8067-e5d54d6d89cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:32.841508 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-91c9fd77-6d99-4b19-8067-e5d54d6d89cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:32.849317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-91c9fd77-6d99-4b19-8067-e5d54d6d89cc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151087 Apr 07 13:21:32.849876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1020/1920] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:32 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:33.273641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cc7a9ac6-747a-47a0-ad97-27fee2955c9b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:33.274258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cc7a9ac6-747a-47a0-ad97-27fee2955c9b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:33.280756 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc7a9ac6-747a-47a0-ad97-27fee2955c9b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:33.281213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc7a9ac6-747a-47a0-ad97-27fee2955c9b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:33.281983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc7a9ac6-747a-47a0-ad97-27fee2955c9b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:33.282424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc7a9ac6-747a-47a0-ad97-27fee2955c9b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:33.342830 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cc7a9ac6-747a-47a0-ad97-27fee2955c9b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:33.350922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cc7a9ac6-747a-47a0-ad97-27fee2955c9b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:33.352434 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cc7a9ac6-747a-47a0-ad97-27fee2955c9b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:33.353566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cc7a9ac6-747a-47a0-ad97-27fee2955c9b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083804 Apr 07 13:21:33.354115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 901/1921] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:33 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:33.461857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0f32583b-1872-4852-b08e-ddc7ff7c29d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:33.462482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0f32583b-1872-4852-b08e-ddc7ff7c29d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:33.469680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0f32583b-1872-4852-b08e-ddc7ff7c29d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:33.470124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0f32583b-1872-4852-b08e-ddc7ff7c29d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:33.470874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0f32583b-1872-4852-b08e-ddc7ff7c29d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:33.471308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0f32583b-1872-4852-b08e-ddc7ff7c29d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:33.529259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0f32583b-1872-4852-b08e-ddc7ff7c29d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:33.538047 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0f32583b-1872-4852-b08e-ddc7ff7c29d3 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080014 Apr 07 13:21:33.538611 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1021/1922] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:33 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:33.866537 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fd41d477-91d0-4800-a8c9-954cf3fd78bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:33.867161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fd41d477-91d0-4800-a8c9-954cf3fd78bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:33.873657 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fd41d477-91d0-4800-a8c9-954cf3fd78bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:33.874159 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fd41d477-91d0-4800-a8c9-954cf3fd78bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:33.875002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fd41d477-91d0-4800-a8c9-954cf3fd78bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:33.875442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fd41d477-91d0-4800-a8c9-954cf3fd78bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:34.006476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fd41d477-91d0-4800-a8c9-954cf3fd78bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:34.014946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fd41d477-91d0-4800-a8c9-954cf3fd78bf tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152251 Apr 07 13:21:34.015490 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 902/1923] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:33 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:34.372430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-aee5d987-128a-47ec-8236-dc02049bc8b9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:34.373039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-aee5d987-128a-47ec-8236-dc02049bc8b9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:34.379919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aee5d987-128a-47ec-8236-dc02049bc8b9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:34.380409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aee5d987-128a-47ec-8236-dc02049bc8b9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:34.381173 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aee5d987-128a-47ec-8236-dc02049bc8b9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:34.381608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-aee5d987-128a-47ec-8236-dc02049bc8b9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:34.440215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-aee5d987-128a-47ec-8236-dc02049bc8b9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:34.448413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-aee5d987-128a-47ec-8236-dc02049bc8b9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:34.449909 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-aee5d987-128a-47ec-8236-dc02049bc8b9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:34.451029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-aee5d987-128a-47ec-8236-dc02049bc8b9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082440 Apr 07 13:21:34.452396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1022/1924] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:34 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:34.554737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0a86bb98-2edb-41d4-b542-8b2aaa2258d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:34.555345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0a86bb98-2edb-41d4-b542-8b2aaa2258d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:34.562287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a86bb98-2edb-41d4-b542-8b2aaa2258d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:34.562731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a86bb98-2edb-41d4-b542-8b2aaa2258d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:34.563487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a86bb98-2edb-41d4-b542-8b2aaa2258d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:34.563919 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a86bb98-2edb-41d4-b542-8b2aaa2258d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:34.624541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0a86bb98-2edb-41d4-b542-8b2aaa2258d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:34.632196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0a86bb98-2edb-41d4-b542-8b2aaa2258d1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081248 Apr 07 13:21:34.632757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 903/1925] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:34 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:35.032454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4dbbccd7-9816-4992-92b9-a446a01b4433 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:35.033103 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4dbbccd7-9816-4992-92b9-a446a01b4433 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:35.039582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4dbbccd7-9816-4992-92b9-a446a01b4433 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:35.040029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4dbbccd7-9816-4992-92b9-a446a01b4433 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:35.040820 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4dbbccd7-9816-4992-92b9-a446a01b4433 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:35.041254 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4dbbccd7-9816-4992-92b9-a446a01b4433 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:35.173488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4dbbccd7-9816-4992-92b9-a446a01b4433 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:35.181135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4dbbccd7-9816-4992-92b9-a446a01b4433 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153136 Apr 07 13:21:35.181696 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1023/1926] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:35 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:35.470722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-71139054-7c63-41c4-aade-962ea7bfae04 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:35.471265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-71139054-7c63-41c4-aade-962ea7bfae04 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:35.477588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71139054-7c63-41c4-aade-962ea7bfae04 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:35.478049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71139054-7c63-41c4-aade-962ea7bfae04 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:35.478823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71139054-7c63-41c4-aade-962ea7bfae04 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:35.479264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-71139054-7c63-41c4-aade-962ea7bfae04 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:35.538598 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-71139054-7c63-41c4-aade-962ea7bfae04 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:35.546846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-71139054-7c63-41c4-aade-962ea7bfae04 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:35.548383 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-71139054-7c63-41c4-aade-962ea7bfae04 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:35.549534 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-71139054-7c63-41c4-aade-962ea7bfae04 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083575 Apr 07 13:21:35.550093 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 904/1927] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:35 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:35.649036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-38afe820-1d3e-446b-94cb-4667924d1d3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:35.649641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-38afe820-1d3e-446b-94cb-4667924d1d3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:35.656565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-38afe820-1d3e-446b-94cb-4667924d1d3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:35.657013 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-38afe820-1d3e-446b-94cb-4667924d1d3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:35.657767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-38afe820-1d3e-446b-94cb-4667924d1d3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:35.658195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-38afe820-1d3e-446b-94cb-4667924d1d3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:35.715935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-38afe820-1d3e-446b-94cb-4667924d1d3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:35.724187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-38afe820-1d3e-446b-94cb-4667924d1d3a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078857 Apr 07 13:21:35.724690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1024/1928] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:35 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:36.198696 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-20a613bf-725c-491f-86f1-cb7258449843 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:36.199307 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-20a613bf-725c-491f-86f1-cb7258449843 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:36.205252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-20a613bf-725c-491f-86f1-cb7258449843 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:36.205698 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-20a613bf-725c-491f-86f1-cb7258449843 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:36.206455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-20a613bf-725c-491f-86f1-cb7258449843 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:36.206885 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-20a613bf-725c-491f-86f1-cb7258449843 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:36.338503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-20a613bf-725c-491f-86f1-cb7258449843 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:36.346288 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-20a613bf-725c-491f-86f1-cb7258449843 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151692 Apr 07 13:21:36.346850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 905/1929] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:36 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:36.567401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3f188501-9092-44a0-a415-5a8596595b5b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:36.567956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3f188501-9092-44a0-a415-5a8596595b5b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:36.574198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f188501-9092-44a0-a415-5a8596595b5b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:36.574642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f188501-9092-44a0-a415-5a8596595b5b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:36.575388 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f188501-9092-44a0-a415-5a8596595b5b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:36.575841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f188501-9092-44a0-a415-5a8596595b5b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:36.635989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3f188501-9092-44a0-a415-5a8596595b5b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:36.644496 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3f188501-9092-44a0-a415-5a8596595b5b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:36.645972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3f188501-9092-44a0-a415-5a8596595b5b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:36.647100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3f188501-9092-44a0-a415-5a8596595b5b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083648 Apr 07 13:21:36.647648 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1025/1930] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:36 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:36.741394 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0fcc8484-c67e-4339-a221-73a062e6621d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:36.742004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0fcc8484-c67e-4339-a221-73a062e6621d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:36.748756 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0fcc8484-c67e-4339-a221-73a062e6621d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:36.749281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0fcc8484-c67e-4339-a221-73a062e6621d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:36.750033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0fcc8484-c67e-4339-a221-73a062e6621d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:36.750469 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0fcc8484-c67e-4339-a221-73a062e6621d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:36.808088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0fcc8484-c67e-4339-a221-73a062e6621d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:36.816406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0fcc8484-c67e-4339-a221-73a062e6621d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078731 Apr 07 13:21:36.816969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 906/1931] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:36 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:37.363256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9a2acd61-7433-46a0-8acd-471f5470b7f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:37.363872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9a2acd61-7433-46a0-8acd-471f5470b7f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:37.369764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a2acd61-7433-46a0-8acd-471f5470b7f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:37.370213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a2acd61-7433-46a0-8acd-471f5470b7f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:37.370969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a2acd61-7433-46a0-8acd-471f5470b7f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:37.371402 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a2acd61-7433-46a0-8acd-471f5470b7f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:37.503857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9a2acd61-7433-46a0-8acd-471f5470b7f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:37.511565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9a2acd61-7433-46a0-8acd-471f5470b7f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152134 Apr 07 13:21:37.512123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1026/1932] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:37 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:37.806372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9409f2a0-2d4e-4f33-b9e6-189382e7134b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:37.806989 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9409f2a0-2d4e-4f33-b9e6-189382e7134b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:37.813618 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9409f2a0-2d4e-4f33-b9e6-189382e7134b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:37.814069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9409f2a0-2d4e-4f33-b9e6-189382e7134b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:37.814829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9409f2a0-2d4e-4f33-b9e6-189382e7134b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:37.815264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9409f2a0-2d4e-4f33-b9e6-189382e7134b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:37.832739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d538f563-d593-401f-8321-b65477d3dbfd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:37.833354 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d538f563-d593-401f-8321-b65477d3dbfd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:37.840245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d538f563-d593-401f-8321-b65477d3dbfd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:37.840709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d538f563-d593-401f-8321-b65477d3dbfd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:37.841484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d538f563-d593-401f-8321-b65477d3dbfd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:37.841968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d538f563-d593-401f-8321-b65477d3dbfd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:37.878894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9409f2a0-2d4e-4f33-b9e6-189382e7134b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:37.887690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9409f2a0-2d4e-4f33-b9e6-189382e7134b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:37.889292 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9409f2a0-2d4e-4f33-b9e6-189382e7134b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:37.890465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9409f2a0-2d4e-4f33-b9e6-189382e7134b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.227993 Apr 07 13:21:37.891023 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 907/1933] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:37 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:37.906744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d538f563-d593-401f-8321-b65477d3dbfd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:37.914739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d538f563-d593-401f-8321-b65477d3dbfd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.085761 Apr 07 13:21:37.915300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1027/1934] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:37 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:38.530095 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-82bc2bde-9697-4035-a8e1-1dcb836d7300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:38.530709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-82bc2bde-9697-4035-a8e1-1dcb836d7300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:38.537294 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-82bc2bde-9697-4035-a8e1-1dcb836d7300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:38.537783 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-82bc2bde-9697-4035-a8e1-1dcb836d7300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:38.538553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-82bc2bde-9697-4035-a8e1-1dcb836d7300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:38.538992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-82bc2bde-9697-4035-a8e1-1dcb836d7300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:38.669818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-82bc2bde-9697-4035-a8e1-1dcb836d7300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:38.677621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-82bc2bde-9697-4035-a8e1-1dcb836d7300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152071 Apr 07 13:21:38.678365 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 908/1935] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:38 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:38.908589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-28eeaaf0-7c88-4668-95b1-bd11c04965cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:38.909201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-28eeaaf0-7c88-4668-95b1-bd11c04965cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:38.915689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-28eeaaf0-7c88-4668-95b1-bd11c04965cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:38.916168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-28eeaaf0-7c88-4668-95b1-bd11c04965cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:38.916921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-28eeaaf0-7c88-4668-95b1-bd11c04965cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:38.917358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-28eeaaf0-7c88-4668-95b1-bd11c04965cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:38.931822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-91b95bbf-b81f-458f-a661-bdf684909114 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:38.932470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-91b95bbf-b81f-458f-a661-bdf684909114 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:38.940177 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-91b95bbf-b81f-458f-a661-bdf684909114 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:38.940630 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-91b95bbf-b81f-458f-a661-bdf684909114 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:38.941426 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-91b95bbf-b81f-458f-a661-bdf684909114 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:38.941861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-91b95bbf-b81f-458f-a661-bdf684909114 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:38.977753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-28eeaaf0-7c88-4668-95b1-bd11c04965cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:38.986591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-28eeaaf0-7c88-4668-95b1-bd11c04965cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:38.988089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-28eeaaf0-7c88-4668-95b1-bd11c04965cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:38.989264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-28eeaaf0-7c88-4668-95b1-bd11c04965cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084566 Apr 07 13:21:38.989829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1028/1936] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:38 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:39.005008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-91b95bbf-b81f-458f-a661-bdf684909114 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:39.012843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-91b95bbf-b81f-458f-a661-bdf684909114 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.084753 Apr 07 13:21:39.013403 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 909/1937] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:38 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:39.695354 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-076fa4dd-445f-4c81-bec5-a8de19176ca2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:39.695961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-076fa4dd-445f-4c81-bec5-a8de19176ca2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:39.702887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-076fa4dd-445f-4c81-bec5-a8de19176ca2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:39.703327 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-076fa4dd-445f-4c81-bec5-a8de19176ca2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:39.704075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-076fa4dd-445f-4c81-bec5-a8de19176ca2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:39.704529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-076fa4dd-445f-4c81-bec5-a8de19176ca2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:39.834800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-076fa4dd-445f-4c81-bec5-a8de19176ca2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:39.843540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-076fa4dd-445f-4c81-bec5-a8de19176ca2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151942 Apr 07 13:21:39.844092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1029/1938] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:39 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:40.008257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-36f3dddf-acd1-4a70-8a5a-0ed5faf9fd2e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:40.008875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-36f3dddf-acd1-4a70-8a5a-0ed5faf9fd2e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:40.015746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-36f3dddf-acd1-4a70-8a5a-0ed5faf9fd2e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:40.016238 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-36f3dddf-acd1-4a70-8a5a-0ed5faf9fd2e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:40.017008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-36f3dddf-acd1-4a70-8a5a-0ed5faf9fd2e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:40.017450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-36f3dddf-acd1-4a70-8a5a-0ed5faf9fd2e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:40.031128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-da065c96-0336-4dc8-8fc8-479095419a3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:40.031738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-da065c96-0336-4dc8-8fc8-479095419a3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:40.038234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da065c96-0336-4dc8-8fc8-479095419a3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:40.038678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da065c96-0336-4dc8-8fc8-479095419a3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:40.039432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da065c96-0336-4dc8-8fc8-479095419a3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:40.039861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-da065c96-0336-4dc8-8fc8-479095419a3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:40.079061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-36f3dddf-acd1-4a70-8a5a-0ed5faf9fd2e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:40.087358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-36f3dddf-acd1-4a70-8a5a-0ed5faf9fd2e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:40.088812 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-36f3dddf-acd1-4a70-8a5a-0ed5faf9fd2e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:40.089967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-36f3dddf-acd1-4a70-8a5a-0ed5faf9fd2e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085590 Apr 07 13:21:40.090526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 910/1939] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:40 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:40.100797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-da065c96-0336-4dc8-8fc8-479095419a3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:40.109232 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-da065c96-0336-4dc8-8fc8-479095419a3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.082523 Apr 07 13:21:40.109885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1030/1940] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:40 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:40.859710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-280ae208-0a61-46cc-82dd-053d59a49158 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:40.860360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-280ae208-0a61-46cc-82dd-053d59a49158 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:40.866296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-280ae208-0a61-46cc-82dd-053d59a49158 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:40.866742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-280ae208-0a61-46cc-82dd-053d59a49158 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:40.867502 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-280ae208-0a61-46cc-82dd-053d59a49158 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:40.867933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-280ae208-0a61-46cc-82dd-053d59a49158 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:40.996302 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-280ae208-0a61-46cc-82dd-053d59a49158 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:41.004543 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-280ae208-0a61-46cc-82dd-053d59a49158 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.148601 Apr 07 13:21:41.005102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 911/1941] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:40 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:41.107056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-24207c46-f511-4b45-85dd-d4922729ca34 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:41.107660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-24207c46-f511-4b45-85dd-d4922729ca34 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:41.114082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-24207c46-f511-4b45-85dd-d4922729ca34 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:41.114467 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-24207c46-f511-4b45-85dd-d4922729ca34 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:41.115238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-24207c46-f511-4b45-85dd-d4922729ca34 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:41.115688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-24207c46-f511-4b45-85dd-d4922729ca34 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:41.127524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2ea49055-f16d-49a2-ad2c-09634eddc7ae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:41.128191 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2ea49055-f16d-49a2-ad2c-09634eddc7ae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:41.134428 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2ea49055-f16d-49a2-ad2c-09634eddc7ae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:41.134876 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2ea49055-f16d-49a2-ad2c-09634eddc7ae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:41.135650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2ea49055-f16d-49a2-ad2c-09634eddc7ae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:41.136088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2ea49055-f16d-49a2-ad2c-09634eddc7ae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:41.176756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-24207c46-f511-4b45-85dd-d4922729ca34 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:41.185027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-24207c46-f511-4b45-85dd-d4922729ca34 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:41.187690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-24207c46-f511-4b45-85dd-d4922729ca34 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:41.188859 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-24207c46-f511-4b45-85dd-d4922729ca34 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085582 Apr 07 13:21:41.189427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1031/1942] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:41 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:41.197436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2ea49055-f16d-49a2-ad2c-09634eddc7ae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:41.205968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2ea49055-f16d-49a2-ad2c-09634eddc7ae tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.082973 Apr 07 13:21:41.206534 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 912/1943] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:41 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:42.021017 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-52e9fe3a-b21f-4ba1-ac97-b8d38ea4f1af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:42.021634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-52e9fe3a-b21f-4ba1-ac97-b8d38ea4f1af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:42.027503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-52e9fe3a-b21f-4ba1-ac97-b8d38ea4f1af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:42.027954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-52e9fe3a-b21f-4ba1-ac97-b8d38ea4f1af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:42.028736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-52e9fe3a-b21f-4ba1-ac97-b8d38ea4f1af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:42.029175 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-52e9fe3a-b21f-4ba1-ac97-b8d38ea4f1af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:42.168240 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-52e9fe3a-b21f-4ba1-ac97-b8d38ea4f1af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:42.176092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-52e9fe3a-b21f-4ba1-ac97-b8d38ea4f1af tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158894 Apr 07 13:21:42.176673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1032/1944] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:42 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:42.207082 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-76222803-710d-40ca-88dc-edaae26a3dc4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:42.207692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-76222803-710d-40ca-88dc-edaae26a3dc4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:42.214114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76222803-710d-40ca-88dc-edaae26a3dc4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:42.214568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76222803-710d-40ca-88dc-edaae26a3dc4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:42.215510 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76222803-710d-40ca-88dc-edaae26a3dc4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:42.215950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76222803-710d-40ca-88dc-edaae26a3dc4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:42.224096 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bfae9755-cb62-4214-8243-48c676b3b91f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:42.224743 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bfae9755-cb62-4214-8243-48c676b3b91f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:42.230524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bfae9755-cb62-4214-8243-48c676b3b91f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:42.230972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bfae9755-cb62-4214-8243-48c676b3b91f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:42.231730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bfae9755-cb62-4214-8243-48c676b3b91f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:42.232194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bfae9755-cb62-4214-8243-48c676b3b91f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:42.279311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-76222803-710d-40ca-88dc-edaae26a3dc4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:42.288599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-76222803-710d-40ca-88dc-edaae26a3dc4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:42.290086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-76222803-710d-40ca-88dc-edaae26a3dc4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:42.291234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-76222803-710d-40ca-88dc-edaae26a3dc4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088023 Apr 07 13:21:42.291792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 913/1945] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:42 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:42.291967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bfae9755-cb62-4214-8243-48c676b3b91f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:42.300050 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bfae9755-cb62-4214-8243-48c676b3b91f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079662 Apr 07 13:21:42.300645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1033/1946] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:42 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:43.193308 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-565afdb2-66c6-4d49-903b-9c50da75a6fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:43.193840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-565afdb2-66c6-4d49-903b-9c50da75a6fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:43.199915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-565afdb2-66c6-4d49-903b-9c50da75a6fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:43.200402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-565afdb2-66c6-4d49-903b-9c50da75a6fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:43.201160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-565afdb2-66c6-4d49-903b-9c50da75a6fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:43.201636 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-565afdb2-66c6-4d49-903b-9c50da75a6fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:43.309943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4fac6f7f-34bb-4ad5-a2f6-54ef343bfe6c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:43.310824 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4fac6f7f-34bb-4ad5-a2f6-54ef343bfe6c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:43.318298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4fac6f7f-34bb-4ad5-a2f6-54ef343bfe6c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:43.318829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4fac6f7f-34bb-4ad5-a2f6-54ef343bfe6c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:43.319685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4fac6f7f-34bb-4ad5-a2f6-54ef343bfe6c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:43.320126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4fac6f7f-34bb-4ad5-a2f6-54ef343bfe6c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:43.339838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-565afdb2-66c6-4d49-903b-9c50da75a6fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:43.347797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-565afdb2-66c6-4d49-903b-9c50da75a6fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158397 Apr 07 13:21:43.348388 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 914/1947] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:43 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:43.352699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-99bc31a0-7fd4-4509-a707-0ced6ec760a0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:43.353304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-99bc31a0-7fd4-4509-a707-0ced6ec760a0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:43.359086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-99bc31a0-7fd4-4509-a707-0ced6ec760a0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:43.359525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-99bc31a0-7fd4-4509-a707-0ced6ec760a0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:43.360327 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-99bc31a0-7fd4-4509-a707-0ced6ec760a0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:43.360759 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-99bc31a0-7fd4-4509-a707-0ced6ec760a0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:43.380632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4fac6f7f-34bb-4ad5-a2f6-54ef343bfe6c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:43.388731 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4fac6f7f-34bb-4ad5-a2f6-54ef343bfe6c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:43.391106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4fac6f7f-34bb-4ad5-a2f6-54ef343bfe6c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:43.392263 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4fac6f7f-34bb-4ad5-a2f6-54ef343bfe6c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086119 Apr 07 13:21:43.392821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1034/1948] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:43 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:21:43.421479 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-99bc31a0-7fd4-4509-a707-0ced6ec760a0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:43.429520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-99bc31a0-7fd4-4509-a707-0ced6ec760a0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080178 Apr 07 13:21:43.430075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 915/1949] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:43 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:44.364965 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d4af9ee8-f63a-4499-8806-07dfdf8a0e32 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:44.365580 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d4af9ee8-f63a-4499-8806-07dfdf8a0e32 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:44.371823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4af9ee8-f63a-4499-8806-07dfdf8a0e32 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:44.372300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4af9ee8-f63a-4499-8806-07dfdf8a0e32 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:44.373054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4af9ee8-f63a-4499-8806-07dfdf8a0e32 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:44.374063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d4af9ee8-f63a-4499-8806-07dfdf8a0e32 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:44.412072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d52b7033-0dbf-4056-9dc6-8b8c79cebc66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:44.412931 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d52b7033-0dbf-4056-9dc6-8b8c79cebc66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:44.418993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d52b7033-0dbf-4056-9dc6-8b8c79cebc66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:44.419444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d52b7033-0dbf-4056-9dc6-8b8c79cebc66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:44.420234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d52b7033-0dbf-4056-9dc6-8b8c79cebc66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:44.421255 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d52b7033-0dbf-4056-9dc6-8b8c79cebc66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:44.484637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d52b7033-0dbf-4056-9dc6-8b8c79cebc66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:44.492786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d52b7033-0dbf-4056-9dc6-8b8c79cebc66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:44.494264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d52b7033-0dbf-4056-9dc6-8b8c79cebc66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:44.495393 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d52b7033-0dbf-4056-9dc6-8b8c79cebc66 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088495 Apr 07 13:21:44.495948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 916/1950] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:44 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:21:44.500580 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d66b9d93-4fa1-4389-846c-56e8c9abcb2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:44.501179 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d66b9d93-4fa1-4389-846c-56e8c9abcb2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:44.506901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d66b9d93-4fa1-4389-846c-56e8c9abcb2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:44.507353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d66b9d93-4fa1-4389-846c-56e8c9abcb2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:44.508115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d66b9d93-4fa1-4389-846c-56e8c9abcb2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:44.508573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d66b9d93-4fa1-4389-846c-56e8c9abcb2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:44.513334 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d4af9ee8-f63a-4499-8806-07dfdf8a0e32 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:44.521725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d4af9ee8-f63a-4499-8806-07dfdf8a0e32 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.160513 Apr 07 13:21:44.522314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1035/1951] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:44 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:44.567502 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d66b9d93-4fa1-4389-846c-56e8c9abcb2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:44.575112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d66b9d93-4fa1-4389-846c-56e8c9abcb2f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078216 Apr 07 13:21:44.575676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 917/1952] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:44 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:45.513630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c487597b-c021-4b0d-aac5-bf658721e679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:45.514301 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c487597b-c021-4b0d-aac5-bf658721e679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:45.521063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c487597b-c021-4b0d-aac5-bf658721e679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:45.521514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c487597b-c021-4b0d-aac5-bf658721e679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:45.522269 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c487597b-c021-4b0d-aac5-bf658721e679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:45.522704 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c487597b-c021-4b0d-aac5-bf658721e679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:45.538897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-afdc9ac7-521c-4bff-8576-8c66138bf137 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:45.539616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-afdc9ac7-521c-4bff-8576-8c66138bf137 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:45.546364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-afdc9ac7-521c-4bff-8576-8c66138bf137 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:45.546816 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-afdc9ac7-521c-4bff-8576-8c66138bf137 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:45.547581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-afdc9ac7-521c-4bff-8576-8c66138bf137 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:45.548015 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-afdc9ac7-521c-4bff-8576-8c66138bf137 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:45.583111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c487597b-c021-4b0d-aac5-bf658721e679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:45.592031 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c487597b-c021-4b0d-aac5-bf658721e679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:45.593598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c487597b-c021-4b0d-aac5-bf658721e679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:45.594753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c487597b-c021-4b0d-aac5-bf658721e679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085010 Apr 07 13:21:45.595491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1036/1953] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:45 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:45.599695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-722e76b0-075e-4faf-97da-cf2632579d99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:45.600330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-722e76b0-075e-4faf-97da-cf2632579d99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:45.606200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-722e76b0-075e-4faf-97da-cf2632579d99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:45.606652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-722e76b0-075e-4faf-97da-cf2632579d99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:45.607412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-722e76b0-075e-4faf-97da-cf2632579d99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:45.608246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-722e76b0-075e-4faf-97da-cf2632579d99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:45.669080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-722e76b0-075e-4faf-97da-cf2632579d99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:45.677529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-722e76b0-075e-4faf-97da-cf2632579d99 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081199 Apr 07 13:21:45.678110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1037/1954] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:45 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:45.694894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-afdc9ac7-521c-4bff-8576-8c66138bf137 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:45.703430 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-afdc9ac7-521c-4bff-8576-8c66138bf137 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.168573 Apr 07 13:21:45.703990 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 918/1955] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:45 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:46.613394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2c03825a-e0c3-46a1-8389-fdf4be4911d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:46.613994 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2c03825a-e0c3-46a1-8389-fdf4be4911d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:46.620314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c03825a-e0c3-46a1-8389-fdf4be4911d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:46.620760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c03825a-e0c3-46a1-8389-fdf4be4911d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:46.621502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c03825a-e0c3-46a1-8389-fdf4be4911d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:46.621930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c03825a-e0c3-46a1-8389-fdf4be4911d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:46.681002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2c03825a-e0c3-46a1-8389-fdf4be4911d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:46.690278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2c03825a-e0c3-46a1-8389-fdf4be4911d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:46.691758 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2c03825a-e0c3-46a1-8389-fdf4be4911d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:46.692918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2c03825a-e0c3-46a1-8389-fdf4be4911d5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083385 Apr 07 13:21:46.693452 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1038/1956] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:46 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:46.694715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-23f2e764-7357-4b0a-a19d-5c66d5d85d3b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:46.695333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-23f2e764-7357-4b0a-a19d-5c66d5d85d3b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:46.701859 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-23f2e764-7357-4b0a-a19d-5c66d5d85d3b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:46.702336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-23f2e764-7357-4b0a-a19d-5c66d5d85d3b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:46.703136 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-23f2e764-7357-4b0a-a19d-5c66d5d85d3b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:46.703571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-23f2e764-7357-4b0a-a19d-5c66d5d85d3b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:46.719825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d7ff1182-7318-46d1-95ea-f10ee36159aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:46.720479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d7ff1182-7318-46d1-95ea-f10ee36159aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:46.726438 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7ff1182-7318-46d1-95ea-f10ee36159aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:46.726893 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7ff1182-7318-46d1-95ea-f10ee36159aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:46.727721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7ff1182-7318-46d1-95ea-f10ee36159aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:46.728175 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7ff1182-7318-46d1-95ea-f10ee36159aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:46.765227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-23f2e764-7357-4b0a-a19d-5c66d5d85d3b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:46.773057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-23f2e764-7357-4b0a-a19d-5c66d5d85d3b tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.082124 Apr 07 13:21:46.773628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 919/1957] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:46 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:46.867558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d7ff1182-7318-46d1-95ea-f10ee36159aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:46.875935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d7ff1182-7318-46d1-95ea-f10ee36159aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.160129 Apr 07 13:21:46.876521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1039/1958] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:46 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:47.710780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-77be5c79-a5a7-490b-9dbe-4a0e6e4139a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:47.711399 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-77be5c79-a5a7-490b-9dbe-4a0e6e4139a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:47.717830 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77be5c79-a5a7-490b-9dbe-4a0e6e4139a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:47.718279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77be5c79-a5a7-490b-9dbe-4a0e6e4139a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:47.719045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77be5c79-a5a7-490b-9dbe-4a0e6e4139a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:47.719484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77be5c79-a5a7-490b-9dbe-4a0e6e4139a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:47.781565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-77be5c79-a5a7-490b-9dbe-4a0e6e4139a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:47.790365 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-77be5c79-a5a7-490b-9dbe-4a0e6e4139a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:47.791847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-77be5c79-a5a7-490b-9dbe-4a0e6e4139a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:47.792982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2f31a071-1f8e-47b8-8405-2986b9fd9c09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:47.793432 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-77be5c79-a5a7-490b-9dbe-4a0e6e4139a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086167 Apr 07 13:21:47.793544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 920/1959] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:47 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:47.793879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2f31a071-1f8e-47b8-8405-2986b9fd9c09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:47.800709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f31a071-1f8e-47b8-8405-2986b9fd9c09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:47.801165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f31a071-1f8e-47b8-8405-2986b9fd9c09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:47.801936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f31a071-1f8e-47b8-8405-2986b9fd9c09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:47.802374 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f31a071-1f8e-47b8-8405-2986b9fd9c09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:47.863879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2f31a071-1f8e-47b8-8405-2986b9fd9c09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:47.871646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2f31a071-1f8e-47b8-8405-2986b9fd9c09 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.082417 Apr 07 13:21:47.872238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1040/1960] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:47 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:47.893476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4352957f-28ce-43a6-a124-18d91d5eae57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:47.894095 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4352957f-28ce-43a6-a124-18d91d5eae57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:47.899975 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4352957f-28ce-43a6-a124-18d91d5eae57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:47.900463 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4352957f-28ce-43a6-a124-18d91d5eae57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:47.901230 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4352957f-28ce-43a6-a124-18d91d5eae57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:47.901673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4352957f-28ce-43a6-a124-18d91d5eae57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:48.032223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4352957f-28ce-43a6-a124-18d91d5eae57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:48.040189 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4352957f-28ce-43a6-a124-18d91d5eae57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151124 Apr 07 13:21:48.040757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 921/1961] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:47 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:48.813844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-45c94d60-75e1-4ced-87b1-70853d4e8572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:48.814428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-45c94d60-75e1-4ced-87b1-70853d4e8572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:48.820848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45c94d60-75e1-4ced-87b1-70853d4e8572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:48.821295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45c94d60-75e1-4ced-87b1-70853d4e8572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:48.822042 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45c94d60-75e1-4ced-87b1-70853d4e8572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:48.822473 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-45c94d60-75e1-4ced-87b1-70853d4e8572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:48.881027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-45c94d60-75e1-4ced-87b1-70853d4e8572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:48.889911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-45c94d60-75e1-4ced-87b1-70853d4e8572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:48.890234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-14213c15-c9a3-475d-a00a-4b869c8855d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:48.890885 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-14213c15-c9a3-475d-a00a-4b869c8855d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:48.891401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-45c94d60-75e1-4ced-87b1-70853d4e8572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:48.892598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-45c94d60-75e1-4ced-87b1-70853d4e8572 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084856 Apr 07 13:21:48.893149 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1041/1962] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:48 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:48.897279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14213c15-c9a3-475d-a00a-4b869c8855d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:48.897728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14213c15-c9a3-475d-a00a-4b869c8855d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:48.898492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14213c15-c9a3-475d-a00a-4b869c8855d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:48.898961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14213c15-c9a3-475d-a00a-4b869c8855d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:48.958737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-14213c15-c9a3-475d-a00a-4b869c8855d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:48.966460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-14213c15-c9a3-475d-a00a-4b869c8855d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081426 Apr 07 13:21:48.967020 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 922/1963] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:48 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:49.057796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7b8f07ee-ee55-4c39-b053-111603439837 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:49.058401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7b8f07ee-ee55-4c39-b053-111603439837 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:49.064605 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7b8f07ee-ee55-4c39-b053-111603439837 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:49.065050 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7b8f07ee-ee55-4c39-b053-111603439837 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:49.065798 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7b8f07ee-ee55-4c39-b053-111603439837 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:49.066231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7b8f07ee-ee55-4c39-b053-111603439837 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:49.196836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7b8f07ee-ee55-4c39-b053-111603439837 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:49.205608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7b8f07ee-ee55-4c39-b053-111603439837 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151537 Apr 07 13:21:49.206172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1042/1964] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:49 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:49.910581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-580a46a0-4d05-4967-91f4-6323e9c7ffe9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:49.911193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-580a46a0-4d05-4967-91f4-6323e9c7ffe9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:49.917528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-580a46a0-4d05-4967-91f4-6323e9c7ffe9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:49.917982 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-580a46a0-4d05-4967-91f4-6323e9c7ffe9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:49.918752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-580a46a0-4d05-4967-91f4-6323e9c7ffe9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:49.919186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-580a46a0-4d05-4967-91f4-6323e9c7ffe9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:49.978283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-580a46a0-4d05-4967-91f4-6323e9c7ffe9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:49.984490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c1e28d73-1ac4-49e4-ba91-85c0412fb620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:49.985105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c1e28d73-1ac4-49e4-ba91-85c0412fb620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:49.987455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-580a46a0-4d05-4967-91f4-6323e9c7ffe9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:49.989023 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-580a46a0-4d05-4967-91f4-6323e9c7ffe9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:49.990206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-580a46a0-4d05-4967-91f4-6323e9c7ffe9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083830 Apr 07 13:21:49.990775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 923/1965] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:49 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:49.991219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c1e28d73-1ac4-49e4-ba91-85c0412fb620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:49.991760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c1e28d73-1ac4-49e4-ba91-85c0412fb620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:49.992557 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c1e28d73-1ac4-49e4-ba91-85c0412fb620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:49.992995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c1e28d73-1ac4-49e4-ba91-85c0412fb620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:50.052488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c1e28d73-1ac4-49e4-ba91-85c0412fb620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:50.060016 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c1e28d73-1ac4-49e4-ba91-85c0412fb620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080149 Apr 07 13:21:50.060596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1043/1966] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:49 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:50.223495 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-98ea81d9-73c5-4239-8f74-1626686945c1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:50.224036 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-98ea81d9-73c5-4239-8f74-1626686945c1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:50.230046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-98ea81d9-73c5-4239-8f74-1626686945c1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:50.230506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-98ea81d9-73c5-4239-8f74-1626686945c1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:50.231279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-98ea81d9-73c5-4239-8f74-1626686945c1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:50.231722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-98ea81d9-73c5-4239-8f74-1626686945c1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:50.363673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-98ea81d9-73c5-4239-8f74-1626686945c1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:50.371342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-98ea81d9-73c5-4239-8f74-1626686945c1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151785 Apr 07 13:21:50.371922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 924/1967] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:50 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:51.007569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bbf77ec0-cecd-45fb-b375-e93914ed1553 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:51.008216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bbf77ec0-cecd-45fb-b375-e93914ed1553 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:51.015197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbf77ec0-cecd-45fb-b375-e93914ed1553 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:51.015648 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbf77ec0-cecd-45fb-b375-e93914ed1553 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:51.016437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbf77ec0-cecd-45fb-b375-e93914ed1553 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:51.016878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbf77ec0-cecd-45fb-b375-e93914ed1553 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:51.077246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3995838a-a641-41d6-a0a2-63019fab6c8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:51.077867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3995838a-a641-41d6-a0a2-63019fab6c8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:51.077995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bbf77ec0-cecd-45fb-b375-e93914ed1553 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:51.084380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3995838a-a641-41d6-a0a2-63019fab6c8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:51.084834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3995838a-a641-41d6-a0a2-63019fab6c8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:51.085611 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3995838a-a641-41d6-a0a2-63019fab6c8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:51.086051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3995838a-a641-41d6-a0a2-63019fab6c8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:51.086259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bbf77ec0-cecd-45fb-b375-e93914ed1553 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:51.087753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bbf77ec0-cecd-45fb-b375-e93914ed1553 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:51.088930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bbf77ec0-cecd-45fb-b375-e93914ed1553 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085255 Apr 07 13:21:51.089527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1044/1968] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:51 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:51.145966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3995838a-a641-41d6-a0a2-63019fab6c8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:51.153697 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3995838a-a641-41d6-a0a2-63019fab6c8f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080585 Apr 07 13:21:51.154260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 925/1969] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:51 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:51.388293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-deca66a6-1393-4d1a-a695-2bccdc89d3de tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:51.388958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-deca66a6-1393-4d1a-a695-2bccdc89d3de tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:51.394962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-deca66a6-1393-4d1a-a695-2bccdc89d3de tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:51.395347 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-deca66a6-1393-4d1a-a695-2bccdc89d3de tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:51.396106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-deca66a6-1393-4d1a-a695-2bccdc89d3de tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:51.396579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-deca66a6-1393-4d1a-a695-2bccdc89d3de tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:51.528107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-deca66a6-1393-4d1a-a695-2bccdc89d3de tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:51.536999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-deca66a6-1393-4d1a-a695-2bccdc89d3de tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152554 Apr 07 13:21:51.537567 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1045/1970] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:51 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:52.106799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0499dce2-7f18-4e89-9689-a8005b12e3b4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:52.107465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0499dce2-7f18-4e89-9689-a8005b12e3b4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:52.113837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0499dce2-7f18-4e89-9689-a8005b12e3b4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:52.114291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0499dce2-7f18-4e89-9689-a8005b12e3b4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:52.115064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0499dce2-7f18-4e89-9689-a8005b12e3b4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:52.115549 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0499dce2-7f18-4e89-9689-a8005b12e3b4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:52.170976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5b90b663-0e6a-4f3b-af86-d14b604f1e8a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:52.171599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5b90b663-0e6a-4f3b-af86-d14b604f1e8a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:52.175667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0499dce2-7f18-4e89-9689-a8005b12e3b4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:52.179517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b90b663-0e6a-4f3b-af86-d14b604f1e8a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:52.179974 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b90b663-0e6a-4f3b-af86-d14b604f1e8a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:52.180799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b90b663-0e6a-4f3b-af86-d14b604f1e8a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:52.181224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b90b663-0e6a-4f3b-af86-d14b604f1e8a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:52.184731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0499dce2-7f18-4e89-9689-a8005b12e3b4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:52.186865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0499dce2-7f18-4e89-9689-a8005b12e3b4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:52.187970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0499dce2-7f18-4e89-9689-a8005b12e3b4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085066 Apr 07 13:21:52.188577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 926/1971] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:52 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:52.240623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5b90b663-0e6a-4f3b-af86-d14b604f1e8a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:52.248880 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5b90b663-0e6a-4f3b-af86-d14b604f1e8a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081520 Apr 07 13:21:52.249451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1046/1972] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:52 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:52.554835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-368c8c22-f397-47ab-96eb-57280c0a6491 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:52.555384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-368c8c22-f397-47ab-96eb-57280c0a6491 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:52.562208 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-368c8c22-f397-47ab-96eb-57280c0a6491 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:52.562659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-368c8c22-f397-47ab-96eb-57280c0a6491 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:52.563425 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-368c8c22-f397-47ab-96eb-57280c0a6491 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:52.563863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-368c8c22-f397-47ab-96eb-57280c0a6491 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:52.700238 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-368c8c22-f397-47ab-96eb-57280c0a6491 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:52.707959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-368c8c22-f397-47ab-96eb-57280c0a6491 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157074 Apr 07 13:21:52.708554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 927/1973] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:52 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:53.206126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3b696ab3-3034-440c-a568-a6721619064d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:53.206687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3b696ab3-3034-440c-a568-a6721619064d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:53.212951 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b696ab3-3034-440c-a568-a6721619064d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:53.213401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b696ab3-3034-440c-a568-a6721619064d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:53.214158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b696ab3-3034-440c-a568-a6721619064d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:53.214593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b696ab3-3034-440c-a568-a6721619064d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:53.265961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e6be6277-1c37-404d-8b4f-86a3c9c2943f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:53.266576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e6be6277-1c37-404d-8b4f-86a3c9c2943f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:53.272943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6be6277-1c37-404d-8b4f-86a3c9c2943f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:53.273398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6be6277-1c37-404d-8b4f-86a3c9c2943f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:53.274173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6be6277-1c37-404d-8b4f-86a3c9c2943f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:53.274613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6be6277-1c37-404d-8b4f-86a3c9c2943f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:53.282298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3b696ab3-3034-440c-a568-a6721619064d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:53.290844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3b696ab3-3034-440c-a568-a6721619064d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:53.292366 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3b696ab3-3034-440c-a568-a6721619064d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:53.293503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3b696ab3-3034-440c-a568-a6721619064d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.091338 Apr 07 13:21:53.294061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1047/1974] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:53 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:53.334870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e6be6277-1c37-404d-8b4f-86a3c9c2943f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:53.343353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e6be6277-1c37-404d-8b4f-86a3c9c2943f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081467 Apr 07 13:21:53.343925 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 928/1975] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:53 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:53.724816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-336fffe5-0839-4c68-8851-af47bfefc94b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:53.725420 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-336fffe5-0839-4c68-8851-af47bfefc94b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:53.731288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-336fffe5-0839-4c68-8851-af47bfefc94b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:53.731729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-336fffe5-0839-4c68-8851-af47bfefc94b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:53.732534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-336fffe5-0839-4c68-8851-af47bfefc94b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:53.733516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-336fffe5-0839-4c68-8851-af47bfefc94b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:53.860779 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-336fffe5-0839-4c68-8851-af47bfefc94b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:53.868500 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-336fffe5-0839-4c68-8851-af47bfefc94b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.147492 Apr 07 13:21:53.869063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1048/1976] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:53 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:54.314007 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-842b6e08-df74-4291-95bc-6537cdc0b020 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:54.314570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-842b6e08-df74-4291-95bc-6537cdc0b020 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:54.320941 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-842b6e08-df74-4291-95bc-6537cdc0b020 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:54.321389 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-842b6e08-df74-4291-95bc-6537cdc0b020 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:54.322149 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-842b6e08-df74-4291-95bc-6537cdc0b020 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:54.322581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-842b6e08-df74-4291-95bc-6537cdc0b020 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:54.360827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4a45edfc-cd17-4e19-8b5d-b43d7c016306 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:54.361541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4a45edfc-cd17-4e19-8b5d-b43d7c016306 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:54.367905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a45edfc-cd17-4e19-8b5d-b43d7c016306 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:54.368475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a45edfc-cd17-4e19-8b5d-b43d7c016306 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:54.369340 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a45edfc-cd17-4e19-8b5d-b43d7c016306 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:54.369862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4a45edfc-cd17-4e19-8b5d-b43d7c016306 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:54.382717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-842b6e08-df74-4291-95bc-6537cdc0b020 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:54.391464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-842b6e08-df74-4291-95bc-6537cdc0b020 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:54.393678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-842b6e08-df74-4291-95bc-6537cdc0b020 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:54.395033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-842b6e08-df74-4291-95bc-6537cdc0b020 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086189 Apr 07 13:21:54.395793 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 929/1977] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:54 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:54.430481 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4a45edfc-cd17-4e19-8b5d-b43d7c016306 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:54.438788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4a45edfc-cd17-4e19-8b5d-b43d7c016306 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.082600 Apr 07 13:21:54.439350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1049/1978] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:54 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:54.886135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2f6ef5b6-692f-4902-bead-8852e875d8d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:54.886528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2f6ef5b6-692f-4902-bead-8852e875d8d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:54.897448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f6ef5b6-692f-4902-bead-8852e875d8d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:54.897909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f6ef5b6-692f-4902-bead-8852e875d8d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:54.898882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f6ef5b6-692f-4902-bead-8852e875d8d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:54.899459 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2f6ef5b6-692f-4902-bead-8852e875d8d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:55.036877 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2f6ef5b6-692f-4902-bead-8852e875d8d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:55.044531 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2f6ef5b6-692f-4902-bead-8852e875d8d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.162550 Apr 07 13:21:55.045998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 930/1979] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:54 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:55.414817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e2fb27c2-346f-4057-80f5-d892ac4b209f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:55.415456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e2fb27c2-346f-4057-80f5-d892ac4b209f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:55.423012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e2fb27c2-346f-4057-80f5-d892ac4b209f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:55.423514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e2fb27c2-346f-4057-80f5-d892ac4b209f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:55.424305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e2fb27c2-346f-4057-80f5-d892ac4b209f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:55.424739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e2fb27c2-346f-4057-80f5-d892ac4b209f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:55.455502 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a8981555-b05b-4cef-b11a-14b81fdcaa52 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:55.456129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a8981555-b05b-4cef-b11a-14b81fdcaa52 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:55.462661 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a8981555-b05b-4cef-b11a-14b81fdcaa52 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:55.463106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a8981555-b05b-4cef-b11a-14b81fdcaa52 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:55.463867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a8981555-b05b-4cef-b11a-14b81fdcaa52 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:55.464472 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a8981555-b05b-4cef-b11a-14b81fdcaa52 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:55.484189 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e2fb27c2-346f-4057-80f5-d892ac4b209f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:55.492613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e2fb27c2-346f-4057-80f5-d892ac4b209f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:55.494116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e2fb27c2-346f-4057-80f5-d892ac4b209f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:55.495298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e2fb27c2-346f-4057-80f5-d892ac4b209f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084354 Apr 07 13:21:55.495967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1050/1980] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:55 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:55.526943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a8981555-b05b-4cef-b11a-14b81fdcaa52 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:55.535573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a8981555-b05b-4cef-b11a-14b81fdcaa52 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.083587 Apr 07 13:21:55.536136 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 931/1981] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:55 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:56.062699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a64fb4e6-f286-46f3-b47b-f6a443056a33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:56.063341 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a64fb4e6-f286-46f3-b47b-f6a443056a33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:56.069194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a64fb4e6-f286-46f3-b47b-f6a443056a33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:56.069645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a64fb4e6-f286-46f3-b47b-f6a443056a33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:56.070397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a64fb4e6-f286-46f3-b47b-f6a443056a33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:56.070839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a64fb4e6-f286-46f3-b47b-f6a443056a33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:56.207534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a64fb4e6-f286-46f3-b47b-f6a443056a33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:56.217311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a64fb4e6-f286-46f3-b47b-f6a443056a33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.159011 Apr 07 13:21:56.217887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1051/1982] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:56 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:56.513336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-032ce02d-8ae0-423b-92f9-2fa221011e44 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:56.514065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-032ce02d-8ae0-423b-92f9-2fa221011e44 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:56.520318 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-032ce02d-8ae0-423b-92f9-2fa221011e44 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:56.520774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-032ce02d-8ae0-423b-92f9-2fa221011e44 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:56.521540 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-032ce02d-8ae0-423b-92f9-2fa221011e44 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:56.521982 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-032ce02d-8ae0-423b-92f9-2fa221011e44 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:56.552156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7fff02c2-509a-490c-970a-31bf62074727 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:56.552769 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7fff02c2-509a-490c-970a-31bf62074727 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:56.559004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fff02c2-509a-490c-970a-31bf62074727 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:56.559452 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fff02c2-509a-490c-970a-31bf62074727 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:56.560243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fff02c2-509a-490c-970a-31bf62074727 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:56.561604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fff02c2-509a-490c-970a-31bf62074727 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:56.581650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-032ce02d-8ae0-423b-92f9-2fa221011e44 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:56.590075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-032ce02d-8ae0-423b-92f9-2fa221011e44 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:56.591406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-032ce02d-8ae0-423b-92f9-2fa221011e44 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:56.592830 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-032ce02d-8ae0-423b-92f9-2fa221011e44 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083366 Apr 07 13:21:56.594419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 932/1983] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:56 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:56.621276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7fff02c2-509a-490c-970a-31bf62074727 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:56.629695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7fff02c2-509a-490c-970a-31bf62074727 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081349 Apr 07 13:21:56.630446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1052/1984] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:56 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:57.235447 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4c112f66-fb77-449d-96a4-8c043dbd29f8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:57.235985 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4c112f66-fb77-449d-96a4-8c043dbd29f8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:57.241941 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c112f66-fb77-449d-96a4-8c043dbd29f8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:57.242394 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c112f66-fb77-449d-96a4-8c043dbd29f8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:57.243161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c112f66-fb77-449d-96a4-8c043dbd29f8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:57.243608 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c112f66-fb77-449d-96a4-8c043dbd29f8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:57.375586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4c112f66-fb77-449d-96a4-8c043dbd29f8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:57.383519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4c112f66-fb77-449d-96a4-8c043dbd29f8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152639 Apr 07 13:21:57.384091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 933/1985] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:57 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:57.610809 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-02f381a0-67fb-4d70-9ae4-ac02acdb2d18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:57.611425 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-02f381a0-67fb-4d70-9ae4-ac02acdb2d18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:57.618447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02f381a0-67fb-4d70-9ae4-ac02acdb2d18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:57.618894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02f381a0-67fb-4d70-9ae4-ac02acdb2d18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:57.619653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02f381a0-67fb-4d70-9ae4-ac02acdb2d18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:57.620087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02f381a0-67fb-4d70-9ae4-ac02acdb2d18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:57.646555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7bbe9e01-23f7-4603-8f19-2867aa556aac tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:57.647168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7bbe9e01-23f7-4603-8f19-2867aa556aac tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:57.653486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7bbe9e01-23f7-4603-8f19-2867aa556aac tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:57.653938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7bbe9e01-23f7-4603-8f19-2867aa556aac tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:57.655422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7bbe9e01-23f7-4603-8f19-2867aa556aac tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:57.655837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7bbe9e01-23f7-4603-8f19-2867aa556aac tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:57.678920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-02f381a0-67fb-4d70-9ae4-ac02acdb2d18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:57.687470 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-02f381a0-67fb-4d70-9ae4-ac02acdb2d18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:57.689003 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-02f381a0-67fb-4d70-9ae4-ac02acdb2d18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:57.690136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-02f381a0-67fb-4d70-9ae4-ac02acdb2d18 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083220 Apr 07 13:21:57.690692 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1053/1986] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:57 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:57.716033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7bbe9e01-23f7-4603-8f19-2867aa556aac tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:57.724730 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7bbe9e01-23f7-4603-8f19-2867aa556aac tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081933 Apr 07 13:21:57.725296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 934/1987] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:57 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:58.400290 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-80af6062-d2a3-437b-8e01-ebdc8df10696 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:58.400906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-80af6062-d2a3-437b-8e01-ebdc8df10696 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:58.407362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80af6062-d2a3-437b-8e01-ebdc8df10696 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:58.407812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80af6062-d2a3-437b-8e01-ebdc8df10696 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:58.408593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80af6062-d2a3-437b-8e01-ebdc8df10696 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:58.409029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80af6062-d2a3-437b-8e01-ebdc8df10696 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:58.569194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-80af6062-d2a3-437b-8e01-ebdc8df10696 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:58.577877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-80af6062-d2a3-437b-8e01-ebdc8df10696 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.181371 Apr 07 13:21:58.578442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1054/1988] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:58 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:58.708708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-11b3458d-c8fd-4af8-b32b-94e65fa199cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:58.709247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-11b3458d-c8fd-4af8-b32b-94e65fa199cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:58.715546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11b3458d-c8fd-4af8-b32b-94e65fa199cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:58.715998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11b3458d-c8fd-4af8-b32b-94e65fa199cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:58.717445 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11b3458d-c8fd-4af8-b32b-94e65fa199cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:58.717947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-11b3458d-c8fd-4af8-b32b-94e65fa199cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:58.742272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4c4ccde1-609d-4ab6-b9dd-36010a034794 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:58.742890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4c4ccde1-609d-4ab6-b9dd-36010a034794 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:58.749970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c4ccde1-609d-4ab6-b9dd-36010a034794 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:58.750569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c4ccde1-609d-4ab6-b9dd-36010a034794 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:58.751402 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c4ccde1-609d-4ab6-b9dd-36010a034794 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:58.751903 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4c4ccde1-609d-4ab6-b9dd-36010a034794 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:58.776785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-11b3458d-c8fd-4af8-b32b-94e65fa199cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:58.789410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-11b3458d-c8fd-4af8-b32b-94e65fa199cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:58.790898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-11b3458d-c8fd-4af8-b32b-94e65fa199cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:58.792075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-11b3458d-c8fd-4af8-b32b-94e65fa199cf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087380 Apr 07 13:21:58.792678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 935/1989] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:58 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:58.816641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4c4ccde1-609d-4ab6-b9dd-36010a034794 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:58.827373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4c4ccde1-609d-4ab6-b9dd-36010a034794 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.087622 Apr 07 13:21:58.827946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1055/1990] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:58 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:21:59.594745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6fdf1064-5b1b-41e9-be2a-1a047de650df tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:59.595361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6fdf1064-5b1b-41e9-be2a-1a047de650df tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:59.601369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6fdf1064-5b1b-41e9-be2a-1a047de650df tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:59.601827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6fdf1064-5b1b-41e9-be2a-1a047de650df tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:59.602604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6fdf1064-5b1b-41e9-be2a-1a047de650df tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:59.603046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6fdf1064-5b1b-41e9-be2a-1a047de650df tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:59.735763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6fdf1064-5b1b-41e9-be2a-1a047de650df tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:59.743494 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6fdf1064-5b1b-41e9-be2a-1a047de650df tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152589 Apr 07 13:21:59.744066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 936/1991] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:59 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:21:59.810734 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-38c0f886-21ca-4c04-946a-092b3a28f2f9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:59.811439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-38c0f886-21ca-4c04-946a-092b3a28f2f9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:59.817720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-38c0f886-21ca-4c04-946a-092b3a28f2f9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:59.818184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-38c0f886-21ca-4c04-946a-092b3a28f2f9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:59.818929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-38c0f886-21ca-4c04-946a-092b3a28f2f9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:59.819361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-38c0f886-21ca-4c04-946a-092b3a28f2f9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:59.844562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3062e3d6-15ae-4821-8afc-1a92d7a0bd86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:21:59.845103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3062e3d6-15ae-4821-8afc-1a92d7a0bd86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:21:59.850918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3062e3d6-15ae-4821-8afc-1a92d7a0bd86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:59.851376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3062e3d6-15ae-4821-8afc-1a92d7a0bd86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:59.852168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3062e3d6-15ae-4821-8afc-1a92d7a0bd86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:21:59.852610 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3062e3d6-15ae-4821-8afc-1a92d7a0bd86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:21:59.880033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-38c0f886-21ca-4c04-946a-092b3a28f2f9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:59.890825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-38c0f886-21ca-4c04-946a-092b3a28f2f9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:59.893311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-38c0f886-21ca-4c04-946a-092b3a28f2f9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:59.894484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-38c0f886-21ca-4c04-946a-092b3a28f2f9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087575 Apr 07 13:21:59.895046 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1056/1992] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:21:59 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:21:59.912713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3062e3d6-15ae-4821-8afc-1a92d7a0bd86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:21:59.921573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3062e3d6-15ae-4821-8afc-1a92d7a0bd86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081634 Apr 07 13:21:59.922133 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 937/1993] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:21:59 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:00.760344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ba971063-6503-4b5c-9951-a21dd1ab37ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:00.760878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ba971063-6503-4b5c-9951-a21dd1ab37ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:00.766955 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ba971063-6503-4b5c-9951-a21dd1ab37ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:00.767402 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ba971063-6503-4b5c-9951-a21dd1ab37ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:00.768164 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ba971063-6503-4b5c-9951-a21dd1ab37ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:00.768604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ba971063-6503-4b5c-9951-a21dd1ab37ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:00.900081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ba971063-6503-4b5c-9951-a21dd1ab37ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:00.908457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ba971063-6503-4b5c-9951-a21dd1ab37ca tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151939 Apr 07 13:22:00.909020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1057/1994] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:00 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:00.912483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-46e1aba9-3c84-4f5e-9e95-a84553d5916c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:00.913119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-46e1aba9-3c84-4f5e-9e95-a84553d5916c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:00.919066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-46e1aba9-3c84-4f5e-9e95-a84553d5916c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:00.919521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-46e1aba9-3c84-4f5e-9e95-a84553d5916c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:00.920845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-46e1aba9-3c84-4f5e-9e95-a84553d5916c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:00.921279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-46e1aba9-3c84-4f5e-9e95-a84553d5916c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:00.938877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9959ae91-39bd-4936-b2a9-d787059cdf34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:00.939488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9959ae91-39bd-4936-b2a9-d787059cdf34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:00.945270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9959ae91-39bd-4936-b2a9-d787059cdf34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:00.945716 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9959ae91-39bd-4936-b2a9-d787059cdf34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:00.946475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9959ae91-39bd-4936-b2a9-d787059cdf34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:00.946916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9959ae91-39bd-4936-b2a9-d787059cdf34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:00.981750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-46e1aba9-3c84-4f5e-9e95-a84553d5916c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:00.990827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-46e1aba9-3c84-4f5e-9e95-a84553d5916c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:00.992337 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-46e1aba9-3c84-4f5e-9e95-a84553d5916c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:00.993481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-46e1aba9-3c84-4f5e-9e95-a84553d5916c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085176 Apr 07 13:22:00.994364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 938/1995] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:00 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:01.006267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9959ae91-39bd-4936-b2a9-d787059cdf34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:01.014733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9959ae91-39bd-4936-b2a9-d787059cdf34 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079981 Apr 07 13:22:01.015235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1058/1996] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:00 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:01.925840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c679871b-f05d-427d-a4e8-aad31bdb571e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:01.926455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c679871b-f05d-427d-a4e8-aad31bdb571e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:01.932774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c679871b-f05d-427d-a4e8-aad31bdb571e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:01.933225 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c679871b-f05d-427d-a4e8-aad31bdb571e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:01.933980 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c679871b-f05d-427d-a4e8-aad31bdb571e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:01.934413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c679871b-f05d-427d-a4e8-aad31bdb571e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:02.012781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-566b0736-e15c-4a30-a592-2824a4033856 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:02.014077 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-566b0736-e15c-4a30-a592-2824a4033856 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:02.020797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-566b0736-e15c-4a30-a592-2824a4033856 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:02.021250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-566b0736-e15c-4a30-a592-2824a4033856 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:02.022021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-566b0736-e15c-4a30-a592-2824a4033856 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:02.022458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-566b0736-e15c-4a30-a592-2824a4033856 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:02.067236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c679871b-f05d-427d-a4e8-aad31bdb571e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:02.075009 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c679871b-f05d-427d-a4e8-aad31bdb571e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153132 Apr 07 13:22:02.075751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 939/1997] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:01 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:02.080717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ccbe2f0c-3a65-4d9e-ac38-e92653c0a9df tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:02.081322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ccbe2f0c-3a65-4d9e-ac38-e92653c0a9df tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:02.085139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-566b0736-e15c-4a30-a592-2824a4033856 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:02.087064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ccbe2f0c-3a65-4d9e-ac38-e92653c0a9df tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:02.087510 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ccbe2f0c-3a65-4d9e-ac38-e92653c0a9df tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:02.088308 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ccbe2f0c-3a65-4d9e-ac38-e92653c0a9df tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:02.088742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ccbe2f0c-3a65-4d9e-ac38-e92653c0a9df tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:02.093722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-566b0736-e15c-4a30-a592-2824a4033856 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:02.095200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-566b0736-e15c-4a30-a592-2824a4033856 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:02.096357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-566b0736-e15c-4a30-a592-2824a4033856 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087538 Apr 07 13:22:02.096912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1059/1998] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:02 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:02.154263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ccbe2f0c-3a65-4d9e-ac38-e92653c0a9df tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:02.162459 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ccbe2f0c-3a65-4d9e-ac38-e92653c0a9df tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.085147 Apr 07 13:22:02.163026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 940/1999] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:02 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:03.093486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-90b6f375-4de8-4ed2-8167-86c9ad127b01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:03.094102 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-90b6f375-4de8-4ed2-8167-86c9ad127b01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:03.100440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-90b6f375-4de8-4ed2-8167-86c9ad127b01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:03.100895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-90b6f375-4de8-4ed2-8167-86c9ad127b01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:03.101695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-90b6f375-4de8-4ed2-8167-86c9ad127b01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:03.102137 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-90b6f375-4de8-4ed2-8167-86c9ad127b01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:03.114091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e770266d-4bc3-4db5-8142-275b2d30e7e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:03.114709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e770266d-4bc3-4db5-8142-275b2d30e7e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:03.120909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e770266d-4bc3-4db5-8142-275b2d30e7e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:03.121363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e770266d-4bc3-4db5-8142-275b2d30e7e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:03.122128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e770266d-4bc3-4db5-8142-275b2d30e7e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:03.122568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e770266d-4bc3-4db5-8142-275b2d30e7e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:03.181734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e770266d-4bc3-4db5-8142-275b2d30e7e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:03.190201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e770266d-4bc3-4db5-8142-275b2d30e7e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:03.191701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e770266d-4bc3-4db5-8142-275b2d30e7e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:03.192886 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e770266d-4bc3-4db5-8142-275b2d30e7e5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082700 Apr 07 13:22:03.193452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 941/2000] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:03 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:03.198555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0f7a877e-043c-4140-a373-399086b14b5f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:03.199163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0f7a877e-043c-4140-a373-399086b14b5f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:03.205740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f7a877e-043c-4140-a373-399086b14b5f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:03.206220 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f7a877e-043c-4140-a373-399086b14b5f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:03.206998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f7a877e-043c-4140-a373-399086b14b5f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:03.207437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0f7a877e-043c-4140-a373-399086b14b5f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:03.237585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-90b6f375-4de8-4ed2-8167-86c9ad127b01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:03.245470 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-90b6f375-4de8-4ed2-8167-86c9ad127b01 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156400 Apr 07 13:22:03.246033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1060/2001] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:03 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:03.266819 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0f7a877e-043c-4140-a373-399086b14b5f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:03.274587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0f7a877e-043c-4140-a373-399086b14b5f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080203 Apr 07 13:22:03.275141 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 942/2002] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:03 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:04.210795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b518bf9f-9b6e-4183-b235-59815eeefe9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:04.211379 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b518bf9f-9b6e-4183-b235-59815eeefe9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:04.218301 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b518bf9f-9b6e-4183-b235-59815eeefe9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:04.218740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b518bf9f-9b6e-4183-b235-59815eeefe9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:04.219488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b518bf9f-9b6e-4183-b235-59815eeefe9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:04.219918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b518bf9f-9b6e-4183-b235-59815eeefe9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:04.262327 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e6d493b6-8899-4012-be16-ae22a4946759 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:04.262952 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e6d493b6-8899-4012-be16-ae22a4946759 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:04.269363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6d493b6-8899-4012-be16-ae22a4946759 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:04.269824 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6d493b6-8899-4012-be16-ae22a4946759 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:04.270598 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6d493b6-8899-4012-be16-ae22a4946759 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:04.271034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6d493b6-8899-4012-be16-ae22a4946759 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:04.281133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b518bf9f-9b6e-4183-b235-59815eeefe9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:04.290105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b518bf9f-9b6e-4183-b235-59815eeefe9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:04.291586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b518bf9f-9b6e-4183-b235-59815eeefe9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:04.292747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b518bf9f-9b6e-4183-b235-59815eeefe9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085818 Apr 07 13:22:04.293297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1061/2003] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:04 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:04.298280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ce346e20-fa2d-4e15-a661-bd70ce9c5931 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:04.298885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ce346e20-fa2d-4e15-a661-bd70ce9c5931 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:04.305385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce346e20-fa2d-4e15-a661-bd70ce9c5931 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:04.305841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce346e20-fa2d-4e15-a661-bd70ce9c5931 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:04.306629 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce346e20-fa2d-4e15-a661-bd70ce9c5931 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:04.307062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce346e20-fa2d-4e15-a661-bd70ce9c5931 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:04.366947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ce346e20-fa2d-4e15-a661-bd70ce9c5931 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:04.375277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ce346e20-fa2d-4e15-a661-bd70ce9c5931 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081045 Apr 07 13:22:04.375841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1062/2004] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:04 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:04.404676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e6d493b6-8899-4012-be16-ae22a4946759 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:04.413069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e6d493b6-8899-4012-be16-ae22a4946759 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154666 Apr 07 13:22:04.413648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 943/2005] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:04 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:05.311266 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bd72ccda-1dff-40a1-9b7f-21a523ce3845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:05.311852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bd72ccda-1dff-40a1-9b7f-21a523ce3845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:05.318132 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bd72ccda-1dff-40a1-9b7f-21a523ce3845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:05.318581 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bd72ccda-1dff-40a1-9b7f-21a523ce3845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:05.319336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bd72ccda-1dff-40a1-9b7f-21a523ce3845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:05.319771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bd72ccda-1dff-40a1-9b7f-21a523ce3845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:05.377877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bd72ccda-1dff-40a1-9b7f-21a523ce3845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:05.385977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bd72ccda-1dff-40a1-9b7f-21a523ce3845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:05.387457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bd72ccda-1dff-40a1-9b7f-21a523ce3845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:05.388722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bd72ccda-1dff-40a1-9b7f-21a523ce3845 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081958 Apr 07 13:22:05.389324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1063/2006] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:05 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:05.392578 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1a380c35-bba7-4fc2-a160-4ddcf08baa4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:05.393194 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1a380c35-bba7-4fc2-a160-4ddcf08baa4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:05.399445 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1a380c35-bba7-4fc2-a160-4ddcf08baa4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:05.399897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1a380c35-bba7-4fc2-a160-4ddcf08baa4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:05.400695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1a380c35-bba7-4fc2-a160-4ddcf08baa4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:05.401136 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1a380c35-bba7-4fc2-a160-4ddcf08baa4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:05.430471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c8f3d584-6925-43d2-80fe-0f48733520be tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:05.431197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c8f3d584-6925-43d2-80fe-0f48733520be tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:05.438185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8f3d584-6925-43d2-80fe-0f48733520be tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:05.438710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8f3d584-6925-43d2-80fe-0f48733520be tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:05.439546 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8f3d584-6925-43d2-80fe-0f48733520be tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:05.440052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8f3d584-6925-43d2-80fe-0f48733520be tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:05.463223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1a380c35-bba7-4fc2-a160-4ddcf08baa4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:05.471987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1a380c35-bba7-4fc2-a160-4ddcf08baa4e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.083571 Apr 07 13:22:05.472595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 944/2007] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:05 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:05.572462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c8f3d584-6925-43d2-80fe-0f48733520be tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:05.581323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c8f3d584-6925-43d2-80fe-0f48733520be tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154462 Apr 07 13:22:05.581898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1064/2008] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:05 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:06.407640 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c4238f9f-e866-460c-9705-2ff101a445ae tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:06.408296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c4238f9f-e866-460c-9705-2ff101a445ae tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:06.414751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c4238f9f-e866-460c-9705-2ff101a445ae tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:06.415196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c4238f9f-e866-460c-9705-2ff101a445ae tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:06.415953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c4238f9f-e866-460c-9705-2ff101a445ae tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:06.416408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c4238f9f-e866-460c-9705-2ff101a445ae tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:06.476507 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c4238f9f-e866-460c-9705-2ff101a445ae tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:06.486054 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c4238f9f-e866-460c-9705-2ff101a445ae tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:06.487544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c4238f9f-e866-460c-9705-2ff101a445ae tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:06.488712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c4238f9f-e866-460c-9705-2ff101a445ae tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085974 Apr 07 13:22:06.489250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-93d58e4f-b98b-4a07-a942-3c9fbab8a104 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:06.489685 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 945/2009] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:06 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:06.489869 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-93d58e4f-b98b-4a07-a942-3c9fbab8a104 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:06.496042 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-93d58e4f-b98b-4a07-a942-3c9fbab8a104 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:06.496529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-93d58e4f-b98b-4a07-a942-3c9fbab8a104 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:06.497288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-93d58e4f-b98b-4a07-a942-3c9fbab8a104 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:06.497724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-93d58e4f-b98b-4a07-a942-3c9fbab8a104 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:06.555846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-93d58e4f-b98b-4a07-a942-3c9fbab8a104 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:06.563498 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-93d58e4f-b98b-4a07-a942-3c9fbab8a104 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.077977 Apr 07 13:22:06.564055 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1065/2010] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:06 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:06.598219 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d77a343a-3444-41f8-9d89-f3a5f299be1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:06.598835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d77a343a-3444-41f8-9d89-f3a5f299be1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:06.604744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d77a343a-3444-41f8-9d89-f3a5f299be1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:06.605197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d77a343a-3444-41f8-9d89-f3a5f299be1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:06.605962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d77a343a-3444-41f8-9d89-f3a5f299be1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:06.606400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d77a343a-3444-41f8-9d89-f3a5f299be1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:06.738263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d77a343a-3444-41f8-9d89-f3a5f299be1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:06.745896 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d77a343a-3444-41f8-9d89-f3a5f299be1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151539 Apr 07 13:22:06.746454 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 946/2011] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:06 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:07.507090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9b129cd5-7c29-4a8f-a091-bfe502062ff2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:07.507680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9b129cd5-7c29-4a8f-a091-bfe502062ff2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:07.514971 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9b129cd5-7c29-4a8f-a091-bfe502062ff2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:07.515413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9b129cd5-7c29-4a8f-a091-bfe502062ff2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:07.516178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9b129cd5-7c29-4a8f-a091-bfe502062ff2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:07.516616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9b129cd5-7c29-4a8f-a091-bfe502062ff2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:07.575299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9b129cd5-7c29-4a8f-a091-bfe502062ff2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:07.580185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ca3738e3-242c-4f77-b564-f870bcadd214 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:07.580798 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ca3738e3-242c-4f77-b564-f870bcadd214 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:07.584296 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9b129cd5-7c29-4a8f-a091-bfe502062ff2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:07.585768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9b129cd5-7c29-4a8f-a091-bfe502062ff2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:07.586888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9b129cd5-7c29-4a8f-a091-bfe502062ff2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083638 Apr 07 13:22:07.587436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1066/2012] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:07 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:07.587588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca3738e3-242c-4f77-b564-f870bcadd214 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:07.587979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca3738e3-242c-4f77-b564-f870bcadd214 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:07.588992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca3738e3-242c-4f77-b564-f870bcadd214 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:07.590029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca3738e3-242c-4f77-b564-f870bcadd214 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:07.649927 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ca3738e3-242c-4f77-b564-f870bcadd214 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:07.657823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ca3738e3-242c-4f77-b564-f870bcadd214 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081599 Apr 07 13:22:07.658418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 947/2013] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:07 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:07.762755 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7d76e017-c7ca-41ea-81e6-dd76bac26c28 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:07.763361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7d76e017-c7ca-41ea-81e6-dd76bac26c28 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:07.769179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7d76e017-c7ca-41ea-81e6-dd76bac26c28 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:07.769622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7d76e017-c7ca-41ea-81e6-dd76bac26c28 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:07.770366 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7d76e017-c7ca-41ea-81e6-dd76bac26c28 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:07.770791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7d76e017-c7ca-41ea-81e6-dd76bac26c28 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:07.905101 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7d76e017-c7ca-41ea-81e6-dd76bac26c28 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:07.912951 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7d76e017-c7ca-41ea-81e6-dd76bac26c28 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154098 Apr 07 13:22:07.913501 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1067/2014] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:07 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:08.604134 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-92dd81b7-2b97-48d7-a936-6ba46e363152 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:08.604776 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-92dd81b7-2b97-48d7-a936-6ba46e363152 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:08.611339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-92dd81b7-2b97-48d7-a936-6ba46e363152 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:08.611794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-92dd81b7-2b97-48d7-a936-6ba46e363152 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:08.612599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-92dd81b7-2b97-48d7-a936-6ba46e363152 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:08.613468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-92dd81b7-2b97-48d7-a936-6ba46e363152 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:08.675269 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2df60ca5-70d2-4607-a06a-772c3e81b553 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:08.675702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-92dd81b7-2b97-48d7-a936-6ba46e363152 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:08.675918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2df60ca5-70d2-4607-a06a-772c3e81b553 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:08.682262 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2df60ca5-70d2-4607-a06a-772c3e81b553 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:08.682716 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2df60ca5-70d2-4607-a06a-772c3e81b553 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:08.683477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2df60ca5-70d2-4607-a06a-772c3e81b553 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:08.683918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2df60ca5-70d2-4607-a06a-772c3e81b553 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:08.684084 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-92dd81b7-2b97-48d7-a936-6ba46e363152 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:08.686165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-92dd81b7-2b97-48d7-a936-6ba46e363152 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:08.687317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-92dd81b7-2b97-48d7-a936-6ba46e363152 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087105 Apr 07 13:22:08.687893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 948/2015] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:08 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:08.742285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2df60ca5-70d2-4607-a06a-772c3e81b553 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:08.750583 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2df60ca5-70d2-4607-a06a-772c3e81b553 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079208 Apr 07 13:22:08.751143 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1068/2016] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:08 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:08.930170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0ba9a78b-ee59-4d7e-a8ad-b748576631fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:08.930789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0ba9a78b-ee59-4d7e-a8ad-b748576631fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:08.937391 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ba9a78b-ee59-4d7e-a8ad-b748576631fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:08.937833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ba9a78b-ee59-4d7e-a8ad-b748576631fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:08.938599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ba9a78b-ee59-4d7e-a8ad-b748576631fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:08.939031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ba9a78b-ee59-4d7e-a8ad-b748576631fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:09.068521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0ba9a78b-ee59-4d7e-a8ad-b748576631fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:09.076325 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0ba9a78b-ee59-4d7e-a8ad-b748576631fd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150045 Apr 07 13:22:09.076894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 949/2017] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:08 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:09.705057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6c8871e5-715d-4bc6-bc5a-1faf3c2b1af4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:09.705672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6c8871e5-715d-4bc6-bc5a-1faf3c2b1af4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:09.711895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c8871e5-715d-4bc6-bc5a-1faf3c2b1af4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:09.712602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c8871e5-715d-4bc6-bc5a-1faf3c2b1af4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:09.713363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c8871e5-715d-4bc6-bc5a-1faf3c2b1af4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:09.713800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c8871e5-715d-4bc6-bc5a-1faf3c2b1af4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:09.769360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9843a4ea-ca3f-4a6f-bd25-3af83a0cebd1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:09.770384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9843a4ea-ca3f-4a6f-bd25-3af83a0cebd1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:09.773889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6c8871e5-715d-4bc6-bc5a-1faf3c2b1af4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:09.780936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9843a4ea-ca3f-4a6f-bd25-3af83a0cebd1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:09.781665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9843a4ea-ca3f-4a6f-bd25-3af83a0cebd1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:09.782934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9843a4ea-ca3f-4a6f-bd25-3af83a0cebd1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:09.783678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9843a4ea-ca3f-4a6f-bd25-3af83a0cebd1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:09.788331 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6c8871e5-715d-4bc6-bc5a-1faf3c2b1af4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:09.790564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6c8871e5-715d-4bc6-bc5a-1faf3c2b1af4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:09.792283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6c8871e5-715d-4bc6-bc5a-1faf3c2b1af4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.090767 Apr 07 13:22:09.793195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1069/2018] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:09 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:09.857505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9843a4ea-ca3f-4a6f-bd25-3af83a0cebd1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:09.865489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9843a4ea-ca3f-4a6f-bd25-3af83a0cebd1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.100478 Apr 07 13:22:09.866056 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 950/2019] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:09 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:10.094060 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-62e65123-9baa-4921-ae7c-2aa0a96a930d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:10.094668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-62e65123-9baa-4921-ae7c-2aa0a96a930d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:10.100563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62e65123-9baa-4921-ae7c-2aa0a96a930d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:10.101013 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62e65123-9baa-4921-ae7c-2aa0a96a930d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:10.101764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62e65123-9baa-4921-ae7c-2aa0a96a930d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:10.102192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-62e65123-9baa-4921-ae7c-2aa0a96a930d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:10.243853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-62e65123-9baa-4921-ae7c-2aa0a96a930d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:10.252472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-62e65123-9baa-4921-ae7c-2aa0a96a930d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.162957 Apr 07 13:22:10.253033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1070/2020] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:10 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:10.819910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4565c877-5f9e-45ce-bf2d-2f8740c63b85 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:10.820552 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4565c877-5f9e-45ce-bf2d-2f8740c63b85 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:10.827338 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4565c877-5f9e-45ce-bf2d-2f8740c63b85 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:10.827790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4565c877-5f9e-45ce-bf2d-2f8740c63b85 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:10.828590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4565c877-5f9e-45ce-bf2d-2f8740c63b85 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:10.829031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4565c877-5f9e-45ce-bf2d-2f8740c63b85 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:10.882442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6c63558f-5db1-4f5a-98a9-0c37713c6093 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:10.883100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6c63558f-5db1-4f5a-98a9-0c37713c6093 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:10.889034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4565c877-5f9e-45ce-bf2d-2f8740c63b85 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:10.889955 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c63558f-5db1-4f5a-98a9-0c37713c6093 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:10.890477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c63558f-5db1-4f5a-98a9-0c37713c6093 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:10.891343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c63558f-5db1-4f5a-98a9-0c37713c6093 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:10.892502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c63558f-5db1-4f5a-98a9-0c37713c6093 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:10.897581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4565c877-5f9e-45ce-bf2d-2f8740c63b85 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:10.899078 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4565c877-5f9e-45ce-bf2d-2f8740c63b85 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:10.900348 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4565c877-5f9e-45ce-bf2d-2f8740c63b85 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084242 Apr 07 13:22:10.900914 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 951/2021] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:10 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:10.953385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6c63558f-5db1-4f5a-98a9-0c37713c6093 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:10.961017 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6c63558f-5db1-4f5a-98a9-0c37713c6093 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.082551 Apr 07 13:22:10.961572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1071/2022] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:10 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:11.270218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-656b7dd4-222d-4e57-ad8e-b5bd60f33344 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:11.270756 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-656b7dd4-222d-4e57-ad8e-b5bd60f33344 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:11.276671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-656b7dd4-222d-4e57-ad8e-b5bd60f33344 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:11.277127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-656b7dd4-222d-4e57-ad8e-b5bd60f33344 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:11.277894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-656b7dd4-222d-4e57-ad8e-b5bd60f33344 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:11.278357 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-656b7dd4-222d-4e57-ad8e-b5bd60f33344 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:11.411074 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-656b7dd4-222d-4e57-ad8e-b5bd60f33344 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:11.418831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-656b7dd4-222d-4e57-ad8e-b5bd60f33344 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152578 Apr 07 13:22:11.419958 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 952/2023] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:11 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:11.918967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a1d46fd0-0acc-4078-bf67-671180fb918b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:11.920676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a1d46fd0-0acc-4078-bf67-671180fb918b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:11.926946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a1d46fd0-0acc-4078-bf67-671180fb918b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:11.927387 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a1d46fd0-0acc-4078-bf67-671180fb918b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:11.928135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a1d46fd0-0acc-4078-bf67-671180fb918b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:11.928589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a1d46fd0-0acc-4078-bf67-671180fb918b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:11.978270 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6d52a5ab-beb1-4e46-bce3-a54a2dcb904f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:11.978880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6d52a5ab-beb1-4e46-bce3-a54a2dcb904f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:11.986134 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6d52a5ab-beb1-4e46-bce3-a54a2dcb904f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:11.986586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6d52a5ab-beb1-4e46-bce3-a54a2dcb904f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:11.987351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6d52a5ab-beb1-4e46-bce3-a54a2dcb904f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:11.987786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6d52a5ab-beb1-4e46-bce3-a54a2dcb904f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:11.988091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a1d46fd0-0acc-4078-bf67-671180fb918b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:11.996311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a1d46fd0-0acc-4078-bf67-671180fb918b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:11.997784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a1d46fd0-0acc-4078-bf67-671180fb918b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:11.998920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a1d46fd0-0acc-4078-bf67-671180fb918b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083795 Apr 07 13:22:11.999462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1072/2024] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:11 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:12.047031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6d52a5ab-beb1-4e46-bce3-a54a2dcb904f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:12.054808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6d52a5ab-beb1-4e46-bce3-a54a2dcb904f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080391 Apr 07 13:22:12.055368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 953/2025] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:11 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:12.437363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6e4fcc1b-464c-48eb-92eb-975fb1073551 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:12.437970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6e4fcc1b-464c-48eb-92eb-975fb1073551 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:12.443896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e4fcc1b-464c-48eb-92eb-975fb1073551 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:12.444382 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e4fcc1b-464c-48eb-92eb-975fb1073551 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:12.445126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e4fcc1b-464c-48eb-92eb-975fb1073551 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:12.445556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e4fcc1b-464c-48eb-92eb-975fb1073551 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:12.575335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6e4fcc1b-464c-48eb-92eb-975fb1073551 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:12.584043 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6e4fcc1b-464c-48eb-92eb-975fb1073551 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150970 Apr 07 13:22:12.584642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1073/2026] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:12 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:13.017014 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9cc9dff1-035c-44d3-89ff-5a9d2642ef35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:13.017626 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9cc9dff1-035c-44d3-89ff-5a9d2642ef35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:13.023956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9cc9dff1-035c-44d3-89ff-5a9d2642ef35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:13.024451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9cc9dff1-035c-44d3-89ff-5a9d2642ef35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:13.025212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9cc9dff1-035c-44d3-89ff-5a9d2642ef35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:13.025648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9cc9dff1-035c-44d3-89ff-5a9d2642ef35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:13.071760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bfe0cf5d-3d79-432a-b2a6-a49b5f341b21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:13.072399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bfe0cf5d-3d79-432a-b2a6-a49b5f341b21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:13.078637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bfe0cf5d-3d79-432a-b2a6-a49b5f341b21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:13.079087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bfe0cf5d-3d79-432a-b2a6-a49b5f341b21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:13.079844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bfe0cf5d-3d79-432a-b2a6-a49b5f341b21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:13.080309 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bfe0cf5d-3d79-432a-b2a6-a49b5f341b21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:13.085441 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9cc9dff1-035c-44d3-89ff-5a9d2642ef35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:13.094187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9cc9dff1-035c-44d3-89ff-5a9d2642ef35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:13.095777 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9cc9dff1-035c-44d3-89ff-5a9d2642ef35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:13.096991 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9cc9dff1-035c-44d3-89ff-5a9d2642ef35 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083818 Apr 07 13:22:13.097559 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 954/2027] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:13 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:13.138270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bfe0cf5d-3d79-432a-b2a6-a49b5f341b21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:13.145985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bfe0cf5d-3d79-432a-b2a6-a49b5f341b21 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078019 Apr 07 13:22:13.146480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1074/2028] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:13 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:13.600447 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0db8ffc5-65a3-4e79-9f3a-0448deca36f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:13.601057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0db8ffc5-65a3-4e79-9f3a-0448deca36f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:13.607416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0db8ffc5-65a3-4e79-9f3a-0448deca36f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:13.607872 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0db8ffc5-65a3-4e79-9f3a-0448deca36f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:13.608676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0db8ffc5-65a3-4e79-9f3a-0448deca36f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:13.609136 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0db8ffc5-65a3-4e79-9f3a-0448deca36f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:13.741551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0db8ffc5-65a3-4e79-9f3a-0448deca36f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:13.749580 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0db8ffc5-65a3-4e79-9f3a-0448deca36f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152940 Apr 07 13:22:13.750149 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 955/2029] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:13 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:14.115975 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-39e8a084-607d-4ffc-9a49-35d93ca0c9f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:14.116614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-39e8a084-607d-4ffc-9a49-35d93ca0c9f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:14.123595 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39e8a084-607d-4ffc-9a49-35d93ca0c9f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:14.125098 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39e8a084-607d-4ffc-9a49-35d93ca0c9f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:14.125865 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39e8a084-607d-4ffc-9a49-35d93ca0c9f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:14.126305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39e8a084-607d-4ffc-9a49-35d93ca0c9f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:14.163287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-614244fc-c770-43f8-a7d3-c7d79b2a1cdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:14.163925 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-614244fc-c770-43f8-a7d3-c7d79b2a1cdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:14.174803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-614244fc-c770-43f8-a7d3-c7d79b2a1cdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:14.175258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-614244fc-c770-43f8-a7d3-c7d79b2a1cdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:14.177998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-614244fc-c770-43f8-a7d3-c7d79b2a1cdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:14.178451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-614244fc-c770-43f8-a7d3-c7d79b2a1cdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:14.195817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-39e8a084-607d-4ffc-9a49-35d93ca0c9f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:14.205352 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-39e8a084-607d-4ffc-9a49-35d93ca0c9f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:14.206846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-39e8a084-607d-4ffc-9a49-35d93ca0c9f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:14.207987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-39e8a084-607d-4ffc-9a49-35d93ca0c9f2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.095916 Apr 07 13:22:14.208573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1075/2030] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:14 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:14.238383 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-614244fc-c770-43f8-a7d3-c7d79b2a1cdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:14.246128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-614244fc-c770-43f8-a7d3-c7d79b2a1cdd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.086967 Apr 07 13:22:14.246688 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 956/2031] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:14 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:14.766471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8cc2d107-01d8-41ff-bded-738589ca8e26 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:14.767118 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8cc2d107-01d8-41ff-bded-738589ca8e26 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:14.773062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8cc2d107-01d8-41ff-bded-738589ca8e26 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:14.773520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8cc2d107-01d8-41ff-bded-738589ca8e26 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:14.774281 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8cc2d107-01d8-41ff-bded-738589ca8e26 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:14.774721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8cc2d107-01d8-41ff-bded-738589ca8e26 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:14.916699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8cc2d107-01d8-41ff-bded-738589ca8e26 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:14.926761 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8cc2d107-01d8-41ff-bded-738589ca8e26 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.164070 Apr 07 13:22:14.927330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1076/2032] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:14 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:15.227656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-024e9cbe-26c3-4592-be6f-4c11112bfb75 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:15.228283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-024e9cbe-26c3-4592-be6f-4c11112bfb75 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:15.235072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-024e9cbe-26c3-4592-be6f-4c11112bfb75 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:15.235521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-024e9cbe-26c3-4592-be6f-4c11112bfb75 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:15.236511 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-024e9cbe-26c3-4592-be6f-4c11112bfb75 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:15.238166 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-024e9cbe-26c3-4592-be6f-4c11112bfb75 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:15.265475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c9c12d12-2b4d-4c53-8a59-cf8ab4c5f33e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:15.266121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c9c12d12-2b4d-4c53-8a59-cf8ab4c5f33e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:15.273783 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9c12d12-2b4d-4c53-8a59-cf8ab4c5f33e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:15.274232 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9c12d12-2b4d-4c53-8a59-cf8ab4c5f33e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:15.275001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9c12d12-2b4d-4c53-8a59-cf8ab4c5f33e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:15.275438 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9c12d12-2b4d-4c53-8a59-cf8ab4c5f33e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:15.307949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-024e9cbe-26c3-4592-be6f-4c11112bfb75 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:15.316930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-024e9cbe-26c3-4592-be6f-4c11112bfb75 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:15.318427 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-024e9cbe-26c3-4592-be6f-4c11112bfb75 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:15.319597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-024e9cbe-26c3-4592-be6f-4c11112bfb75 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.096765 Apr 07 13:22:15.320193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 957/2033] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:15 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:15.343752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c9c12d12-2b4d-4c53-8a59-cf8ab4c5f33e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:15.353657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c9c12d12-2b4d-4c53-8a59-cf8ab4c5f33e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.092631 Apr 07 13:22:15.354236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1077/2034] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:15 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:15.944356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-72096446-f2cf-4a17-b945-8903e8cbc0d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:15.944973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-72096446-f2cf-4a17-b945-8903e8cbc0d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:15.950808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-72096446-f2cf-4a17-b945-8903e8cbc0d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:15.951265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-72096446-f2cf-4a17-b945-8903e8cbc0d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:15.952037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-72096446-f2cf-4a17-b945-8903e8cbc0d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:15.952500 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-72096446-f2cf-4a17-b945-8903e8cbc0d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:16.095451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-72096446-f2cf-4a17-b945-8903e8cbc0d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:16.103385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-72096446-f2cf-4a17-b945-8903e8cbc0d4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.162843 Apr 07 13:22:16.104041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 958/2035] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:15 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:16.340914 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9eb1ebd4-f566-48ed-933f-147a4838b310 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:16.342116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9eb1ebd4-f566-48ed-933f-147a4838b310 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:16.348332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9eb1ebd4-f566-48ed-933f-147a4838b310 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:16.348782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9eb1ebd4-f566-48ed-933f-147a4838b310 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:16.349537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9eb1ebd4-f566-48ed-933f-147a4838b310 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:16.349976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9eb1ebd4-f566-48ed-933f-147a4838b310 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:16.370539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b8a2dde3-da19-4930-b940-c3119fc02674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:16.371158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b8a2dde3-da19-4930-b940-c3119fc02674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:16.377399 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b8a2dde3-da19-4930-b940-c3119fc02674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:16.377853 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b8a2dde3-da19-4930-b940-c3119fc02674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:16.378627 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b8a2dde3-da19-4930-b940-c3119fc02674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:16.380102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b8a2dde3-da19-4930-b940-c3119fc02674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:16.411327 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9eb1ebd4-f566-48ed-933f-147a4838b310 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:16.420815 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9eb1ebd4-f566-48ed-933f-147a4838b310 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:16.422330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9eb1ebd4-f566-48ed-933f-147a4838b310 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:16.423479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9eb1ebd4-f566-48ed-933f-147a4838b310 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086444 Apr 07 13:22:16.424041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1078/2036] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:16 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:16.440741 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b8a2dde3-da19-4930-b940-c3119fc02674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:16.448373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b8a2dde3-da19-4930-b940-c3119fc02674 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081703 Apr 07 13:22:16.448927 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 959/2037] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:16 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:17.121085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b561e528-886c-4aed-be0a-0702a48698d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:17.121698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b561e528-886c-4aed-be0a-0702a48698d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:17.128541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b561e528-886c-4aed-be0a-0702a48698d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:17.128999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b561e528-886c-4aed-be0a-0702a48698d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:17.129765 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b561e528-886c-4aed-be0a-0702a48698d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:17.130205 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b561e528-886c-4aed-be0a-0702a48698d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:17.258576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b561e528-886c-4aed-be0a-0702a48698d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:17.266456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b561e528-886c-4aed-be0a-0702a48698d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149131 Apr 07 13:22:17.267028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1079/2038] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:17 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:17.441797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f4755f01-5474-42cb-bb5b-c993359a5451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:17.442411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f4755f01-5474-42cb-bb5b-c993359a5451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:17.448694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f4755f01-5474-42cb-bb5b-c993359a5451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:17.449151 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f4755f01-5474-42cb-bb5b-c993359a5451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:17.449913 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f4755f01-5474-42cb-bb5b-c993359a5451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:17.451056 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f4755f01-5474-42cb-bb5b-c993359a5451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:17.464848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-95af8a6a-cd36-43cf-a5bb-325dd8282c93 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:17.465483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-95af8a6a-cd36-43cf-a5bb-325dd8282c93 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:17.472315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-95af8a6a-cd36-43cf-a5bb-325dd8282c93 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:17.472766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-95af8a6a-cd36-43cf-a5bb-325dd8282c93 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:17.473514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-95af8a6a-cd36-43cf-a5bb-325dd8282c93 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:17.473944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-95af8a6a-cd36-43cf-a5bb-325dd8282c93 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:17.510374 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f4755f01-5474-42cb-bb5b-c993359a5451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:17.520942 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f4755f01-5474-42cb-bb5b-c993359a5451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:17.522962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f4755f01-5474-42cb-bb5b-c993359a5451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:17.525622 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f4755f01-5474-42cb-bb5b-c993359a5451 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087739 Apr 07 13:22:17.526186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 960/2039] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:17 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:17.545670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-95af8a6a-cd36-43cf-a5bb-325dd8282c93 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:17.553610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-95af8a6a-cd36-43cf-a5bb-325dd8282c93 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.092582 Apr 07 13:22:17.554175 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1080/2040] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:17 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:18.283532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b0d0574f-e3fd-4b9d-915f-4ba24193592e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:18.284058 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b0d0574f-e3fd-4b9d-915f-4ba24193592e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:18.290354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0d0574f-e3fd-4b9d-915f-4ba24193592e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:18.290811 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0d0574f-e3fd-4b9d-915f-4ba24193592e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:18.291579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0d0574f-e3fd-4b9d-915f-4ba24193592e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:18.292021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0d0574f-e3fd-4b9d-915f-4ba24193592e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:18.426784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b0d0574f-e3fd-4b9d-915f-4ba24193592e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:18.434490 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b0d0574f-e3fd-4b9d-915f-4ba24193592e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154893 Apr 07 13:22:18.435125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 961/2041] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:18 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:18.545729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b0c18978-c4b5-4719-ac95-e263a56a4b38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:18.546293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b0c18978-c4b5-4719-ac95-e263a56a4b38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:18.552545 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b0c18978-c4b5-4719-ac95-e263a56a4b38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:18.552989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b0c18978-c4b5-4719-ac95-e263a56a4b38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:18.553733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b0c18978-c4b5-4719-ac95-e263a56a4b38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:18.554158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b0c18978-c4b5-4719-ac95-e263a56a4b38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:18.569848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-be6fbf08-73b1-438a-8263-1cca37b1a27a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:18.570466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-be6fbf08-73b1-438a-8263-1cca37b1a27a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:18.576894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-be6fbf08-73b1-438a-8263-1cca37b1a27a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:18.577352 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-be6fbf08-73b1-438a-8263-1cca37b1a27a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:18.578165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-be6fbf08-73b1-438a-8263-1cca37b1a27a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:18.578613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-be6fbf08-73b1-438a-8263-1cca37b1a27a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:18.614155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b0c18978-c4b5-4719-ac95-e263a56a4b38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:18.622513 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b0c18978-c4b5-4719-ac95-e263a56a4b38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:18.624570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b0c18978-c4b5-4719-ac95-e263a56a4b38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:18.625706 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b0c18978-c4b5-4719-ac95-e263a56a4b38 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085044 Apr 07 13:22:18.626258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1081/2042] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:18 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:18.639233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-be6fbf08-73b1-438a-8263-1cca37b1a27a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:18.647026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-be6fbf08-73b1-438a-8263-1cca37b1a27a tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080981 Apr 07 13:22:18.647577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 962/2043] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:18 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:19.451328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4cde6688-5197-48d2-9817-649f9ef59711 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:19.451970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4cde6688-5197-48d2-9817-649f9ef59711 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:19.457874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4cde6688-5197-48d2-9817-649f9ef59711 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:19.458320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4cde6688-5197-48d2-9817-649f9ef59711 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:19.459070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4cde6688-5197-48d2-9817-649f9ef59711 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:19.459504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4cde6688-5197-48d2-9817-649f9ef59711 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:19.588923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4cde6688-5197-48d2-9817-649f9ef59711 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:19.596912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4cde6688-5197-48d2-9817-649f9ef59711 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150032 Apr 07 13:22:19.597485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1082/2044] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:19 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:19.643899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8e9edc72-347e-45c7-8423-001907f1765a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:19.644541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8e9edc72-347e-45c7-8423-001907f1765a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:19.650781 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8e9edc72-347e-45c7-8423-001907f1765a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:19.651236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8e9edc72-347e-45c7-8423-001907f1765a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:19.652033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8e9edc72-347e-45c7-8423-001907f1765a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:19.652498 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8e9edc72-347e-45c7-8423-001907f1765a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:19.665177 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c1daf0c7-c0f4-4188-bfc2-9506ca06f1b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:19.665800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c1daf0c7-c0f4-4188-bfc2-9506ca06f1b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:19.671995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c1daf0c7-c0f4-4188-bfc2-9506ca06f1b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:19.672485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c1daf0c7-c0f4-4188-bfc2-9506ca06f1b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:19.673247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c1daf0c7-c0f4-4188-bfc2-9506ca06f1b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:19.673687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c1daf0c7-c0f4-4188-bfc2-9506ca06f1b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:19.712262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8e9edc72-347e-45c7-8423-001907f1765a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:19.720710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8e9edc72-347e-45c7-8423-001907f1765a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:19.722558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8e9edc72-347e-45c7-8423-001907f1765a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:19.723788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8e9edc72-347e-45c7-8423-001907f1765a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083735 Apr 07 13:22:19.724601 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 963/2045] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:19 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:19.733492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c1daf0c7-c0f4-4188-bfc2-9506ca06f1b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:19.741278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c1daf0c7-c0f4-4188-bfc2-9506ca06f1b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080056 Apr 07 13:22:19.741836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1083/2046] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:19 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:20.613990 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-511e0c9a-5e95-4c63-970e-cb3f855bd76f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:20.614608 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-511e0c9a-5e95-4c63-970e-cb3f855bd76f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:20.620456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-511e0c9a-5e95-4c63-970e-cb3f855bd76f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:20.620903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-511e0c9a-5e95-4c63-970e-cb3f855bd76f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:20.621657 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-511e0c9a-5e95-4c63-970e-cb3f855bd76f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:20.623248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-511e0c9a-5e95-4c63-970e-cb3f855bd76f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:20.741906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-65e88762-83b5-4c0f-b0a2-4066bdb0960f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:20.742440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-65e88762-83b5-4c0f-b0a2-4066bdb0960f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:20.749614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65e88762-83b5-4c0f-b0a2-4066bdb0960f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:20.750069 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65e88762-83b5-4c0f-b0a2-4066bdb0960f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:20.750838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65e88762-83b5-4c0f-b0a2-4066bdb0960f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:20.751271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65e88762-83b5-4c0f-b0a2-4066bdb0960f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:20.757118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-511e0c9a-5e95-4c63-970e-cb3f855bd76f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:20.764988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-511e0c9a-5e95-4c63-970e-cb3f855bd76f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154804 Apr 07 13:22:20.765560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 964/2047] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:20 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:20.769982 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9dd17ee1-cb1b-4134-a013-6f5fe6afb3d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:20.770587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9dd17ee1-cb1b-4134-a013-6f5fe6afb3d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:20.776118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9dd17ee1-cb1b-4134-a013-6f5fe6afb3d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:20.776650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9dd17ee1-cb1b-4134-a013-6f5fe6afb3d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:20.777423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9dd17ee1-cb1b-4134-a013-6f5fe6afb3d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:20.777861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9dd17ee1-cb1b-4134-a013-6f5fe6afb3d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:20.814743 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-65e88762-83b5-4c0f-b0a2-4066bdb0960f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:20.823361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-65e88762-83b5-4c0f-b0a2-4066bdb0960f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:20.824888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-65e88762-83b5-4c0f-b0a2-4066bdb0960f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:20.826147 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-65e88762-83b5-4c0f-b0a2-4066bdb0960f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088161 Apr 07 13:22:20.826760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1084/2048] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:20 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:20.837756 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9dd17ee1-cb1b-4134-a013-6f5fe6afb3d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:20.847009 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9dd17ee1-cb1b-4134-a013-6f5fe6afb3d7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080395 Apr 07 13:22:20.847769 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 965/2049] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:20 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:21.782342 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5baf1e9d-392b-47c3-86f1-d2252572799d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:21.782958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5baf1e9d-392b-47c3-86f1-d2252572799d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:21.789490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5baf1e9d-392b-47c3-86f1-d2252572799d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:21.789943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5baf1e9d-392b-47c3-86f1-d2252572799d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:21.790701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5baf1e9d-392b-47c3-86f1-d2252572799d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:21.791291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5baf1e9d-392b-47c3-86f1-d2252572799d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:21.844910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a0c9fb34-30b5-4365-b479-7bba6de58db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:21.845568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a0c9fb34-30b5-4365-b479-7bba6de58db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:21.852263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0c9fb34-30b5-4365-b479-7bba6de58db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:21.852719 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0c9fb34-30b5-4365-b479-7bba6de58db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:21.853501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0c9fb34-30b5-4365-b479-7bba6de58db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:21.853946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0c9fb34-30b5-4365-b479-7bba6de58db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:21.924300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5baf1e9d-392b-47c3-86f1-d2252572799d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:21.933650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5baf1e9d-392b-47c3-86f1-d2252572799d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155575 Apr 07 13:22:21.934224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1085/2050] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:21 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:21.938775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b8b7cf19-639d-4c82-ab65-222ba77c06ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:21.939374 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b8b7cf19-639d-4c82-ab65-222ba77c06ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:21.945104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b8b7cf19-639d-4c82-ab65-222ba77c06ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:21.945550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b8b7cf19-639d-4c82-ab65-222ba77c06ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:21.946299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b8b7cf19-639d-4c82-ab65-222ba77c06ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:21.946728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b8b7cf19-639d-4c82-ab65-222ba77c06ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:21.981762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a0c9fb34-30b5-4365-b479-7bba6de58db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:21.990547 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a0c9fb34-30b5-4365-b479-7bba6de58db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:21.992059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a0c9fb34-30b5-4365-b479-7bba6de58db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:21.993388 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a0c9fb34-30b5-4365-b479-7bba6de58db3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.153134 Apr 07 13:22:21.993953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 966/2051] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:21 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:22.005802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b8b7cf19-639d-4c82-ab65-222ba77c06ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:22.014315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b8b7cf19-639d-4c82-ab65-222ba77c06ce tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079067 Apr 07 13:22:22.014875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1086/2052] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:21 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:22.950656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5d2fb64d-a009-4fc5-b745-c8f83958ed60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:22.951308 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5d2fb64d-a009-4fc5-b745-c8f83958ed60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:22.957632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d2fb64d-a009-4fc5-b745-c8f83958ed60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:22.958086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d2fb64d-a009-4fc5-b745-c8f83958ed60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:22.958848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d2fb64d-a009-4fc5-b745-c8f83958ed60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:22.959283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d2fb64d-a009-4fc5-b745-c8f83958ed60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:23.011794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-63831eb3-e5ab-43ea-af70-67d0a4e658a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:23.012411 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-63831eb3-e5ab-43ea-af70-67d0a4e658a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:23.018757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63831eb3-e5ab-43ea-af70-67d0a4e658a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:23.019229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63831eb3-e5ab-43ea-af70-67d0a4e658a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:23.019985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63831eb3-e5ab-43ea-af70-67d0a4e658a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:23.020465 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-63831eb3-e5ab-43ea-af70-67d0a4e658a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:23.084464 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-63831eb3-e5ab-43ea-af70-67d0a4e658a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:23.093611 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-63831eb3-e5ab-43ea-af70-67d0a4e658a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:23.094962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5d2fb64d-a009-4fc5-b745-c8f83958ed60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:23.095132 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-63831eb3-e5ab-43ea-af70-67d0a4e658a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:23.096248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-63831eb3-e5ab-43ea-af70-67d0a4e658a9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088280 Apr 07 13:22:23.107171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1087/2053] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:23 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:23.107171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0dd63b84-9dde-4e5c-b049-5810f7c638eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:23.107171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0dd63b84-9dde-4e5c-b049-5810f7c638eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:23.107558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5d2fb64d-a009-4fc5-b745-c8f83958ed60 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156122 Apr 07 13:22:23.107558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 967/2054] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:22 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:23.108199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0dd63b84-9dde-4e5c-b049-5810f7c638eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:23.108624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0dd63b84-9dde-4e5c-b049-5810f7c638eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:23.109385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0dd63b84-9dde-4e5c-b049-5810f7c638eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:23.109823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0dd63b84-9dde-4e5c-b049-5810f7c638eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:23.171290 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0dd63b84-9dde-4e5c-b049-5810f7c638eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:23.179108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0dd63b84-9dde-4e5c-b049-5810f7c638eb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081374 Apr 07 13:22:23.179692 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1088/2055] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:23 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:24.114176 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fc794bc1-ce92-4935-bc15-71876a8eed28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:24.114793 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fc794bc1-ce92-4935-bc15-71876a8eed28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:24.119956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bb53b089-1464-4438-bd18-5f67933119c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:24.120600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bb53b089-1464-4438-bd18-5f67933119c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:24.121066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc794bc1-ce92-4935-bc15-71876a8eed28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:24.121512 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc794bc1-ce92-4935-bc15-71876a8eed28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:24.122278 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc794bc1-ce92-4935-bc15-71876a8eed28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:24.122870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc794bc1-ce92-4935-bc15-71876a8eed28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:24.126880 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb53b089-1464-4438-bd18-5f67933119c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:24.127338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb53b089-1464-4438-bd18-5f67933119c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:24.128100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb53b089-1464-4438-bd18-5f67933119c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:24.128558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb53b089-1464-4438-bd18-5f67933119c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:24.185969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fc794bc1-ce92-4935-bc15-71876a8eed28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:24.194295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fc794bc1-ce92-4935-bc15-71876a8eed28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:24.195776 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fc794bc1-ce92-4935-bc15-71876a8eed28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:24.196939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fc794bc1-ce92-4935-bc15-71876a8eed28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086636 Apr 07 13:22:24.197637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 968/2056] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:24 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:24.202388 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ae839b2f-18ab-4ac6-b47d-4d70f1d843ad tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:24.202990 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ae839b2f-18ab-4ac6-b47d-4d70f1d843ad tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:24.208586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae839b2f-18ab-4ac6-b47d-4d70f1d843ad tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:24.210213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae839b2f-18ab-4ac6-b47d-4d70f1d843ad tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:24.211042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae839b2f-18ab-4ac6-b47d-4d70f1d843ad tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:24.211492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ae839b2f-18ab-4ac6-b47d-4d70f1d843ad tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:24.274807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ae839b2f-18ab-4ac6-b47d-4d70f1d843ad tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:24.283453 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ae839b2f-18ab-4ac6-b47d-4d70f1d843ad tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.084845 Apr 07 13:22:24.284029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 969/2057] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:24 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:24.320370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bb53b089-1464-4438-bd18-5f67933119c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:24.328520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bb53b089-1464-4438-bd18-5f67933119c5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.212248 Apr 07 13:22:24.329082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1089/2058] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:24 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:25.217377 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c86bc0f9-ee8f-4390-8e7d-e0cba61b6bfb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:25.218094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c86bc0f9-ee8f-4390-8e7d-e0cba61b6bfb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:25.224686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c86bc0f9-ee8f-4390-8e7d-e0cba61b6bfb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:25.225129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c86bc0f9-ee8f-4390-8e7d-e0cba61b6bfb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:25.225892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c86bc0f9-ee8f-4390-8e7d-e0cba61b6bfb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:25.226323 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c86bc0f9-ee8f-4390-8e7d-e0cba61b6bfb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:25.286851 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c86bc0f9-ee8f-4390-8e7d-e0cba61b6bfb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:25.296349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c86bc0f9-ee8f-4390-8e7d-e0cba61b6bfb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:25.297602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c86bc0f9-ee8f-4390-8e7d-e0cba61b6bfb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:25.298750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c86bc0f9-ee8f-4390-8e7d-e0cba61b6bfb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086764 Apr 07 13:22:25.299294 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 970/2059] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:25 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:25.301196 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9aaa6652-d623-4f2d-98ea-6eea183f0dbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:25.301795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9aaa6652-d623-4f2d-98ea-6eea183f0dbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:25.308028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9aaa6652-d623-4f2d-98ea-6eea183f0dbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:25.308589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9aaa6652-d623-4f2d-98ea-6eea183f0dbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:25.309421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9aaa6652-d623-4f2d-98ea-6eea183f0dbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:25.309862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9aaa6652-d623-4f2d-98ea-6eea183f0dbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:25.346324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b910e82c-38c4-4d85-9dff-4e9b522cd1f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:25.346932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b910e82c-38c4-4d85-9dff-4e9b522cd1f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:25.352766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b910e82c-38c4-4d85-9dff-4e9b522cd1f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:25.353216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b910e82c-38c4-4d85-9dff-4e9b522cd1f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:25.353978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b910e82c-38c4-4d85-9dff-4e9b522cd1f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:25.354410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b910e82c-38c4-4d85-9dff-4e9b522cd1f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:25.367818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9aaa6652-d623-4f2d-98ea-6eea183f0dbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:25.375738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9aaa6652-d623-4f2d-98ea-6eea183f0dbd tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078272 Apr 07 13:22:25.376323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1090/2060] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:25 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:25.484174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b910e82c-38c4-4d85-9dff-4e9b522cd1f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:25.491839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b910e82c-38c4-4d85-9dff-4e9b522cd1f7 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149329 Apr 07 13:22:25.492434 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 971/2061] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:25 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:26.316681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-90155338-8f4c-40ab-897a-bec83bbcfd14 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:26.317272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-90155338-8f4c-40ab-897a-bec83bbcfd14 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:26.323477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-90155338-8f4c-40ab-897a-bec83bbcfd14 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:26.323923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-90155338-8f4c-40ab-897a-bec83bbcfd14 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:26.324696 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-90155338-8f4c-40ab-897a-bec83bbcfd14 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:26.325487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-90155338-8f4c-40ab-897a-bec83bbcfd14 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:26.388214 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-90155338-8f4c-40ab-897a-bec83bbcfd14 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:26.392587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-023aa774-d675-477c-895c-eec2d64e7bc0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:26.393207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-023aa774-d675-477c-895c-eec2d64e7bc0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:26.397295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-90155338-8f4c-40ab-897a-bec83bbcfd14 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:26.398758 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-90155338-8f4c-40ab-897a-bec83bbcfd14 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:26.399482 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-023aa774-d675-477c-895c-eec2d64e7bc0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:26.399890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-90155338-8f4c-40ab-897a-bec83bbcfd14 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087058 Apr 07 13:22:26.400012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-023aa774-d675-477c-895c-eec2d64e7bc0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:26.400678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1091/2062] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:26 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:26.400820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-023aa774-d675-477c-895c-eec2d64e7bc0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:26.401312 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-023aa774-d675-477c-895c-eec2d64e7bc0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:26.464418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-023aa774-d675-477c-895c-eec2d64e7bc0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:26.472335 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-023aa774-d675-477c-895c-eec2d64e7bc0 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.083610 Apr 07 13:22:26.472922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 972/2063] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:26 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:26.509539 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1d58bffa-6f25-4272-b68f-d8be1997239b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:26.510156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1d58bffa-6f25-4272-b68f-d8be1997239b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:26.516256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1d58bffa-6f25-4272-b68f-d8be1997239b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:26.516702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1d58bffa-6f25-4272-b68f-d8be1997239b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:26.517456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1d58bffa-6f25-4272-b68f-d8be1997239b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:26.517887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1d58bffa-6f25-4272-b68f-d8be1997239b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:26.907634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1d58bffa-6f25-4272-b68f-d8be1997239b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:26.915604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1d58bffa-6f25-4272-b68f-d8be1997239b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.409848 Apr 07 13:22:26.916169 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1092/2064] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:26 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:27.419038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9992e715-7b29-45dc-91a2-08a872f3343a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:27.419742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9992e715-7b29-45dc-91a2-08a872f3343a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:27.425975 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9992e715-7b29-45dc-91a2-08a872f3343a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:27.426433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9992e715-7b29-45dc-91a2-08a872f3343a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:27.427203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9992e715-7b29-45dc-91a2-08a872f3343a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:27.427642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9992e715-7b29-45dc-91a2-08a872f3343a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:27.485827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9992e715-7b29-45dc-91a2-08a872f3343a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:27.489788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2ccad52b-ee08-42eb-873e-fd3c85cbd620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:27.490491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2ccad52b-ee08-42eb-873e-fd3c85cbd620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:27.494054 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9992e715-7b29-45dc-91a2-08a872f3343a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:27.495555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9992e715-7b29-45dc-91a2-08a872f3343a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:27.496751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9992e715-7b29-45dc-91a2-08a872f3343a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081776 Apr 07 13:22:27.497442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2ccad52b-ee08-42eb-873e-fd3c85cbd620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:27.497994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 973/2065] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:27 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:27.498124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2ccad52b-ee08-42eb-873e-fd3c85cbd620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:27.498639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2ccad52b-ee08-42eb-873e-fd3c85cbd620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:27.499218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2ccad52b-ee08-42eb-873e-fd3c85cbd620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:27.557116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2ccad52b-ee08-42eb-873e-fd3c85cbd620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:27.565384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2ccad52b-ee08-42eb-873e-fd3c85cbd620 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079397 Apr 07 13:22:27.565937 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1093/2066] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:27 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:27.934022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6bea688a-4f03-4428-8e1b-bed758026761 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:27.935330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6bea688a-4f03-4428-8e1b-bed758026761 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:27.941200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bea688a-4f03-4428-8e1b-bed758026761 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:27.941652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bea688a-4f03-4428-8e1b-bed758026761 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:27.942416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bea688a-4f03-4428-8e1b-bed758026761 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:27.942852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6bea688a-4f03-4428-8e1b-bed758026761 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:28.071886 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6bea688a-4f03-4428-8e1b-bed758026761 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:28.080491 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6bea688a-4f03-4428-8e1b-bed758026761 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150242 Apr 07 13:22:28.081088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 974/2067] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:27 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:28.515675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8fe73d1e-b6aa-4ab7-9b4a-a3e317fc47ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:28.516415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8fe73d1e-b6aa-4ab7-9b4a-a3e317fc47ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:28.522650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fe73d1e-b6aa-4ab7-9b4a-a3e317fc47ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:28.523091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fe73d1e-b6aa-4ab7-9b4a-a3e317fc47ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:28.523852 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fe73d1e-b6aa-4ab7-9b4a-a3e317fc47ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:28.524326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8fe73d1e-b6aa-4ab7-9b4a-a3e317fc47ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:28.583978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f7073b1f-2992-4825-8913-3ef98bc5d22d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:28.584661 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f7073b1f-2992-4825-8913-3ef98bc5d22d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:28.586000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8fe73d1e-b6aa-4ab7-9b4a-a3e317fc47ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:28.594629 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f7073b1f-2992-4825-8913-3ef98bc5d22d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:28.595082 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f7073b1f-2992-4825-8913-3ef98bc5d22d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:28.595863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f7073b1f-2992-4825-8913-3ef98bc5d22d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:28.595976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8fe73d1e-b6aa-4ab7-9b4a-a3e317fc47ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:28.596353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f7073b1f-2992-4825-8913-3ef98bc5d22d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:28.597371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8fe73d1e-b6aa-4ab7-9b4a-a3e317fc47ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:28.598564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8fe73d1e-b6aa-4ab7-9b4a-a3e317fc47ea tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087015 Apr 07 13:22:28.599329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1094/2068] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:28 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:28.655990 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f7073b1f-2992-4825-8913-3ef98bc5d22d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:28.663828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f7073b1f-2992-4825-8913-3ef98bc5d22d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.085611 Apr 07 13:22:28.664424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 975/2069] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:28 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:29.097558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c2a865b7-5383-45be-9295-37c1f4d040e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:29.098172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c2a865b7-5383-45be-9295-37c1f4d040e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:29.104089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2a865b7-5383-45be-9295-37c1f4d040e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:29.104572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2a865b7-5383-45be-9295-37c1f4d040e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:29.105332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2a865b7-5383-45be-9295-37c1f4d040e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:29.105765 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2a865b7-5383-45be-9295-37c1f4d040e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:29.240014 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c2a865b7-5383-45be-9295-37c1f4d040e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:29.248318 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c2a865b7-5383-45be-9295-37c1f4d040e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154567 Apr 07 13:22:29.248876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1095/2070] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:29 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:29.616858 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-34a3598d-15a1-4d2e-a3c8-070ec97d0f54 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:29.617479 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-34a3598d-15a1-4d2e-a3c8-070ec97d0f54 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:29.624478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34a3598d-15a1-4d2e-a3c8-070ec97d0f54 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:29.624939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34a3598d-15a1-4d2e-a3c8-070ec97d0f54 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:29.625710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34a3598d-15a1-4d2e-a3c8-070ec97d0f54 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:29.626155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-34a3598d-15a1-4d2e-a3c8-070ec97d0f54 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:29.681303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3cd3d27b-79a6-4c6f-8201-9e3cdf97fb79 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:29.681920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3cd3d27b-79a6-4c6f-8201-9e3cdf97fb79 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:29.687951 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-34a3598d-15a1-4d2e-a3c8-070ec97d0f54 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:29.689047 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3cd3d27b-79a6-4c6f-8201-9e3cdf97fb79 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:29.689503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3cd3d27b-79a6-4c6f-8201-9e3cdf97fb79 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:29.690283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3cd3d27b-79a6-4c6f-8201-9e3cdf97fb79 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:29.690723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3cd3d27b-79a6-4c6f-8201-9e3cdf97fb79 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:29.696284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-34a3598d-15a1-4d2e-a3c8-070ec97d0f54 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:29.697793 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-34a3598d-15a1-4d2e-a3c8-070ec97d0f54 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:29.698944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-34a3598d-15a1-4d2e-a3c8-070ec97d0f54 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086002 Apr 07 13:22:29.699505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 976/2071] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:29 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:29.748773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3cd3d27b-79a6-4c6f-8201-9e3cdf97fb79 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:29.756428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3cd3d27b-79a6-4c6f-8201-9e3cdf97fb79 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078974 Apr 07 13:22:29.756994 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1096/2072] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:29 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:30.266021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bf4f1667-716a-48c3-af37-af70529f4b14 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:30.266671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bf4f1667-716a-48c3-af37-af70529f4b14 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:30.272577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf4f1667-716a-48c3-af37-af70529f4b14 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:30.273026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf4f1667-716a-48c3-af37-af70529f4b14 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:30.273789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf4f1667-716a-48c3-af37-af70529f4b14 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:30.274224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bf4f1667-716a-48c3-af37-af70529f4b14 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:30.405598 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bf4f1667-716a-48c3-af37-af70529f4b14 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:30.413521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bf4f1667-716a-48c3-af37-af70529f4b14 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152098 Apr 07 13:22:30.414091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 977/2073] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:30 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:30.717714 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e5401ad9-7634-44f8-ae3e-cd6df8e7a3b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:30.718329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e5401ad9-7634-44f8-ae3e-cd6df8e7a3b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:30.724938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e5401ad9-7634-44f8-ae3e-cd6df8e7a3b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:30.725395 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e5401ad9-7634-44f8-ae3e-cd6df8e7a3b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:30.726155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e5401ad9-7634-44f8-ae3e-cd6df8e7a3b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:30.726589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e5401ad9-7634-44f8-ae3e-cd6df8e7a3b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:30.772356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f176fa5b-a053-4cbc-addf-f8c93495e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:30.773087 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f176fa5b-a053-4cbc-addf-f8c93495e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:30.780069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f176fa5b-a053-4cbc-addf-f8c93495e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:30.780541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f176fa5b-a053-4cbc-addf-f8c93495e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:30.781302 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f176fa5b-a053-4cbc-addf-f8c93495e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:30.781733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f176fa5b-a053-4cbc-addf-f8c93495e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:30.786579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e5401ad9-7634-44f8-ae3e-cd6df8e7a3b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:30.794769 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e5401ad9-7634-44f8-ae3e-cd6df8e7a3b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:30.796320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e5401ad9-7634-44f8-ae3e-cd6df8e7a3b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:30.797460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e5401ad9-7634-44f8-ae3e-cd6df8e7a3b5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084442 Apr 07 13:22:30.798016 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1097/2074] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:30 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:30.839939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f176fa5b-a053-4cbc-addf-f8c93495e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:30.848237 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f176fa5b-a053-4cbc-addf-f8c93495e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079694 Apr 07 13:22:30.848803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 978/2075] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:30 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:31.431127 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3389f03f-e7f7-4df6-aaa6-f6f5676acc44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:31.431740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3389f03f-e7f7-4df6-aaa6-f6f5676acc44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:31.438433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3389f03f-e7f7-4df6-aaa6-f6f5676acc44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:31.438878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3389f03f-e7f7-4df6-aaa6-f6f5676acc44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:31.439629 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3389f03f-e7f7-4df6-aaa6-f6f5676acc44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:31.440070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3389f03f-e7f7-4df6-aaa6-f6f5676acc44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:31.571194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3389f03f-e7f7-4df6-aaa6-f6f5676acc44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:31.579699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3389f03f-e7f7-4df6-aaa6-f6f5676acc44 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152377 Apr 07 13:22:31.580295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1098/2076] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:31 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:31.815708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b180771f-7b79-4e7a-aacd-4254381723dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:31.816254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b180771f-7b79-4e7a-aacd-4254381723dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:31.822458 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b180771f-7b79-4e7a-aacd-4254381723dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:31.822904 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b180771f-7b79-4e7a-aacd-4254381723dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:31.823661 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b180771f-7b79-4e7a-aacd-4254381723dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:31.824091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b180771f-7b79-4e7a-aacd-4254381723dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:31.864866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-52144d54-61cb-45d9-aee2-40da22f91e36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:31.865491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-52144d54-61cb-45d9-aee2-40da22f91e36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:31.871941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-52144d54-61cb-45d9-aee2-40da22f91e36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:31.872444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-52144d54-61cb-45d9-aee2-40da22f91e36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:31.873218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-52144d54-61cb-45d9-aee2-40da22f91e36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:31.873658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-52144d54-61cb-45d9-aee2-40da22f91e36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:31.887003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b180771f-7b79-4e7a-aacd-4254381723dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:31.895412 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b180771f-7b79-4e7a-aacd-4254381723dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:31.896961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b180771f-7b79-4e7a-aacd-4254381723dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:31.898148 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b180771f-7b79-4e7a-aacd-4254381723dc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.086580 Apr 07 13:22:31.898716 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 979/2077] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:31 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:31.932423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-52144d54-61cb-45d9-aee2-40da22f91e36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:31.940633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-52144d54-61cb-45d9-aee2-40da22f91e36 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079530 Apr 07 13:22:31.941187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1099/2078] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:31 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:32.597602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5f9fa0dd-f0d5-40d7-a5e8-16ac3eb6b1e3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:32.598215 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5f9fa0dd-f0d5-40d7-a5e8-16ac3eb6b1e3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:32.604101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f9fa0dd-f0d5-40d7-a5e8-16ac3eb6b1e3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:32.604583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f9fa0dd-f0d5-40d7-a5e8-16ac3eb6b1e3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:32.605340 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f9fa0dd-f0d5-40d7-a5e8-16ac3eb6b1e3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:32.605774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f9fa0dd-f0d5-40d7-a5e8-16ac3eb6b1e3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:32.738178 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5f9fa0dd-f0d5-40d7-a5e8-16ac3eb6b1e3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:32.745830 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5f9fa0dd-f0d5-40d7-a5e8-16ac3eb6b1e3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152060 Apr 07 13:22:32.746390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 980/2079] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:32 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:32.916957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-65d96aa5-fcd9-45af-b98d-3032d859caa2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:32.917570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-65d96aa5-fcd9-45af-b98d-3032d859caa2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:32.924356 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65d96aa5-fcd9-45af-b98d-3032d859caa2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:32.924805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65d96aa5-fcd9-45af-b98d-3032d859caa2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:32.925563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65d96aa5-fcd9-45af-b98d-3032d859caa2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:32.925999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-65d96aa5-fcd9-45af-b98d-3032d859caa2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:32.959850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e6b0ec9d-bb71-4546-a8f6-bf29de2b6655 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:32.960989 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e6b0ec9d-bb71-4546-a8f6-bf29de2b6655 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:32.971506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6b0ec9d-bb71-4546-a8f6-bf29de2b6655 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:32.972081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6b0ec9d-bb71-4546-a8f6-bf29de2b6655 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:32.972994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6b0ec9d-bb71-4546-a8f6-bf29de2b6655 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:32.973775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6b0ec9d-bb71-4546-a8f6-bf29de2b6655 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:32.994805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-65d96aa5-fcd9-45af-b98d-3032d859caa2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:33.003641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-65d96aa5-fcd9-45af-b98d-3032d859caa2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:33.005138 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-65d96aa5-fcd9-45af-b98d-3032d859caa2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:33.006381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-65d96aa5-fcd9-45af-b98d-3032d859caa2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.093146 Apr 07 13:22:33.006941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1100/2080] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:32 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:33.036583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e6b0ec9d-bb71-4546-a8f6-bf29de2b6655 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:33.044928 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e6b0ec9d-bb71-4546-a8f6-bf29de2b6655 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.091417 Apr 07 13:22:33.045499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 981/2081] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:32 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:33.763492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-faa05d49-a3ac-4075-9100-b3000692b22a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:33.764100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-faa05d49-a3ac-4075-9100-b3000692b22a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:33.770037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-faa05d49-a3ac-4075-9100-b3000692b22a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:33.770479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-faa05d49-a3ac-4075-9100-b3000692b22a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:33.771229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-faa05d49-a3ac-4075-9100-b3000692b22a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:33.771658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-faa05d49-a3ac-4075-9100-b3000692b22a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:33.904115 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-faa05d49-a3ac-4075-9100-b3000692b22a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:33.912224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-faa05d49-a3ac-4075-9100-b3000692b22a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152826 Apr 07 13:22:33.912790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1101/2082] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:33 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:34.024526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8a7ca30f-f619-49ed-9975-686f921506a6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:34.025139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8a7ca30f-f619-49ed-9975-686f921506a6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:34.031668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a7ca30f-f619-49ed-9975-686f921506a6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:34.032122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a7ca30f-f619-49ed-9975-686f921506a6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:34.033068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a7ca30f-f619-49ed-9975-686f921506a6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:34.033506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8a7ca30f-f619-49ed-9975-686f921506a6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:34.062106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-de960ba2-b412-4b41-8191-653b35ce9685 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:34.062833 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-de960ba2-b412-4b41-8191-653b35ce9685 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:34.069185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de960ba2-b412-4b41-8191-653b35ce9685 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:34.069632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de960ba2-b412-4b41-8191-653b35ce9685 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:34.070388 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de960ba2-b412-4b41-8191-653b35ce9685 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:34.070820 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-de960ba2-b412-4b41-8191-653b35ce9685 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:34.093072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8a7ca30f-f619-49ed-9975-686f921506a6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:34.101168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8a7ca30f-f619-49ed-9975-686f921506a6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:34.102669 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8a7ca30f-f619-49ed-9975-686f921506a6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:34.103818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8a7ca30f-f619-49ed-9975-686f921506a6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083308 Apr 07 13:22:34.104492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 982/2083] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:34 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:34.130267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-de960ba2-b412-4b41-8191-653b35ce9685 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:34.138074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-de960ba2-b412-4b41-8191-653b35ce9685 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080353 Apr 07 13:22:34.138630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1102/2084] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:34 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:34.931072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e5cced6b-4b27-4314-940a-c00c97f24f33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:34.931692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e5cced6b-4b27-4314-940a-c00c97f24f33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:34.938039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e5cced6b-4b27-4314-940a-c00c97f24f33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:34.938490 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e5cced6b-4b27-4314-940a-c00c97f24f33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:34.939262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e5cced6b-4b27-4314-940a-c00c97f24f33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:34.939697 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e5cced6b-4b27-4314-940a-c00c97f24f33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:35.072556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e5cced6b-4b27-4314-940a-c00c97f24f33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:35.081310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e5cced6b-4b27-4314-940a-c00c97f24f33 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154048 Apr 07 13:22:35.081865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 983/2085] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:34 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:35.122507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3bcd0ee8-7efe-4ab0-b405-b84610371546 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:35.123119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3bcd0ee8-7efe-4ab0-b405-b84610371546 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:35.129448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bcd0ee8-7efe-4ab0-b405-b84610371546 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:35.129902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bcd0ee8-7efe-4ab0-b405-b84610371546 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:35.130697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bcd0ee8-7efe-4ab0-b405-b84610371546 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:35.131138 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bcd0ee8-7efe-4ab0-b405-b84610371546 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:35.155205 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c8a9a17c-064a-4f94-8df7-efc18789000c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:35.155751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c8a9a17c-064a-4f94-8df7-efc18789000c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:35.161875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8a9a17c-064a-4f94-8df7-efc18789000c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:35.162336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8a9a17c-064a-4f94-8df7-efc18789000c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:35.163115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8a9a17c-064a-4f94-8df7-efc18789000c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:35.163553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8a9a17c-064a-4f94-8df7-efc18789000c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:35.190891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3bcd0ee8-7efe-4ab0-b405-b84610371546 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:35.199196 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3bcd0ee8-7efe-4ab0-b405-b84610371546 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:35.201379 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3bcd0ee8-7efe-4ab0-b405-b84610371546 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:35.202520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3bcd0ee8-7efe-4ab0-b405-b84610371546 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084051 Apr 07 13:22:35.203080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1103/2086] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:35 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:35.223498 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c8a9a17c-064a-4f94-8df7-efc18789000c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:35.231371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c8a9a17c-064a-4f94-8df7-efc18789000c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080653 Apr 07 13:22:35.231943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 984/2087] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:35 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:36.098759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6f3ae9f1-dfe3-4dd1-8258-640e34805d15 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:36.099369 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6f3ae9f1-dfe3-4dd1-8258-640e34805d15 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:36.105197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f3ae9f1-dfe3-4dd1-8258-640e34805d15 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:36.105649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f3ae9f1-dfe3-4dd1-8258-640e34805d15 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:36.106799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f3ae9f1-dfe3-4dd1-8258-640e34805d15 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:36.107241 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f3ae9f1-dfe3-4dd1-8258-640e34805d15 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:36.220355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b5beb3ea-f781-4dba-968d-5292cead00f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:36.220977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b5beb3ea-f781-4dba-968d-5292cead00f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:36.227217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5beb3ea-f781-4dba-968d-5292cead00f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:36.227670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5beb3ea-f781-4dba-968d-5292cead00f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:36.228467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5beb3ea-f781-4dba-968d-5292cead00f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:36.228906 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b5beb3ea-f781-4dba-968d-5292cead00f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:36.239686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6f3ae9f1-dfe3-4dd1-8258-640e34805d15 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:36.248466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6f3ae9f1-dfe3-4dd1-8258-640e34805d15 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153442 Apr 07 13:22:36.249224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1104/2088] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:36 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:36.253415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-21533033-7ac5-40cd-9d6f-2a49a79953b1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:36.254017 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-21533033-7ac5-40cd-9d6f-2a49a79953b1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:36.259663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21533033-7ac5-40cd-9d6f-2a49a79953b1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:36.260166 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21533033-7ac5-40cd-9d6f-2a49a79953b1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:36.260946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21533033-7ac5-40cd-9d6f-2a49a79953b1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:36.261380 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-21533033-7ac5-40cd-9d6f-2a49a79953b1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:36.289429 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b5beb3ea-f781-4dba-968d-5292cead00f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:36.297806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b5beb3ea-f781-4dba-968d-5292cead00f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:36.299303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b5beb3ea-f781-4dba-968d-5292cead00f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:36.300497 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b5beb3ea-f781-4dba-968d-5292cead00f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084089 Apr 07 13:22:36.301057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 985/2089] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:36 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:36.320835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-21533033-7ac5-40cd-9d6f-2a49a79953b1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:36.328900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-21533033-7ac5-40cd-9d6f-2a49a79953b1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078897 Apr 07 13:22:36.329460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1105/2090] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:36 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:37.265892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-aaf35f1a-4c99-4514-9e60-226e52a587f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:37.266456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-aaf35f1a-4c99-4514-9e60-226e52a587f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:37.272750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aaf35f1a-4c99-4514-9e60-226e52a587f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:37.273204 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aaf35f1a-4c99-4514-9e60-226e52a587f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:37.273972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aaf35f1a-4c99-4514-9e60-226e52a587f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:37.274416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aaf35f1a-4c99-4514-9e60-226e52a587f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:37.318641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f1f753db-b3cd-47b7-8a64-95226f591218 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:37.319249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f1f753db-b3cd-47b7-8a64-95226f591218 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:37.325503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1f753db-b3cd-47b7-8a64-95226f591218 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:37.325970 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1f753db-b3cd-47b7-8a64-95226f591218 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:37.326729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1f753db-b3cd-47b7-8a64-95226f591218 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:37.327170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1f753db-b3cd-47b7-8a64-95226f591218 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:37.388196 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f1f753db-b3cd-47b7-8a64-95226f591218 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:37.396465 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f1f753db-b3cd-47b7-8a64-95226f591218 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:37.397941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f1f753db-b3cd-47b7-8a64-95226f591218 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:37.399068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f1f753db-b3cd-47b7-8a64-95226f591218 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084258 Apr 07 13:22:37.399615 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1106/2091] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:37 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:37.404217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d3ad0905-59e2-4d81-93f5-6e273157ff3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:37.404887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d3ad0905-59e2-4d81-93f5-6e273157ff3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:37.407744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-aaf35f1a-4c99-4514-9e60-226e52a587f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:37.410730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d3ad0905-59e2-4d81-93f5-6e273157ff3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:37.411180 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d3ad0905-59e2-4d81-93f5-6e273157ff3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:37.411935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d3ad0905-59e2-4d81-93f5-6e273157ff3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:37.412395 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d3ad0905-59e2-4d81-93f5-6e273157ff3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:37.415897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-aaf35f1a-4c99-4514-9e60-226e52a587f5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154136 Apr 07 13:22:37.416486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 986/2092] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:37 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:37.627253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d3ad0905-59e2-4d81-93f5-6e273157ff3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:37.635001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d3ad0905-59e2-4d81-93f5-6e273157ff3e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.234459 Apr 07 13:22:37.635559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1107/2093] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:37 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:38.417400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-32a13b14-c9e9-4127-bc46-ed373a6b187b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:38.418011 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-32a13b14-c9e9-4127-bc46-ed373a6b187b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:38.425689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32a13b14-c9e9-4127-bc46-ed373a6b187b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:38.426146 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32a13b14-c9e9-4127-bc46-ed373a6b187b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:38.426907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32a13b14-c9e9-4127-bc46-ed373a6b187b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:38.427349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32a13b14-c9e9-4127-bc46-ed373a6b187b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:38.433485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a09feafa-6458-4a9d-8ecc-da208a972db6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:38.434293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a09feafa-6458-4a9d-8ecc-da208a972db6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:38.440579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a09feafa-6458-4a9d-8ecc-da208a972db6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:38.441030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a09feafa-6458-4a9d-8ecc-da208a972db6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:38.441791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a09feafa-6458-4a9d-8ecc-da208a972db6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:38.442221 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a09feafa-6458-4a9d-8ecc-da208a972db6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:38.490939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-32a13b14-c9e9-4127-bc46-ed373a6b187b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:38.499376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-32a13b14-c9e9-4127-bc46-ed373a6b187b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:38.500916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-32a13b14-c9e9-4127-bc46-ed373a6b187b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:38.502070 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-32a13b14-c9e9-4127-bc46-ed373a6b187b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088602 Apr 07 13:22:38.502640 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 987/2094] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:38 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:38.578614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a09feafa-6458-4a9d-8ecc-da208a972db6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:38.586596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a09feafa-6458-4a9d-8ecc-da208a972db6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156821 Apr 07 13:22:38.587158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1108/2095] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:38 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:38.651597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5389d1d3-ad2c-4db6-a17f-d3f2c800b6de tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:38.652235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5389d1d3-ad2c-4db6-a17f-d3f2c800b6de tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:38.658585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5389d1d3-ad2c-4db6-a17f-d3f2c800b6de tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:38.659032 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5389d1d3-ad2c-4db6-a17f-d3f2c800b6de tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:38.659790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5389d1d3-ad2c-4db6-a17f-d3f2c800b6de tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:38.660509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5389d1d3-ad2c-4db6-a17f-d3f2c800b6de tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:38.718850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5389d1d3-ad2c-4db6-a17f-d3f2c800b6de tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:38.726519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5389d1d3-ad2c-4db6-a17f-d3f2c800b6de tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078653 Apr 07 13:22:38.727190 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 988/2096] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:38 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:39.519934 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d7a61e4d-86e6-4166-8d53-47af5a4f9e28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:39.520571 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d7a61e4d-86e6-4166-8d53-47af5a4f9e28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:39.526820 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7a61e4d-86e6-4166-8d53-47af5a4f9e28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:39.527263 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7a61e4d-86e6-4166-8d53-47af5a4f9e28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:39.528662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7a61e4d-86e6-4166-8d53-47af5a4f9e28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:39.529180 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7a61e4d-86e6-4166-8d53-47af5a4f9e28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:39.587436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d7a61e4d-86e6-4166-8d53-47af5a4f9e28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:39.596831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d7a61e4d-86e6-4166-8d53-47af5a4f9e28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:39.598320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d7a61e4d-86e6-4166-8d53-47af5a4f9e28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:39.600258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d7a61e4d-86e6-4166-8d53-47af5a4f9e28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083820 Apr 07 13:22:39.601211 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1109/2097] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:39 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:39.604744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2df07a37-afc5-4905-9469-5914c700a1bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:39.605365 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2df07a37-afc5-4905-9469-5914c700a1bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:39.618607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2df07a37-afc5-4905-9469-5914c700a1bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:39.619052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2df07a37-afc5-4905-9469-5914c700a1bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:39.619822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2df07a37-afc5-4905-9469-5914c700a1bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:39.620343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2df07a37-afc5-4905-9469-5914c700a1bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:39.742961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-970ea16a-c673-4e81-b34b-d5ef3202dedb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:39.743579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-970ea16a-c673-4e81-b34b-d5ef3202dedb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:39.749482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-970ea16a-c673-4e81-b34b-d5ef3202dedb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:39.749935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-970ea16a-c673-4e81-b34b-d5ef3202dedb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:39.750693 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-970ea16a-c673-4e81-b34b-d5ef3202dedb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:39.751131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-970ea16a-c673-4e81-b34b-d5ef3202dedb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:39.753862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2df07a37-afc5-4905-9469-5914c700a1bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:39.761613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2df07a37-afc5-4905-9469-5914c700a1bd tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.160815 Apr 07 13:22:39.762827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 989/2098] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:39 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:39.809450 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-970ea16a-c673-4e81-b34b-d5ef3202dedb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:39.817048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-970ea16a-c673-4e81-b34b-d5ef3202dedb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.077880 Apr 07 13:22:39.817593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1110/2099] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:39 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:40.618686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4c938342-3872-40be-9e88-9f292380225e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:40.619316 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4c938342-3872-40be-9e88-9f292380225e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:40.626205 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c938342-3872-40be-9e88-9f292380225e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:40.626654 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c938342-3872-40be-9e88-9f292380225e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:40.627412 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c938342-3872-40be-9e88-9f292380225e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:40.627883 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c938342-3872-40be-9e88-9f292380225e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:40.689304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4c938342-3872-40be-9e88-9f292380225e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:40.697301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4c938342-3872-40be-9e88-9f292380225e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:40.698778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4c938342-3872-40be-9e88-9f292380225e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:40.700117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4c938342-3872-40be-9e88-9f292380225e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085320 Apr 07 13:22:40.700682 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 990/2100] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:40 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:40.779978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e01b6e6c-a358-46fe-b796-e2720d22d032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:40.780616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e01b6e6c-a358-46fe-b796-e2720d22d032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:40.787080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e01b6e6c-a358-46fe-b796-e2720d22d032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:40.787523 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e01b6e6c-a358-46fe-b796-e2720d22d032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:40.788314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e01b6e6c-a358-46fe-b796-e2720d22d032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:40.788747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e01b6e6c-a358-46fe-b796-e2720d22d032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:40.834472 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e75b4f91-6f75-4589-b4f6-7e8df8ae450e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:40.835012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e75b4f91-6f75-4589-b4f6-7e8df8ae450e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:40.841468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e75b4f91-6f75-4589-b4f6-7e8df8ae450e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:40.841923 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e75b4f91-6f75-4589-b4f6-7e8df8ae450e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:40.842704 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e75b4f91-6f75-4589-b4f6-7e8df8ae450e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:40.843147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e75b4f91-6f75-4589-b4f6-7e8df8ae450e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:40.905477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e75b4f91-6f75-4589-b4f6-7e8df8ae450e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:40.914639 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e75b4f91-6f75-4589-b4f6-7e8df8ae450e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.084029 Apr 07 13:22:40.915223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 991/2101] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:40 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:40.938817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e01b6e6c-a358-46fe-b796-e2720d22d032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:40.946517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e01b6e6c-a358-46fe-b796-e2720d22d032 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.171346 Apr 07 13:22:40.947072 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1111/2102] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:40 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:41.717619 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6a2007e4-9ce1-40fa-ada3-262f84fd1e29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:41.718235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6a2007e4-9ce1-40fa-ada3-262f84fd1e29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:41.724866 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6a2007e4-9ce1-40fa-ada3-262f84fd1e29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:41.725321 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6a2007e4-9ce1-40fa-ada3-262f84fd1e29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:41.726118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6a2007e4-9ce1-40fa-ada3-262f84fd1e29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:41.726551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6a2007e4-9ce1-40fa-ada3-262f84fd1e29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:41.785615 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6a2007e4-9ce1-40fa-ada3-262f84fd1e29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:41.794380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6a2007e4-9ce1-40fa-ada3-262f84fd1e29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:41.795873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6a2007e4-9ce1-40fa-ada3-262f84fd1e29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:41.797054 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6a2007e4-9ce1-40fa-ada3-262f84fd1e29 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083335 Apr 07 13:22:41.797625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 992/2103] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:41 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:41.931494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c83fd93c-70b4-473b-b4d2-3b46152b85bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:41.931900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c83fd93c-70b4-473b-b4d2-3b46152b85bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:41.938582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c83fd93c-70b4-473b-b4d2-3b46152b85bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:41.939037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c83fd93c-70b4-473b-b4d2-3b46152b85bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:41.939797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c83fd93c-70b4-473b-b4d2-3b46152b85bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:41.940274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c83fd93c-70b4-473b-b4d2-3b46152b85bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:41.963879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d13431fb-72a2-4d1b-9bac-be7eecf90a1d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:41.964514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d13431fb-72a2-4d1b-9bac-be7eecf90a1d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:41.970426 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d13431fb-72a2-4d1b-9bac-be7eecf90a1d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:41.970877 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d13431fb-72a2-4d1b-9bac-be7eecf90a1d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:41.971635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d13431fb-72a2-4d1b-9bac-be7eecf90a1d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:41.972069 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d13431fb-72a2-4d1b-9bac-be7eecf90a1d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:41.998508 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c83fd93c-70b4-473b-b4d2-3b46152b85bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:42.006307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c83fd93c-70b4-473b-b4d2-3b46152b85bb tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079052 Apr 07 13:22:42.006868 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1112/2104] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:41 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:42.104992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d13431fb-72a2-4d1b-9bac-be7eecf90a1d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:42.112861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d13431fb-72a2-4d1b-9bac-be7eecf90a1d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.152763 Apr 07 13:22:42.113427 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 993/2105] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:41 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:42.815190 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-19297d82-52bd-46c1-99c2-cd87eaab28b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:42.815795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-19297d82-52bd-46c1-99c2-cd87eaab28b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:42.821627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19297d82-52bd-46c1-99c2-cd87eaab28b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:42.822073 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19297d82-52bd-46c1-99c2-cd87eaab28b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:42.822824 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19297d82-52bd-46c1-99c2-cd87eaab28b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:42.823287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19297d82-52bd-46c1-99c2-cd87eaab28b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:42.883842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-19297d82-52bd-46c1-99c2-cd87eaab28b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:42.892517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-19297d82-52bd-46c1-99c2-cd87eaab28b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:42.894011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-19297d82-52bd-46c1-99c2-cd87eaab28b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:42.895142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-19297d82-52bd-46c1-99c2-cd87eaab28b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083810 Apr 07 13:22:42.895691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1113/2106] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:42 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:43.022642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-04c1cda2-353f-4f85-8464-61bcf9a13b7d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:43.023260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-04c1cda2-353f-4f85-8464-61bcf9a13b7d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:43.030128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-04c1cda2-353f-4f85-8464-61bcf9a13b7d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:43.030128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-04c1cda2-353f-4f85-8464-61bcf9a13b7d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:43.030838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-04c1cda2-353f-4f85-8464-61bcf9a13b7d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:43.031280 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-04c1cda2-353f-4f85-8464-61bcf9a13b7d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:43.089837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-04c1cda2-353f-4f85-8464-61bcf9a13b7d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:43.097595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-04c1cda2-353f-4f85-8464-61bcf9a13b7d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078758 Apr 07 13:22:43.098155 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 994/2107] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:43 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:43.130110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0c7bd2d7-2308-4c88-8773-ee73f062d57f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:43.130723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0c7bd2d7-2308-4c88-8773-ee73f062d57f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:43.137672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c7bd2d7-2308-4c88-8773-ee73f062d57f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:43.138136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c7bd2d7-2308-4c88-8773-ee73f062d57f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:43.138891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c7bd2d7-2308-4c88-8773-ee73f062d57f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:43.139328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c7bd2d7-2308-4c88-8773-ee73f062d57f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:43.269264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0c7bd2d7-2308-4c88-8773-ee73f062d57f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:43.277177 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0c7bd2d7-2308-4c88-8773-ee73f062d57f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150788 Apr 07 13:22:43.277796 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1114/2108] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:43 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:43.912809 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-83f7d8f9-571d-4011-b7f2-7d019ba48011 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:43.913422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-83f7d8f9-571d-4011-b7f2-7d019ba48011 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:43.920212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83f7d8f9-571d-4011-b7f2-7d019ba48011 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:43.920668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83f7d8f9-571d-4011-b7f2-7d019ba48011 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:43.921436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83f7d8f9-571d-4011-b7f2-7d019ba48011 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:43.921875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-83f7d8f9-571d-4011-b7f2-7d019ba48011 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:43.980265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-83f7d8f9-571d-4011-b7f2-7d019ba48011 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:43.988828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-83f7d8f9-571d-4011-b7f2-7d019ba48011 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:43.990305 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-83f7d8f9-571d-4011-b7f2-7d019ba48011 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:43.991439 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-83f7d8f9-571d-4011-b7f2-7d019ba48011 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082756 Apr 07 13:22:43.991999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 995/2109] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:43 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:44.114881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e930b5db-4e7f-4b3a-ba6b-1163722c048f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:44.115531 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e930b5db-4e7f-4b3a-ba6b-1163722c048f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:44.121537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e930b5db-4e7f-4b3a-ba6b-1163722c048f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:44.121993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e930b5db-4e7f-4b3a-ba6b-1163722c048f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:44.122758 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e930b5db-4e7f-4b3a-ba6b-1163722c048f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:44.123196 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e930b5db-4e7f-4b3a-ba6b-1163722c048f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:44.182376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e930b5db-4e7f-4b3a-ba6b-1163722c048f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:44.192670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e930b5db-4e7f-4b3a-ba6b-1163722c048f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081664 Apr 07 13:22:44.193151 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1115/2110] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:44 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:44.294395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cd96c6fe-70d7-4f9a-824e-b2f75cec5d37 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:44.295003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cd96c6fe-70d7-4f9a-824e-b2f75cec5d37 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:44.301322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cd96c6fe-70d7-4f9a-824e-b2f75cec5d37 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:44.301768 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cd96c6fe-70d7-4f9a-824e-b2f75cec5d37 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:44.302524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cd96c6fe-70d7-4f9a-824e-b2f75cec5d37 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:44.302959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cd96c6fe-70d7-4f9a-824e-b2f75cec5d37 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:44.436629 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cd96c6fe-70d7-4f9a-824e-b2f75cec5d37 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:44.444523 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cd96c6fe-70d7-4f9a-824e-b2f75cec5d37 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153824 Apr 07 13:22:44.445096 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 996/2111] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:44 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:45.009653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d53a3203-20f8-4b57-90f1-9890e5f75676 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:45.010266 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d53a3203-20f8-4b57-90f1-9890e5f75676 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:45.016414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d53a3203-20f8-4b57-90f1-9890e5f75676 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:45.016867 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d53a3203-20f8-4b57-90f1-9890e5f75676 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:45.017623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d53a3203-20f8-4b57-90f1-9890e5f75676 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:45.018066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d53a3203-20f8-4b57-90f1-9890e5f75676 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:45.076445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d53a3203-20f8-4b57-90f1-9890e5f75676 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:45.084494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d53a3203-20f8-4b57-90f1-9890e5f75676 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:45.085983 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d53a3203-20f8-4b57-90f1-9890e5f75676 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:45.087149 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d53a3203-20f8-4b57-90f1-9890e5f75676 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081355 Apr 07 13:22:45.087689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1116/2112] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:45 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:45.210858 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d15c19ff-cf0c-4c9c-8453-ffa4f4f45853 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:45.211389 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d15c19ff-cf0c-4c9c-8453-ffa4f4f45853 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:45.217916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d15c19ff-cf0c-4c9c-8453-ffa4f4f45853 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:45.218364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d15c19ff-cf0c-4c9c-8453-ffa4f4f45853 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:45.219120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d15c19ff-cf0c-4c9c-8453-ffa4f4f45853 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:45.219554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d15c19ff-cf0c-4c9c-8453-ffa4f4f45853 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:45.276953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d15c19ff-cf0c-4c9c-8453-ffa4f4f45853 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:45.285569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d15c19ff-cf0c-4c9c-8453-ffa4f4f45853 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078413 Apr 07 13:22:45.286128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 997/2113] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:45 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:45.462680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-32d045a8-3892-484a-8f6c-6b8575097f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:45.463222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-32d045a8-3892-484a-8f6c-6b8575097f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:45.470930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32d045a8-3892-484a-8f6c-6b8575097f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:45.471372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32d045a8-3892-484a-8f6c-6b8575097f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:45.472118 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32d045a8-3892-484a-8f6c-6b8575097f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:45.472578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-32d045a8-3892-484a-8f6c-6b8575097f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:45.605956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-32d045a8-3892-484a-8f6c-6b8575097f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:45.613669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-32d045a8-3892-484a-8f6c-6b8575097f95 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154802 Apr 07 13:22:45.614216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1117/2114] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:45 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:46.105248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-461708cc-d04c-4366-a058-2696245cee74 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:46.106068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-461708cc-d04c-4366-a058-2696245cee74 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:46.112347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-461708cc-d04c-4366-a058-2696245cee74 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:46.112798 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-461708cc-d04c-4366-a058-2696245cee74 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:46.113564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-461708cc-d04c-4366-a058-2696245cee74 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:46.114007 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-461708cc-d04c-4366-a058-2696245cee74 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:46.173758 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-461708cc-d04c-4366-a058-2696245cee74 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:46.181828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-461708cc-d04c-4366-a058-2696245cee74 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:46.183305 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-461708cc-d04c-4366-a058-2696245cee74 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:46.185160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-461708cc-d04c-4366-a058-2696245cee74 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083773 Apr 07 13:22:46.185717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 998/2115] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:46 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:46.302745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bb060ca9-1d3b-4423-ae0e-db6809004a8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:46.303299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bb060ca9-1d3b-4423-ae0e-db6809004a8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:46.310273 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb060ca9-1d3b-4423-ae0e-db6809004a8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:46.310727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb060ca9-1d3b-4423-ae0e-db6809004a8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:46.311481 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb060ca9-1d3b-4423-ae0e-db6809004a8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:46.311911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bb060ca9-1d3b-4423-ae0e-db6809004a8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:46.369677 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bb060ca9-1d3b-4423-ae0e-db6809004a8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:46.378241 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bb060ca9-1d3b-4423-ae0e-db6809004a8c tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079458 Apr 07 13:22:46.378791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1118/2116] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:46 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:46.630661 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7b2f9981-f1c9-4f28-a777-87beaddc3513 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:46.631278 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7b2f9981-f1c9-4f28-a777-87beaddc3513 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:46.637486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b2f9981-f1c9-4f28-a777-87beaddc3513 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:46.637937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b2f9981-f1c9-4f28-a777-87beaddc3513 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:46.638704 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b2f9981-f1c9-4f28-a777-87beaddc3513 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:46.639143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b2f9981-f1c9-4f28-a777-87beaddc3513 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:46.771905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7b2f9981-f1c9-4f28-a777-87beaddc3513 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:46.780485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7b2f9981-f1c9-4f28-a777-87beaddc3513 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153610 Apr 07 13:22:46.781061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 999/2117] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:46 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:47.203674 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-399b48dd-d393-47ec-a1d3-c4219675ddac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:47.204243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-399b48dd-d393-47ec-a1d3-c4219675ddac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:47.210394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-399b48dd-d393-47ec-a1d3-c4219675ddac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:47.210838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-399b48dd-d393-47ec-a1d3-c4219675ddac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:47.211689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-399b48dd-d393-47ec-a1d3-c4219675ddac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:47.212119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-399b48dd-d393-47ec-a1d3-c4219675ddac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:47.271686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-399b48dd-d393-47ec-a1d3-c4219675ddac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:47.280499 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-399b48dd-d393-47ec-a1d3-c4219675ddac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:47.281971 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-399b48dd-d393-47ec-a1d3-c4219675ddac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:47.283087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-399b48dd-d393-47ec-a1d3-c4219675ddac tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083964 Apr 07 13:22:47.283630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1119/2118] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:47 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:47.394973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e1e2e911-a342-48f0-a936-c0ad29f4e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:47.395596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e1e2e911-a342-48f0-a936-c0ad29f4e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:47.402101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1e2e911-a342-48f0-a936-c0ad29f4e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:47.403104 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1e2e911-a342-48f0-a936-c0ad29f4e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:47.403885 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1e2e911-a342-48f0-a936-c0ad29f4e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:47.404366 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1e2e911-a342-48f0-a936-c0ad29f4e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:47.462970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e1e2e911-a342-48f0-a936-c0ad29f4e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:47.471153 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e1e2e911-a342-48f0-a936-c0ad29f4e658 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079983 Apr 07 13:22:47.471718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1000/2119] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:47 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:47.797760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-beff61c2-5ec8-4f16-93e0-10b6459c60a3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:47.798362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-beff61c2-5ec8-4f16-93e0-10b6459c60a3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:47.804126 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-beff61c2-5ec8-4f16-93e0-10b6459c60a3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:47.804641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-beff61c2-5ec8-4f16-93e0-10b6459c60a3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:47.805396 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-beff61c2-5ec8-4f16-93e0-10b6459c60a3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:47.805837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-beff61c2-5ec8-4f16-93e0-10b6459c60a3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:47.941260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-beff61c2-5ec8-4f16-93e0-10b6459c60a3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:47.950882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-beff61c2-5ec8-4f16-93e0-10b6459c60a3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.157010 Apr 07 13:22:47.951439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1120/2120] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:47 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:48.302127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-87477bd7-9ac7-4c2a-8723-96de8ec0a687 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:48.302742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-87477bd7-9ac7-4c2a-8723-96de8ec0a687 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:48.309199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-87477bd7-9ac7-4c2a-8723-96de8ec0a687 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:48.309694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-87477bd7-9ac7-4c2a-8723-96de8ec0a687 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:48.310461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-87477bd7-9ac7-4c2a-8723-96de8ec0a687 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:48.310898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-87477bd7-9ac7-4c2a-8723-96de8ec0a687 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:48.488847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-09c59140-cf82-4834-888d-64378aee4345 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:48.489442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-09c59140-cf82-4834-888d-64378aee4345 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:48.497110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-09c59140-cf82-4834-888d-64378aee4345 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:48.497676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-09c59140-cf82-4834-888d-64378aee4345 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:48.498453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-09c59140-cf82-4834-888d-64378aee4345 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:48.498892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-09c59140-cf82-4834-888d-64378aee4345 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:48.535021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-87477bd7-9ac7-4c2a-8723-96de8ec0a687 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:48.544792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-87477bd7-9ac7-4c2a-8723-96de8ec0a687 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:48.546278 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-87477bd7-9ac7-4c2a-8723-96de8ec0a687 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:48.547419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-87477bd7-9ac7-4c2a-8723-96de8ec0a687 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.249256 Apr 07 13:22:48.547976 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1001/2121] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:48 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:48.557131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-09c59140-cf82-4834-888d-64378aee4345 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:48.565782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-09c59140-cf82-4834-888d-64378aee4345 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080847 Apr 07 13:22:48.566334 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1121/2122] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:48 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:48.967419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-820b6c0b-dcfc-4eb3-b4fb-2a6252a2dfe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:48.968077 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-820b6c0b-dcfc-4eb3-b4fb-2a6252a2dfe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:48.974033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-820b6c0b-dcfc-4eb3-b4fb-2a6252a2dfe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:48.974484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-820b6c0b-dcfc-4eb3-b4fb-2a6252a2dfe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:48.975242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-820b6c0b-dcfc-4eb3-b4fb-2a6252a2dfe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:48.975681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-820b6c0b-dcfc-4eb3-b4fb-2a6252a2dfe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:49.108552 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-820b6c0b-dcfc-4eb3-b4fb-2a6252a2dfe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:49.116379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-820b6c0b-dcfc-4eb3-b4fb-2a6252a2dfe0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153051 Apr 07 13:22:49.116941 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1002/2123] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:48 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:49.566086 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7f18dbce-7c88-4f01-a84b-bcfd89e3980e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:49.566700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7f18dbce-7c88-4f01-a84b-bcfd89e3980e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:49.573000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f18dbce-7c88-4f01-a84b-bcfd89e3980e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:49.573458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f18dbce-7c88-4f01-a84b-bcfd89e3980e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:49.574360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f18dbce-7c88-4f01-a84b-bcfd89e3980e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:49.574884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7f18dbce-7c88-4f01-a84b-bcfd89e3980e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:49.582550 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-075d9f28-5304-4e63-80c9-58135fac651d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:49.583170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-075d9f28-5304-4e63-80c9-58135fac651d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:49.589509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-075d9f28-5304-4e63-80c9-58135fac651d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:49.591486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-075d9f28-5304-4e63-80c9-58135fac651d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:49.591981 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-075d9f28-5304-4e63-80c9-58135fac651d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:49.592448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-075d9f28-5304-4e63-80c9-58135fac651d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:49.636885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7f18dbce-7c88-4f01-a84b-bcfd89e3980e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:49.645316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7f18dbce-7c88-4f01-a84b-bcfd89e3980e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:49.647163 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7f18dbce-7c88-4f01-a84b-bcfd89e3980e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:49.648076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7f18dbce-7c88-4f01-a84b-bcfd89e3980e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085839 Apr 07 13:22:49.648680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1122/2124] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:49 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:49.651945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-075d9f28-5304-4e63-80c9-58135fac651d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:49.660585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-075d9f28-5304-4e63-80c9-58135fac651d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081879 Apr 07 13:22:49.661135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1003/2125] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:49 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:50.134100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-78afd9f6-160d-48d7-80d7-c22af5b7f774 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:50.134711 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-78afd9f6-160d-48d7-80d7-c22af5b7f774 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:50.140602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-78afd9f6-160d-48d7-80d7-c22af5b7f774 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:50.141087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-78afd9f6-160d-48d7-80d7-c22af5b7f774 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:50.141841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-78afd9f6-160d-48d7-80d7-c22af5b7f774 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:50.142276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-78afd9f6-160d-48d7-80d7-c22af5b7f774 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:50.270877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-78afd9f6-160d-48d7-80d7-c22af5b7f774 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:50.279091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-78afd9f6-160d-48d7-80d7-c22af5b7f774 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.148819 Apr 07 13:22:50.279646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1123/2126] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:50 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:50.666849 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-376a6395-2b76-4870-92d5-42a7e6ab2bb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:50.667468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-376a6395-2b76-4870-92d5-42a7e6ab2bb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:50.674828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-376a6395-2b76-4870-92d5-42a7e6ab2bb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:50.675278 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-376a6395-2b76-4870-92d5-42a7e6ab2bb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:50.676039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-376a6395-2b76-4870-92d5-42a7e6ab2bb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:50.676503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-376a6395-2b76-4870-92d5-42a7e6ab2bb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:50.677107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3c323f8f-a5d5-4aad-badb-3532baf47918 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:50.677825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3c323f8f-a5d5-4aad-badb-3532baf47918 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:50.684179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c323f8f-a5d5-4aad-badb-3532baf47918 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:50.684638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c323f8f-a5d5-4aad-badb-3532baf47918 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:50.685390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c323f8f-a5d5-4aad-badb-3532baf47918 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:50.685820 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3c323f8f-a5d5-4aad-badb-3532baf47918 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:50.736771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-376a6395-2b76-4870-92d5-42a7e6ab2bb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:50.745061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-376a6395-2b76-4870-92d5-42a7e6ab2bb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:50.746753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-376a6395-2b76-4870-92d5-42a7e6ab2bb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:50.747935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-376a6395-2b76-4870-92d5-42a7e6ab2bb3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084921 Apr 07 13:22:50.748499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1004/2127] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:50 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:50.750154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3c323f8f-a5d5-4aad-badb-3532baf47918 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:50.758105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3c323f8f-a5d5-4aad-badb-3532baf47918 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.084671 Apr 07 13:22:50.758642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1124/2128] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:50 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:51.296236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f6ee6c09-b41a-4899-b444-071a2a096b57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:51.296864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f6ee6c09-b41a-4899-b444-071a2a096b57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:51.302921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f6ee6c09-b41a-4899-b444-071a2a096b57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:51.303372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f6ee6c09-b41a-4899-b444-071a2a096b57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:51.304167 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f6ee6c09-b41a-4899-b444-071a2a096b57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:51.304619 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f6ee6c09-b41a-4899-b444-071a2a096b57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:51.433842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f6ee6c09-b41a-4899-b444-071a2a096b57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:51.441587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f6ee6c09-b41a-4899-b444-071a2a096b57 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149248 Apr 07 13:22:51.442137 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1005/2129] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:51 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:51.766458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-76a8feff-482e-4c6c-a1fb-0b52654115f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:51.767072 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-76a8feff-482e-4c6c-a1fb-0b52654115f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:51.773386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-76a8feff-482e-4c6c-a1fb-0b52654115f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:51.773835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-76a8feff-482e-4c6c-a1fb-0b52654115f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:51.774465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b7f9b641-c9ec-4323-842d-2e128eb3f49f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:51.774900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-76a8feff-482e-4c6c-a1fb-0b52654115f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:51.775012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-76a8feff-482e-4c6c-a1fb-0b52654115f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:51.775113 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b7f9b641-c9ec-4323-842d-2e128eb3f49f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:51.782680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7f9b641-c9ec-4323-842d-2e128eb3f49f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:51.783138 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7f9b641-c9ec-4323-842d-2e128eb3f49f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:51.783903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7f9b641-c9ec-4323-842d-2e128eb3f49f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:51.784381 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b7f9b641-c9ec-4323-842d-2e128eb3f49f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:51.835173 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-76a8feff-482e-4c6c-a1fb-0b52654115f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:51.844750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-76a8feff-482e-4c6c-a1fb-0b52654115f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:51.846237 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-76a8feff-482e-4c6c-a1fb-0b52654115f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:51.847363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-76a8feff-482e-4c6c-a1fb-0b52654115f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084922 Apr 07 13:22:51.847532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b7f9b641-c9ec-4323-842d-2e128eb3f49f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:51.847902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1125/2130] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:51 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:51.855876 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b7f9b641-c9ec-4323-842d-2e128eb3f49f tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.084984 Apr 07 13:22:51.856467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1006/2131] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:51 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:52.458956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9bc4c234-ab88-4934-8683-1e5d0895d58f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:52.459601 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9bc4c234-ab88-4934-8683-1e5d0895d58f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:52.465660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9bc4c234-ab88-4934-8683-1e5d0895d58f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:52.466114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9bc4c234-ab88-4934-8683-1e5d0895d58f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:52.466871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9bc4c234-ab88-4934-8683-1e5d0895d58f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:52.467323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9bc4c234-ab88-4934-8683-1e5d0895d58f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:52.596775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9bc4c234-ab88-4934-8683-1e5d0895d58f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:52.604479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9bc4c234-ab88-4934-8683-1e5d0895d58f tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.149570 Apr 07 13:22:52.605034 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1126/2132] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:52 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:52.865501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ebacbdad-e862-4188-92ec-9b7f59430e7f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:52.866115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ebacbdad-e862-4188-92ec-9b7f59430e7f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:52.872374 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6a777323-a20a-41ce-bff9-cef68baf33b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:52.873057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6a777323-a20a-41ce-bff9-cef68baf33b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:52.873180 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ebacbdad-e862-4188-92ec-9b7f59430e7f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:52.873564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ebacbdad-e862-4188-92ec-9b7f59430e7f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:52.874335 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ebacbdad-e862-4188-92ec-9b7f59430e7f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:52.874771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ebacbdad-e862-4188-92ec-9b7f59430e7f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:52.878859 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a777323-a20a-41ce-bff9-cef68baf33b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:52.879311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a777323-a20a-41ce-bff9-cef68baf33b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:52.880075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a777323-a20a-41ce-bff9-cef68baf33b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:52.880567 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a777323-a20a-41ce-bff9-cef68baf33b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:52.936617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ebacbdad-e862-4188-92ec-9b7f59430e7f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:52.938793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6a777323-a20a-41ce-bff9-cef68baf33b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:52.944997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ebacbdad-e862-4188-92ec-9b7f59430e7f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:52.946482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6a777323-a20a-41ce-bff9-cef68baf33b6 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.077896 Apr 07 13:22:52.946628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ebacbdad-e862-4188-92ec-9b7f59430e7f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:52.947040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1127/2133] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:52 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:52.947798 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ebacbdad-e862-4188-92ec-9b7f59430e7f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085994 Apr 07 13:22:52.948296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1007/2134] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:52 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:53.623898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ae31e60b-e4b7-475a-9ad0-d57ad1855c49 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:53.624541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ae31e60b-e4b7-475a-9ad0-d57ad1855c49 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:53.630847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae31e60b-e4b7-475a-9ad0-d57ad1855c49 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:53.631295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae31e60b-e4b7-475a-9ad0-d57ad1855c49 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:53.632051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae31e60b-e4b7-475a-9ad0-d57ad1855c49 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:53.632511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae31e60b-e4b7-475a-9ad0-d57ad1855c49 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:53.770178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ae31e60b-e4b7-475a-9ad0-d57ad1855c49 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:53.778334 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ae31e60b-e4b7-475a-9ad0-d57ad1855c49 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.158912 Apr 07 13:22:53.778890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1128/2135] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:53 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:53.844457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:22:53.844645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:22:53.964184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9d3ecbd7-abe5-4be7-acf0-a611653a2cab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:53.964871 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9d3ecbd7-abe5-4be7-acf0-a611653a2cab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:53.965654 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fb4ee8da-d77c-4065-a823-a9db7b408b87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:53.966275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fb4ee8da-d77c-4065-a823-a9db7b408b87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:53.971301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d3ecbd7-abe5-4be7-acf0-a611653a2cab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:53.971763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d3ecbd7-abe5-4be7-acf0-a611653a2cab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:53.972174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb4ee8da-d77c-4065-a823-a9db7b408b87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:53.972592 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d3ecbd7-abe5-4be7-acf0-a611653a2cab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:53.972710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb4ee8da-d77c-4065-a823-a9db7b408b87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:53.973026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d3ecbd7-abe5-4be7-acf0-a611653a2cab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:53.973386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb4ee8da-d77c-4065-a823-a9db7b408b87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:53.973822 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fb4ee8da-d77c-4065-a823-a9db7b408b87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:54.032244 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9d3ecbd7-abe5-4be7-acf0-a611653a2cab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:54.033129 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fb4ee8da-d77c-4065-a823-a9db7b408b87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:54.040567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9d3ecbd7-abe5-4be7-acf0-a611653a2cab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080194 Apr 07 13:22:54.041130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1008/2136] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:53 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:54.041510 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fb4ee8da-d77c-4065-a823-a9db7b408b87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:54.043505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fb4ee8da-d77c-4065-a823-a9db7b408b87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:54.044673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fb4ee8da-d77c-4065-a823-a9db7b408b87 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082802 Apr 07 13:22:54.045209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1129/2137] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:53 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:54.795599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-30808ab9-84f5-4031-a3c1-b4da3876beb9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:54.796236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-30808ab9-84f5-4031-a3c1-b4da3876beb9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:54.802165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-30808ab9-84f5-4031-a3c1-b4da3876beb9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:54.802623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-30808ab9-84f5-4031-a3c1-b4da3876beb9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:54.803392 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-30808ab9-84f5-4031-a3c1-b4da3876beb9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:54.803833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-30808ab9-84f5-4031-a3c1-b4da3876beb9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:54.937247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-30808ab9-84f5-4031-a3c1-b4da3876beb9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:54.945119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-30808ab9-84f5-4031-a3c1-b4da3876beb9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153416 Apr 07 13:22:54.945679 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1009/2138] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:54 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:55.057276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e2ea9093-b319-4e15-abe9-39d1851d9bc7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:55.057894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e2ea9093-b319-4e15-abe9-39d1851d9bc7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:55.063051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b3c55f6f-3085-4f89-96d1-f9780f1849b8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:55.063671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b3c55f6f-3085-4f89-96d1-f9780f1849b8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:55.064953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e2ea9093-b319-4e15-abe9-39d1851d9bc7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:55.065418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e2ea9093-b319-4e15-abe9-39d1851d9bc7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:55.066191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e2ea9093-b319-4e15-abe9-39d1851d9bc7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:55.066636 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e2ea9093-b319-4e15-abe9-39d1851d9bc7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:55.069663 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3c55f6f-3085-4f89-96d1-f9780f1849b8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:55.070131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3c55f6f-3085-4f89-96d1-f9780f1849b8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:55.070908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3c55f6f-3085-4f89-96d1-f9780f1849b8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:55.071352 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3c55f6f-3085-4f89-96d1-f9780f1849b8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:55.127601 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e2ea9093-b319-4e15-abe9-39d1851d9bc7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:55.132677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b3c55f6f-3085-4f89-96d1-f9780f1849b8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:55.135738 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e2ea9093-b319-4e15-abe9-39d1851d9bc7 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.082299 Apr 07 13:22:55.136269 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1130/2139] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:55 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:55.146784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b3c55f6f-3085-4f89-96d1-f9780f1849b8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:55.148668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b3c55f6f-3085-4f89-96d1-f9780f1849b8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:55.149843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b3c55f6f-3085-4f89-96d1-f9780f1849b8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.090677 Apr 07 13:22:55.150394 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1010/2140] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:55 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:55.962579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-60ff99a8-da4a-49e8-8b58-df41e6cb88b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:55.963192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-60ff99a8-da4a-49e8-8b58-df41e6cb88b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:55.970215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60ff99a8-da4a-49e8-8b58-df41e6cb88b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:55.970664 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60ff99a8-da4a-49e8-8b58-df41e6cb88b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:55.971438 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60ff99a8-da4a-49e8-8b58-df41e6cb88b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:55.971871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60ff99a8-da4a-49e8-8b58-df41e6cb88b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:56.106188 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-60ff99a8-da4a-49e8-8b58-df41e6cb88b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:56.113880 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-60ff99a8-da4a-49e8-8b58-df41e6cb88b6 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155122 Apr 07 13:22:56.114443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1131/2141] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:55 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:56.153106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5a0ce4c7-c1a5-492e-934a-5635b7e30f51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:56.153748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5a0ce4c7-c1a5-492e-934a-5635b7e30f51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:56.161359 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5a0ce4c7-c1a5-492e-934a-5635b7e30f51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:56.161811 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5a0ce4c7-c1a5-492e-934a-5635b7e30f51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:56.162576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5a0ce4c7-c1a5-492e-934a-5635b7e30f51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:56.163010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5a0ce4c7-c1a5-492e-934a-5635b7e30f51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:56.168022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3d354786-77b0-4cfa-9932-1e1fcefea5d9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:56.168748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3d354786-77b0-4cfa-9932-1e1fcefea5d9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:56.174487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d354786-77b0-4cfa-9932-1e1fcefea5d9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:56.174948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d354786-77b0-4cfa-9932-1e1fcefea5d9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:56.175724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d354786-77b0-4cfa-9932-1e1fcefea5d9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:56.176182 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d354786-77b0-4cfa-9932-1e1fcefea5d9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:56.229674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5a0ce4c7-c1a5-492e-934a-5635b7e30f51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:56.240514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3d354786-77b0-4cfa-9932-1e1fcefea5d9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:56.243143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5a0ce4c7-c1a5-492e-934a-5635b7e30f51 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.091043 Apr 07 13:22:56.243839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1011/2142] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:56 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:56.250595 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3d354786-77b0-4cfa-9932-1e1fcefea5d9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:56.251512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3d354786-77b0-4cfa-9932-1e1fcefea5d9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:56.252676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3d354786-77b0-4cfa-9932-1e1fcefea5d9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088634 Apr 07 13:22:56.253214 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1132/2143] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:56 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:22:57.130782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3c3c7cd5-e028-4c2f-a9d9-21a224787fac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:57.131425 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3c3c7cd5-e028-4c2f-a9d9-21a224787fac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:57.138887 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c3c7cd5-e028-4c2f-a9d9-21a224787fac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:57.139335 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c3c7cd5-e028-4c2f-a9d9-21a224787fac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:57.140094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c3c7cd5-e028-4c2f-a9d9-21a224787fac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:57.140553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c3c7cd5-e028-4c2f-a9d9-21a224787fac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:57.259243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6d8422c2-da29-4207-806f-7784ebc76624 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:57.259979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6d8422c2-da29-4207-806f-7784ebc76624 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:57.266908 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d8422c2-da29-4207-806f-7784ebc76624 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:57.267895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d8422c2-da29-4207-806f-7784ebc76624 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:57.268130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d8422c2-da29-4207-806f-7784ebc76624 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:57.268586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d8422c2-da29-4207-806f-7784ebc76624 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:57.269907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3c3c7cd5-e028-4c2f-a9d9-21a224787fac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:57.277934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3c3c7cd5-e028-4c2f-a9d9-21a224787fac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150872 Apr 07 13:22:57.278516 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1012/2144] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:57 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:57.282947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5282faf1-cd3e-47d3-a672-76a6eee0fe07 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:57.283693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5282faf1-cd3e-47d3-a672-76a6eee0fe07 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:57.289541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5282faf1-cd3e-47d3-a672-76a6eee0fe07 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:57.289997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5282faf1-cd3e-47d3-a672-76a6eee0fe07 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:57.290782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5282faf1-cd3e-47d3-a672-76a6eee0fe07 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:57.291222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5282faf1-cd3e-47d3-a672-76a6eee0fe07 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:57.328457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6d8422c2-da29-4207-806f-7784ebc76624 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:57.336306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6d8422c2-da29-4207-806f-7784ebc76624 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080832 Apr 07 13:22:57.337216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1133/2145] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:57 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:57.351596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5282faf1-cd3e-47d3-a672-76a6eee0fe07 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:57.359983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5282faf1-cd3e-47d3-a672-76a6eee0fe07 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:57.361570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5282faf1-cd3e-47d3-a672-76a6eee0fe07 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:57.362716 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5282faf1-cd3e-47d3-a672-76a6eee0fe07 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083284 Apr 07 13:22:57.363259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1013/2146] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:57 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:58.295005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4fde2254-75b9-479b-9410-22303edf8e24 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:58.295619 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4fde2254-75b9-479b-9410-22303edf8e24 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:58.301903 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4fde2254-75b9-479b-9410-22303edf8e24 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:58.302351 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4fde2254-75b9-479b-9410-22303edf8e24 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:58.303108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4fde2254-75b9-479b-9410-22303edf8e24 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:58.303563 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4fde2254-75b9-479b-9410-22303edf8e24 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:58.353092 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1e98106b-69a7-41d7-8b7e-8c04082a3a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:58.353709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1e98106b-69a7-41d7-8b7e-8c04082a3a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:58.360643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e98106b-69a7-41d7-8b7e-8c04082a3a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:58.361100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e98106b-69a7-41d7-8b7e-8c04082a3a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:58.361865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e98106b-69a7-41d7-8b7e-8c04082a3a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:58.362302 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e98106b-69a7-41d7-8b7e-8c04082a3a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:58.426621 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1e98106b-69a7-41d7-8b7e-8c04082a3a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:58.434555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1e98106b-69a7-41d7-8b7e-8c04082a3a37 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.085289 Apr 07 13:22:58.435273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1014/2147] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:58 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:22:58.438265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4fde2254-75b9-479b-9410-22303edf8e24 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:58.439597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1c754ddc-f135-4b85-bdcd-be64ee444866 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:58.440266 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1c754ddc-f135-4b85-bdcd-be64ee444866 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:58.445896 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1c754ddc-f135-4b85-bdcd-be64ee444866 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:58.446293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4fde2254-75b9-479b-9410-22303edf8e24 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155322 Apr 07 13:22:58.446422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1c754ddc-f135-4b85-bdcd-be64ee444866 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:58.446844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1134/2148] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:58 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:58.447102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1c754ddc-f135-4b85-bdcd-be64ee444866 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:58.447542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1c754ddc-f135-4b85-bdcd-be64ee444866 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:58.507950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1c754ddc-f135-4b85-bdcd-be64ee444866 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:58.516725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1c754ddc-f135-4b85-bdcd-be64ee444866 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:58.518248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1c754ddc-f135-4b85-bdcd-be64ee444866 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:58.519399 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1c754ddc-f135-4b85-bdcd-be64ee444866 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083360 Apr 07 13:22:58.519956 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1015/2149] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:58 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:59.451657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8462fffb-fa07-43a2-89fc-5e0e26756c5d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:59.452348 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8462fffb-fa07-43a2-89fc-5e0e26756c5d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:59.458618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8462fffb-fa07-43a2-89fc-5e0e26756c5d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:59.459082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8462fffb-fa07-43a2-89fc-5e0e26756c5d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:59.459823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8462fffb-fa07-43a2-89fc-5e0e26756c5d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:59.460291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8462fffb-fa07-43a2-89fc-5e0e26756c5d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:59.467846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dcce3bfc-b860-47d1-ad4c-30a036aa41aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:59.468492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dcce3bfc-b860-47d1-ad4c-30a036aa41aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:59.474838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dcce3bfc-b860-47d1-ad4c-30a036aa41aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:59.475295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dcce3bfc-b860-47d1-ad4c-30a036aa41aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:59.476085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dcce3bfc-b860-47d1-ad4c-30a036aa41aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:59.476538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dcce3bfc-b860-47d1-ad4c-30a036aa41aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:59.526351 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8462fffb-fa07-43a2-89fc-5e0e26756c5d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:59.541358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8462fffb-fa07-43a2-89fc-5e0e26756c5d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.093353 Apr 07 13:22:59.543205 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1135/2150] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:59 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:22:59.551456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-438f064c-c0f3-45d6-8020-6f161c0faac0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:22:59.552649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-438f064c-c0f3-45d6-8020-6f161c0faac0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:22:59.559504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-438f064c-c0f3-45d6-8020-6f161c0faac0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:59.559954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-438f064c-c0f3-45d6-8020-6f161c0faac0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:59.560752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-438f064c-c0f3-45d6-8020-6f161c0faac0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:22:59.561188 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-438f064c-c0f3-45d6-8020-6f161c0faac0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:22:59.621448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-438f064c-c0f3-45d6-8020-6f161c0faac0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:59.629851 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-438f064c-c0f3-45d6-8020-6f161c0faac0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:59.630023 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dcce3bfc-b860-47d1-ad4c-30a036aa41aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:59.631477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-438f064c-c0f3-45d6-8020-6f161c0faac0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:22:59.632653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-438f064c-c0f3-45d6-8020-6f161c0faac0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088124 Apr 07 13:22:59.633198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1136/2151] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:22:59 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:22:59.638167 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dcce3bfc-b860-47d1-ad4c-30a036aa41aa tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.174588 Apr 07 13:22:59.638722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1016/2152] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:22:59 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:00.559799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e23c83c3-97b1-49f9-94c1-19d99e1aceea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:00.560492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e23c83c3-97b1-49f9-94c1-19d99e1aceea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:00.566748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e23c83c3-97b1-49f9-94c1-19d99e1aceea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:00.567197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e23c83c3-97b1-49f9-94c1-19d99e1aceea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:00.567951 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e23c83c3-97b1-49f9-94c1-19d99e1aceea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:00.568415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e23c83c3-97b1-49f9-94c1-19d99e1aceea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:00.626489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e23c83c3-97b1-49f9-94c1-19d99e1aceea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:00.634059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e23c83c3-97b1-49f9-94c1-19d99e1aceea tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078189 Apr 07 13:23:00.634610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1137/2153] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:00 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:00.650931 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2a7c2d2f-e81a-4412-9bae-fe45d0d60f8a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:00.651582 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2a7c2d2f-e81a-4412-9bae-fe45d0d60f8a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:00.654947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-684f564e-74ec-4a27-baac-e6829380c5d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:00.655594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-684f564e-74ec-4a27-baac-e6829380c5d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:00.658763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a7c2d2f-e81a-4412-9bae-fe45d0d60f8a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:00.659222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a7c2d2f-e81a-4412-9bae-fe45d0d60f8a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:00.660008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a7c2d2f-e81a-4412-9bae-fe45d0d60f8a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:00.661171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a7c2d2f-e81a-4412-9bae-fe45d0d60f8a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:00.661454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-684f564e-74ec-4a27-baac-e6829380c5d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:00.661904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-684f564e-74ec-4a27-baac-e6829380c5d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:00.662662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-684f564e-74ec-4a27-baac-e6829380c5d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:00.663098 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-684f564e-74ec-4a27-baac-e6829380c5d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:00.721852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2a7c2d2f-e81a-4412-9bae-fe45d0d60f8a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:00.730085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2a7c2d2f-e81a-4412-9bae-fe45d0d60f8a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:00.731587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2a7c2d2f-e81a-4412-9bae-fe45d0d60f8a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:00.732763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2a7c2d2f-e81a-4412-9bae-fe45d0d60f8a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085971 Apr 07 13:23:00.733505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1017/2154] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:00 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:00.796712 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-684f564e-74ec-4a27-baac-e6829380c5d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:00.804463 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-684f564e-74ec-4a27-baac-e6829380c5d0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153831 Apr 07 13:23:00.805022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1138/2155] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:00 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:01.651495 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-928196a0-9c15-493a-866c-33aeec63298d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:01.653068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-928196a0-9c15-493a-866c-33aeec63298d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:01.659342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-928196a0-9c15-493a-866c-33aeec63298d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:01.659788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-928196a0-9c15-493a-866c-33aeec63298d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:01.660839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-928196a0-9c15-493a-866c-33aeec63298d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:01.661273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-928196a0-9c15-493a-866c-33aeec63298d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:01.722038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-928196a0-9c15-493a-866c-33aeec63298d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:01.729700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-928196a0-9c15-493a-866c-33aeec63298d tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.082072 Apr 07 13:23:01.735221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1018/2156] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:01 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:01.750382 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c8bc4afe-d880-42e5-ab5e-8b8e81ca3a28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:01.750992 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c8bc4afe-d880-42e5-ab5e-8b8e81ca3a28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:01.757219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8bc4afe-d880-42e5-ab5e-8b8e81ca3a28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:01.757670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8bc4afe-d880-42e5-ab5e-8b8e81ca3a28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:01.758425 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8bc4afe-d880-42e5-ab5e-8b8e81ca3a28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:01.758863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8bc4afe-d880-42e5-ab5e-8b8e81ca3a28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:01.817729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c8bc4afe-d880-42e5-ab5e-8b8e81ca3a28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:01.821792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-43ba0bce-fc26-4e9c-8c8c-c52224e230a9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:01.822493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-43ba0bce-fc26-4e9c-8c8c-c52224e230a9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:01.826779 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c8bc4afe-d880-42e5-ab5e-8b8e81ca3a28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:01.828292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c8bc4afe-d880-42e5-ab5e-8b8e81ca3a28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:01.828903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43ba0bce-fc26-4e9c-8c8c-c52224e230a9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:01.829420 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43ba0bce-fc26-4e9c-8c8c-c52224e230a9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:01.829547 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c8bc4afe-d880-42e5-ab5e-8b8e81ca3a28 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082887 Apr 07 13:23:01.829972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1139/2157] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:01 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:01.830341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43ba0bce-fc26-4e9c-8c8c-c52224e230a9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:01.830794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43ba0bce-fc26-4e9c-8c8c-c52224e230a9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:01.962224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-43ba0bce-fc26-4e9c-8c8c-c52224e230a9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:01.970942 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-43ba0bce-fc26-4e9c-8c8c-c52224e230a9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153231 Apr 07 13:23:01.971504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1019/2158] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:01 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:02.752675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6cc2fdc4-f874-472c-b800-d57edce62b9e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:02.753285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6cc2fdc4-f874-472c-b800-d57edce62b9e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:02.759520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6cc2fdc4-f874-472c-b800-d57edce62b9e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:02.759968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6cc2fdc4-f874-472c-b800-d57edce62b9e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:02.760750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6cc2fdc4-f874-472c-b800-d57edce62b9e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:02.761709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6cc2fdc4-f874-472c-b800-d57edce62b9e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:02.821076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6cc2fdc4-f874-472c-b800-d57edce62b9e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:02.828941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6cc2fdc4-f874-472c-b800-d57edce62b9e tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.080046 Apr 07 13:23:02.829494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1140/2159] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:02 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:02.847893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-74470c3c-2df9-4a17-b286-76a3955d48f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:02.848474 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-74470c3c-2df9-4a17-b286-76a3955d48f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:02.855299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74470c3c-2df9-4a17-b286-76a3955d48f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:02.855872 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74470c3c-2df9-4a17-b286-76a3955d48f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:02.856670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74470c3c-2df9-4a17-b286-76a3955d48f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:02.857114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74470c3c-2df9-4a17-b286-76a3955d48f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:02.915406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-74470c3c-2df9-4a17-b286-76a3955d48f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:02.924097 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-74470c3c-2df9-4a17-b286-76a3955d48f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:02.925602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-74470c3c-2df9-4a17-b286-76a3955d48f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:02.926744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-74470c3c-2df9-4a17-b286-76a3955d48f6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082783 Apr 07 13:23:02.927298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1020/2160] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:02 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:02.987864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-853719f3-895f-405a-aeae-0760a77684c2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:02.988520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-853719f3-895f-405a-aeae-0760a77684c2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:02.994448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-853719f3-895f-405a-aeae-0760a77684c2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:02.994902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-853719f3-895f-405a-aeae-0760a77684c2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:02.996501 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-853719f3-895f-405a-aeae-0760a77684c2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:02.996989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-853719f3-895f-405a-aeae-0760a77684c2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:03.129312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-853719f3-895f-405a-aeae-0760a77684c2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:03.137671 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-853719f3-895f-405a-aeae-0760a77684c2 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153587 Apr 07 13:23:03.138213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1141/2161] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:02 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:03.424380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:23:03.424582 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:23:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:23:03.846109 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8ecd6762-1fa0-4be4-9ce3-198d3e5301a8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:03.846642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8ecd6762-1fa0-4be4-9ce3-198d3e5301a8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:03.852699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8ecd6762-1fa0-4be4-9ce3-198d3e5301a8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:03.853251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8ecd6762-1fa0-4be4-9ce3-198d3e5301a8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:03.853909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8ecd6762-1fa0-4be4-9ce3-198d3e5301a8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:03.854349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8ecd6762-1fa0-4be4-9ce3-198d3e5301a8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:03.915369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8ecd6762-1fa0-4be4-9ce3-198d3e5301a8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:03.923401 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8ecd6762-1fa0-4be4-9ce3-198d3e5301a8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081103 Apr 07 13:23:03.923953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1021/2162] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:03 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:03.944252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-60d4a160-96a9-4f2d-a926-14dc5581072c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:03.944862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-60d4a160-96a9-4f2d-a926-14dc5581072c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:03.951723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60d4a160-96a9-4f2d-a926-14dc5581072c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:03.952265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60d4a160-96a9-4f2d-a926-14dc5581072c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:03.953020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60d4a160-96a9-4f2d-a926-14dc5581072c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:03.953453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-60d4a160-96a9-4f2d-a926-14dc5581072c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:04.012881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-60d4a160-96a9-4f2d-a926-14dc5581072c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:04.020935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-60d4a160-96a9-4f2d-a926-14dc5581072c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:04.022403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-60d4a160-96a9-4f2d-a926-14dc5581072c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:04.023555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-60d4a160-96a9-4f2d-a926-14dc5581072c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083099 Apr 07 13:23:04.024097 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1142/2163] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:03 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:04.153790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-be6fc0f5-feff-49b4-9bd0-17380bbed8e1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:04.154411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-be6fc0f5-feff-49b4-9bd0-17380bbed8e1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:04.160558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-be6fc0f5-feff-49b4-9bd0-17380bbed8e1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:04.161018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-be6fc0f5-feff-49b4-9bd0-17380bbed8e1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:04.161793 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-be6fc0f5-feff-49b4-9bd0-17380bbed8e1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:04.162232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-be6fc0f5-feff-49b4-9bd0-17380bbed8e1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:04.503330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-be6fc0f5-feff-49b4-9bd0-17380bbed8e1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:04.511195 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-be6fc0f5-feff-49b4-9bd0-17380bbed8e1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.361200 Apr 07 13:23:04.512212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1022/2164] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:04 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:04.939743 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-51336f16-5ac3-491a-8adc-db1b20b8c3c8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:04.940380 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-51336f16-5ac3-491a-8adc-db1b20b8c3c8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:04.946192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51336f16-5ac3-491a-8adc-db1b20b8c3c8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:04.946752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51336f16-5ac3-491a-8adc-db1b20b8c3c8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:04.947405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51336f16-5ac3-491a-8adc-db1b20b8c3c8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:04.947835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-51336f16-5ac3-491a-8adc-db1b20b8c3c8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:05.006644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-51336f16-5ac3-491a-8adc-db1b20b8c3c8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:05.014936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-51336f16-5ac3-491a-8adc-db1b20b8c3c8 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078942 Apr 07 13:23:05.015493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1143/2165] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:04 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:05.041216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9e13c9ea-e3e9-4515-8809-db3b02cea743 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:05.041838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9e13c9ea-e3e9-4515-8809-db3b02cea743 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:05.049001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9e13c9ea-e3e9-4515-8809-db3b02cea743 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:05.049455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9e13c9ea-e3e9-4515-8809-db3b02cea743 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:05.050221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9e13c9ea-e3e9-4515-8809-db3b02cea743 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:05.050659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9e13c9ea-e3e9-4515-8809-db3b02cea743 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:05.108968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9e13c9ea-e3e9-4515-8809-db3b02cea743 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:05.117068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9e13c9ea-e3e9-4515-8809-db3b02cea743 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:05.118544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9e13c9ea-e3e9-4515-8809-db3b02cea743 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:05.119695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9e13c9ea-e3e9-4515-8809-db3b02cea743 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082392 Apr 07 13:23:05.120416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1023/2166] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:05 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:05.529702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e815309e-6f1e-4bc9-a3e6-bff41afb8a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:05.530313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e815309e-6f1e-4bc9-a3e6-bff41afb8a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:05.536490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e815309e-6f1e-4bc9-a3e6-bff41afb8a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:05.536942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e815309e-6f1e-4bc9-a3e6-bff41afb8a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:05.537693 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e815309e-6f1e-4bc9-a3e6-bff41afb8a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:05.538123 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e815309e-6f1e-4bc9-a3e6-bff41afb8a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:05.671630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e815309e-6f1e-4bc9-a3e6-bff41afb8a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:05.679432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e815309e-6f1e-4bc9-a3e6-bff41afb8a38 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154397 Apr 07 13:23:05.679996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1144/2167] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:05 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:06.031116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-db5d28ee-781f-4d0a-aed7-16a10c198032 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:06.031741 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-db5d28ee-781f-4d0a-aed7-16a10c198032 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:06.037857 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db5d28ee-781f-4d0a-aed7-16a10c198032 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:06.038316 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db5d28ee-781f-4d0a-aed7-16a10c198032 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:06.039090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db5d28ee-781f-4d0a-aed7-16a10c198032 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:06.039545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-db5d28ee-781f-4d0a-aed7-16a10c198032 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:06.097774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-db5d28ee-781f-4d0a-aed7-16a10c198032 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:06.106156 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-db5d28ee-781f-4d0a-aed7-16a10c198032 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079120 Apr 07 13:23:06.106720 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1024/2168] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:06 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:06.137984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-30ac1002-a22f-49ee-a69e-6765f226e154 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:06.138588 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-30ac1002-a22f-49ee-a69e-6765f226e154 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:06.144779 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-30ac1002-a22f-49ee-a69e-6765f226e154 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:06.145225 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-30ac1002-a22f-49ee-a69e-6765f226e154 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:06.145973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-30ac1002-a22f-49ee-a69e-6765f226e154 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:06.146405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-30ac1002-a22f-49ee-a69e-6765f226e154 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:06.205152 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-30ac1002-a22f-49ee-a69e-6765f226e154 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:06.213274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-30ac1002-a22f-49ee-a69e-6765f226e154 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:06.215347 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-30ac1002-a22f-49ee-a69e-6765f226e154 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:06.216503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-30ac1002-a22f-49ee-a69e-6765f226e154 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082453 Apr 07 13:23:06.217054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1145/2169] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:06 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:06.696410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f0f92348-7fb7-4514-801e-5b6f0f63cd05 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:06.697052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f0f92348-7fb7-4514-801e-5b6f0f63cd05 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:06.703515 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0f92348-7fb7-4514-801e-5b6f0f63cd05 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:06.703966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0f92348-7fb7-4514-801e-5b6f0f63cd05 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:06.704772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0f92348-7fb7-4514-801e-5b6f0f63cd05 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:06.705210 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0f92348-7fb7-4514-801e-5b6f0f63cd05 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:06.837143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f0f92348-7fb7-4514-801e-5b6f0f63cd05 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:06.845862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f0f92348-7fb7-4514-801e-5b6f0f63cd05 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153291 Apr 07 13:23:06.846431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1025/2170] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:06 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:07.122974 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6751fdd3-a005-4de1-9f26-908ac3014aab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:07.123589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6751fdd3-a005-4de1-9f26-908ac3014aab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:07.129484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6751fdd3-a005-4de1-9f26-908ac3014aab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:07.129936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6751fdd3-a005-4de1-9f26-908ac3014aab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:07.130691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6751fdd3-a005-4de1-9f26-908ac3014aab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:07.131131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6751fdd3-a005-4de1-9f26-908ac3014aab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:07.189433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6751fdd3-a005-4de1-9f26-908ac3014aab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:07.197138 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6751fdd3-a005-4de1-9f26-908ac3014aab tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078518 Apr 07 13:23:07.197694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1146/2171] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:07 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:07.234796 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-61f4e697-12fb-4c94-a0a1-826478f98824 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:07.235401 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-61f4e697-12fb-4c94-a0a1-826478f98824 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:07.241620 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61f4e697-12fb-4c94-a0a1-826478f98824 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:07.242085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61f4e697-12fb-4c94-a0a1-826478f98824 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:07.242834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61f4e697-12fb-4c94-a0a1-826478f98824 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:07.243268 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61f4e697-12fb-4c94-a0a1-826478f98824 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:07.302135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-61f4e697-12fb-4c94-a0a1-826478f98824 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:07.311320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-61f4e697-12fb-4c94-a0a1-826478f98824 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:07.312830 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-61f4e697-12fb-4c94-a0a1-826478f98824 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:07.313972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-61f4e697-12fb-4c94-a0a1-826478f98824 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083060 Apr 07 13:23:07.314520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1026/2172] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:07 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:07.862818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0d035272-363a-410e-b551-b239749786e8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:07.863442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0d035272-363a-410e-b551-b239749786e8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:07.869284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0d035272-363a-410e-b551-b239749786e8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:07.869736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0d035272-363a-410e-b551-b239749786e8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:07.871348 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0d035272-363a-410e-b551-b239749786e8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:07.871625 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0d035272-363a-410e-b551-b239749786e8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:08.002601 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0d035272-363a-410e-b551-b239749786e8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:08.010284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0d035272-363a-410e-b551-b239749786e8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151358 Apr 07 13:23:08.010875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1147/2173] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:07 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:08.213848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-de28e1cc-c1d3-4477-b23f-5a83637e5d82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:08.214444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-de28e1cc-c1d3-4477-b23f-5a83637e5d82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:08.220464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-de28e1cc-c1d3-4477-b23f-5a83637e5d82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:08.220925 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-de28e1cc-c1d3-4477-b23f-5a83637e5d82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:08.221700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-de28e1cc-c1d3-4477-b23f-5a83637e5d82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:08.222145 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-de28e1cc-c1d3-4477-b23f-5a83637e5d82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:08.280937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-de28e1cc-c1d3-4477-b23f-5a83637e5d82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:08.288844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-de28e1cc-c1d3-4477-b23f-5a83637e5d82 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078913 Apr 07 13:23:08.289411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1027/2174] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:08 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:08.332181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9e126f25-aa07-48da-9d97-f14e61b57a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:08.332797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9e126f25-aa07-48da-9d97-f14e61b57a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:08.339511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e126f25-aa07-48da-9d97-f14e61b57a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:08.340104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e126f25-aa07-48da-9d97-f14e61b57a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:08.340897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e126f25-aa07-48da-9d97-f14e61b57a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:08.341338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9e126f25-aa07-48da-9d97-f14e61b57a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:08.399010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9e126f25-aa07-48da-9d97-f14e61b57a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:08.407750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9e126f25-aa07-48da-9d97-f14e61b57a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:08.409282 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9e126f25-aa07-48da-9d97-f14e61b57a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:08.410665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9e126f25-aa07-48da-9d97-f14e61b57a4b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082067 Apr 07 13:23:08.411217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1148/2175] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:08 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:09.027390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-32cfaeea-4ea1-48d6-ba7d-3791278a813a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:09.028004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-32cfaeea-4ea1-48d6-ba7d-3791278a813a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:09.034024 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32cfaeea-4ea1-48d6-ba7d-3791278a813a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:09.034486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32cfaeea-4ea1-48d6-ba7d-3791278a813a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:09.035528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32cfaeea-4ea1-48d6-ba7d-3791278a813a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:09.035970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32cfaeea-4ea1-48d6-ba7d-3791278a813a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:09.169078 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-32cfaeea-4ea1-48d6-ba7d-3791278a813a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:09.176711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-32cfaeea-4ea1-48d6-ba7d-3791278a813a tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153755 Apr 07 13:23:09.177268 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1028/2176] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:09 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:09.305866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d46147d9-8850-4c46-9102-23d001a9ec01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:09.306485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d46147d9-8850-4c46-9102-23d001a9ec01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:09.312374 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d46147d9-8850-4c46-9102-23d001a9ec01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:09.312824 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d46147d9-8850-4c46-9102-23d001a9ec01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:09.313582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d46147d9-8850-4c46-9102-23d001a9ec01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:09.314019 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d46147d9-8850-4c46-9102-23d001a9ec01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:09.372692 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d46147d9-8850-4c46-9102-23d001a9ec01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:09.380261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d46147d9-8850-4c46-9102-23d001a9ec01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078306 Apr 07 13:23:09.380812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1149/2177] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:09 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:09.429506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ce8379e9-6ce3-4c97-a9da-1e8d19bd9063 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:09.430050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ce8379e9-6ce3-4c97-a9da-1e8d19bd9063 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:09.436707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ce8379e9-6ce3-4c97-a9da-1e8d19bd9063 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:09.437237 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ce8379e9-6ce3-4c97-a9da-1e8d19bd9063 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:09.438004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ce8379e9-6ce3-4c97-a9da-1e8d19bd9063 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:09.438441 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ce8379e9-6ce3-4c97-a9da-1e8d19bd9063 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:09.496594 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ce8379e9-6ce3-4c97-a9da-1e8d19bd9063 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:09.504668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ce8379e9-6ce3-4c97-a9da-1e8d19bd9063 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:09.506147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ce8379e9-6ce3-4c97-a9da-1e8d19bd9063 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:09.507279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ce8379e9-6ce3-4c97-a9da-1e8d19bd9063 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.081649 Apr 07 13:23:09.507823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1029/2178] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:09 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:10.194270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7fde9357-62dd-4b16-bf3d-1ff565fe036e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:10.194883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7fde9357-62dd-4b16-bf3d-1ff565fe036e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:10.201439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fde9357-62dd-4b16-bf3d-1ff565fe036e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:10.201891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fde9357-62dd-4b16-bf3d-1ff565fe036e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:10.202649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fde9357-62dd-4b16-bf3d-1ff565fe036e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:10.203091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fde9357-62dd-4b16-bf3d-1ff565fe036e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:10.335089 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7fde9357-62dd-4b16-bf3d-1ff565fe036e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:10.343943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7fde9357-62dd-4b16-bf3d-1ff565fe036e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153517 Apr 07 13:23:10.344524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1150/2179] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:10 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:10.397197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-caadfb2e-3b82-43e4-8e81-75ce805195f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:10.397829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-caadfb2e-3b82-43e4-8e81-75ce805195f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:10.404192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-caadfb2e-3b82-43e4-8e81-75ce805195f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:10.404651 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-caadfb2e-3b82-43e4-8e81-75ce805195f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:10.405411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-caadfb2e-3b82-43e4-8e81-75ce805195f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:10.405846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-caadfb2e-3b82-43e4-8e81-75ce805195f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:10.462885 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-caadfb2e-3b82-43e4-8e81-75ce805195f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:10.471522 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-caadfb2e-3b82-43e4-8e81-75ce805195f5 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078139 Apr 07 13:23:10.472083 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1030/2180] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:10 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:10.526251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-77e1273f-59dc-4096-8e0f-06d9dee1c60d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:10.527550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-77e1273f-59dc-4096-8e0f-06d9dee1c60d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:10.533409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-77e1273f-59dc-4096-8e0f-06d9dee1c60d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:10.533850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-77e1273f-59dc-4096-8e0f-06d9dee1c60d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:10.534614 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-77e1273f-59dc-4096-8e0f-06d9dee1c60d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:10.535039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-77e1273f-59dc-4096-8e0f-06d9dee1c60d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:10.603063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-77e1273f-59dc-4096-8e0f-06d9dee1c60d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:10.609345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-77e1273f-59dc-4096-8e0f-06d9dee1c60d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:10.610837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-77e1273f-59dc-4096-8e0f-06d9dee1c60d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:10.611971 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-77e1273f-59dc-4096-8e0f-06d9dee1c60d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.089639 Apr 07 13:23:10.612570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1151/2181] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:10 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:11.361972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4058f3c7-fe1c-427f-8ad7-358e4270c492 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:11.362595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4058f3c7-fe1c-427f-8ad7-358e4270c492 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:11.368576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4058f3c7-fe1c-427f-8ad7-358e4270c492 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:11.369027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4058f3c7-fe1c-427f-8ad7-358e4270c492 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:11.369789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4058f3c7-fe1c-427f-8ad7-358e4270c492 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:11.370232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4058f3c7-fe1c-427f-8ad7-358e4270c492 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:11.488632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cf4e92ad-9ba8-4a38-9a4b-a2f10e09a304 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:11.489376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cf4e92ad-9ba8-4a38-9a4b-a2f10e09a304 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:11.496947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cf4e92ad-9ba8-4a38-9a4b-a2f10e09a304 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:11.497522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cf4e92ad-9ba8-4a38-9a4b-a2f10e09a304 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:11.498367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cf4e92ad-9ba8-4a38-9a4b-a2f10e09a304 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:11.498861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cf4e92ad-9ba8-4a38-9a4b-a2f10e09a304 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:11.501062 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4058f3c7-fe1c-427f-8ad7-358e4270c492 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:11.509731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4058f3c7-fe1c-427f-8ad7-358e4270c492 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.151773 Apr 07 13:23:11.510300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1031/2182] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:11 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:11.563888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cf4e92ad-9ba8-4a38-9a4b-a2f10e09a304 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:11.574876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cf4e92ad-9ba8-4a38-9a4b-a2f10e09a304 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.090053 Apr 07 13:23:11.575439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1152/2183] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:11 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:11.630474 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3c6d1ad4-818c-4c0b-a8d7-a4f6b20e8dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:11.631057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3c6d1ad4-818c-4c0b-a8d7-a4f6b20e8dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:11.638198 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c6d1ad4-818c-4c0b-a8d7-a4f6b20e8dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:11.638652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c6d1ad4-818c-4c0b-a8d7-a4f6b20e8dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:11.639420 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c6d1ad4-818c-4c0b-a8d7-a4f6b20e8dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:11.639861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c6d1ad4-818c-4c0b-a8d7-a4f6b20e8dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:11.697237 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3c6d1ad4-818c-4c0b-a8d7-a4f6b20e8dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:11.705979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3c6d1ad4-818c-4c0b-a8d7-a4f6b20e8dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:11.707466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3c6d1ad4-818c-4c0b-a8d7-a4f6b20e8dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:11.708655 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3c6d1ad4-818c-4c0b-a8d7-a4f6b20e8dc6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082282 Apr 07 13:23:11.709205 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1032/2184] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:11 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:12.530878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ab68eb01-90af-4249-8127-1e568941a2f9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:12.531488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ab68eb01-90af-4249-8127-1e568941a2f9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:12.538021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab68eb01-90af-4249-8127-1e568941a2f9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:12.538465 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab68eb01-90af-4249-8127-1e568941a2f9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:12.539216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab68eb01-90af-4249-8127-1e568941a2f9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:12.539647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ab68eb01-90af-4249-8127-1e568941a2f9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:12.590761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-54eb9e70-e3b6-41eb-865a-2f728cc0db01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:12.591391 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-54eb9e70-e3b6-41eb-865a-2f728cc0db01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:12.597912 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-54eb9e70-e3b6-41eb-865a-2f728cc0db01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:12.598370 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-54eb9e70-e3b6-41eb-865a-2f728cc0db01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:12.599182 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-54eb9e70-e3b6-41eb-865a-2f728cc0db01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:12.599635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-54eb9e70-e3b6-41eb-865a-2f728cc0db01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:12.658110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-54eb9e70-e3b6-41eb-865a-2f728cc0db01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:12.666114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-54eb9e70-e3b6-41eb-865a-2f728cc0db01 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079238 Apr 07 13:23:12.666674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1033/2185] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:12 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:12.674390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ab68eb01-90af-4249-8127-1e568941a2f9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:12.682422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ab68eb01-90af-4249-8127-1e568941a2f9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155406 Apr 07 13:23:12.683155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1153/2186] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:12 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:12.727396 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d4c0bb60-8303-48ab-908e-b605e76d9c7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:12.728223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d4c0bb60-8303-48ab-908e-b605e76d9c7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:12.734704 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d4c0bb60-8303-48ab-908e-b605e76d9c7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:12.735142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d4c0bb60-8303-48ab-908e-b605e76d9c7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:12.735909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d4c0bb60-8303-48ab-908e-b605e76d9c7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:12.736368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d4c0bb60-8303-48ab-908e-b605e76d9c7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:12.795725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d4c0bb60-8303-48ab-908e-b605e76d9c7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:12.803852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d4c0bb60-8303-48ab-908e-b605e76d9c7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:12.805364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d4c0bb60-8303-48ab-908e-b605e76d9c7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:12.806499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d4c0bb60-8303-48ab-908e-b605e76d9c7e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083593 Apr 07 13:23:12.807041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1034/2187] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:12 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:13.683625 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3fbb3bb0-b36c-4045-83c0-3a551723c5e9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:13.684256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3fbb3bb0-b36c-4045-83c0-3a551723c5e9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:13.690455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3fbb3bb0-b36c-4045-83c0-3a551723c5e9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:13.690902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3fbb3bb0-b36c-4045-83c0-3a551723c5e9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:13.691650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3fbb3bb0-b36c-4045-83c0-3a551723c5e9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:13.692080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3fbb3bb0-b36c-4045-83c0-3a551723c5e9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:13.699598 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e6402831-1e4f-45c6-b519-886d9316435e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:13.700249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e6402831-1e4f-45c6-b519-886d9316435e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:13.706650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6402831-1e4f-45c6-b519-886d9316435e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:13.707279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6402831-1e4f-45c6-b519-886d9316435e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:13.708051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6402831-1e4f-45c6-b519-886d9316435e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:13.708521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e6402831-1e4f-45c6-b519-886d9316435e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:13.750567 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3fbb3bb0-b36c-4045-83c0-3a551723c5e9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:13.758483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3fbb3bb0-b36c-4045-83c0-3a551723c5e9 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079059 Apr 07 13:23:13.759044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1154/2188] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:13 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:13.824313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5b163770-6735-4c4a-b9b2-a0090b17f6b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:13.824929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5b163770-6735-4c4a-b9b2-a0090b17f6b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:13.830615 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b163770-6735-4c4a-b9b2-a0090b17f6b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:13.831058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b163770-6735-4c4a-b9b2-a0090b17f6b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:13.831864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b163770-6735-4c4a-b9b2-a0090b17f6b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:13.832270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b163770-6735-4c4a-b9b2-a0090b17f6b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:13.843804 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e6402831-1e4f-45c6-b519-886d9316435e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:13.851716 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e6402831-1e4f-45c6-b519-886d9316435e tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.156114 Apr 07 13:23:13.852309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1035/2189] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:13 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:13.897314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5b163770-6735-4c4a-b9b2-a0090b17f6b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:13.906232 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5b163770-6735-4c4a-b9b2-a0090b17f6b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:13.907702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5b163770-6735-4c4a-b9b2-a0090b17f6b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:13.908864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5b163770-6735-4c4a-b9b2-a0090b17f6b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.088454 Apr 07 13:23:13.909411 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1155/2190] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:13 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:23:14.774800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4a7ed016-42c2-4aa7-8881-c672bbdc6103 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:14.775421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4a7ed016-42c2-4aa7-8881-c672bbdc6103 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:14.781822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4a7ed016-42c2-4aa7-8881-c672bbdc6103 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:14.782273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4a7ed016-42c2-4aa7-8881-c672bbdc6103 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:14.783052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4a7ed016-42c2-4aa7-8881-c672bbdc6103 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:14.783494 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4a7ed016-42c2-4aa7-8881-c672bbdc6103 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:14.853171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4a7ed016-42c2-4aa7-8881-c672bbdc6103 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:14.861517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4a7ed016-42c2-4aa7-8881-c672bbdc6103 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.090546 Apr 07 13:23:14.862070 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1036/2191] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:14 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:14.868800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ce3206e7-7359-4bcf-ab0d-0ae4feb12305 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:14.869414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ce3206e7-7359-4bcf-ab0d-0ae4feb12305 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:14.876527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce3206e7-7359-4bcf-ab0d-0ae4feb12305 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:14.876975 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce3206e7-7359-4bcf-ab0d-0ae4feb12305 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:14.877730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce3206e7-7359-4bcf-ab0d-0ae4feb12305 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:14.878163 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ce3206e7-7359-4bcf-ab0d-0ae4feb12305 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:14.926709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-336fd2b8-a0c1-4400-a6a4-3ea1e26bbb3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:14.927319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-336fd2b8-a0c1-4400-a6a4-3ea1e26bbb3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:14.933900 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-336fd2b8-a0c1-4400-a6a4-3ea1e26bbb3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:14.934347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-336fd2b8-a0c1-4400-a6a4-3ea1e26bbb3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:14.935300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-336fd2b8-a0c1-4400-a6a4-3ea1e26bbb3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:14.935738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-336fd2b8-a0c1-4400-a6a4-3ea1e26bbb3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:14.994662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-336fd2b8-a0c1-4400-a6a4-3ea1e26bbb3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:15.003599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-336fd2b8-a0c1-4400-a6a4-3ea1e26bbb3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:15.005119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-336fd2b8-a0c1-4400-a6a4-3ea1e26bbb3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:15.006266 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-336fd2b8-a0c1-4400-a6a4-3ea1e26bbb3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083392 Apr 07 13:23:15.006829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1037/2192] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:14 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:23:15.010519 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ce3206e7-7359-4bcf-ab0d-0ae4feb12305 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:15.018949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ce3206e7-7359-4bcf-ab0d-0ae4feb12305 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.153801 Apr 07 13:23:15.019530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1156/2193] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:14 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:15.878781 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-178bed09-f0d5-44e1-a613-47f1298da2f1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:15.879390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-178bed09-f0d5-44e1-a613-47f1298da2f1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:15.886482 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-178bed09-f0d5-44e1-a613-47f1298da2f1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:15.886915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-178bed09-f0d5-44e1-a613-47f1298da2f1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:15.887825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-178bed09-f0d5-44e1-a613-47f1298da2f1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:15.888433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-178bed09-f0d5-44e1-a613-47f1298da2f1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:15.950481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-178bed09-f0d5-44e1-a613-47f1298da2f1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:15.958184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-178bed09-f0d5-44e1-a613-47f1298da2f1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.083248 Apr 07 13:23:15.958738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1038/2194] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:15 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:16.024474 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b30c27ca-cbed-47ae-b528-09b00aca3fd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:16.025087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b30c27ca-cbed-47ae-b528-09b00aca3fd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:16.031362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b30c27ca-cbed-47ae-b528-09b00aca3fd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:16.031816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b30c27ca-cbed-47ae-b528-09b00aca3fd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:16.032605 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b30c27ca-cbed-47ae-b528-09b00aca3fd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:16.033048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b30c27ca-cbed-47ae-b528-09b00aca3fd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:16.036043 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-41e75d53-62a7-4870-9920-8dcbf8385e59 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:16.036690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-41e75d53-62a7-4870-9920-8dcbf8385e59 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:16.042423 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-41e75d53-62a7-4870-9920-8dcbf8385e59 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:16.042869 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-41e75d53-62a7-4870-9920-8dcbf8385e59 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:16.043637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-41e75d53-62a7-4870-9920-8dcbf8385e59 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:16.044072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-41e75d53-62a7-4870-9920-8dcbf8385e59 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:16.094376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b30c27ca-cbed-47ae-b528-09b00aca3fd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:16.102715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b30c27ca-cbed-47ae-b528-09b00aca3fd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:16.104249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b30c27ca-cbed-47ae-b528-09b00aca3fd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:16.105528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b30c27ca-cbed-47ae-b528-09b00aca3fd4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084985 Apr 07 13:23:16.106091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1157/2195] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:16 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:16.174799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-41e75d53-62a7-4870-9920-8dcbf8385e59 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:16.183084 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-41e75d53-62a7-4870-9920-8dcbf8385e59 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.150438 Apr 07 13:23:16.183655 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1039/2196] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:16 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:16.975058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c694afb0-a435-44cb-a800-302b5170f9fa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:16.975681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c694afb0-a435-44cb-a800-302b5170f9fa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:16.983287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c694afb0-a435-44cb-a800-302b5170f9fa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:16.983768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c694afb0-a435-44cb-a800-302b5170f9fa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:16.984587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c694afb0-a435-44cb-a800-302b5170f9fa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:16.985025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c694afb0-a435-44cb-a800-302b5170f9fa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:17.062001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c694afb0-a435-44cb-a800-302b5170f9fa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:17.070095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c694afb0-a435-44cb-a800-302b5170f9fa tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.099146 Apr 07 13:23:17.070656 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1158/2197] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:16 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:17.125922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6381edc9-7bae-49b8-beee-bf201739d796 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:17.126574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6381edc9-7bae-49b8-beee-bf201739d796 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:17.133035 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6381edc9-7bae-49b8-beee-bf201739d796 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:17.133491 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6381edc9-7bae-49b8-beee-bf201739d796 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:17.134272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6381edc9-7bae-49b8-beee-bf201739d796 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:17.134714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6381edc9-7bae-49b8-beee-bf201739d796 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:17.197252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6381edc9-7bae-49b8-beee-bf201739d796 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:17.201471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8d9ac253-b49a-45f3-a0b3-7c79b5a94ad5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:17.202098 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8d9ac253-b49a-45f3-a0b3-7c79b5a94ad5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:17.206552 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6381edc9-7bae-49b8-beee-bf201739d796 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:17.207995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d9ac253-b49a-45f3-a0b3-7c79b5a94ad5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:17.208160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6381edc9-7bae-49b8-beee-bf201739d796 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:17.208486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d9ac253-b49a-45f3-a0b3-7c79b5a94ad5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:17.209225 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6381edc9-7bae-49b8-beee-bf201739d796 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.087302 Apr 07 13:23:17.209364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d9ac253-b49a-45f3-a0b3-7c79b5a94ad5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:17.209783 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1040/2198] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:17 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:23:17.209926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8d9ac253-b49a-45f3-a0b3-7c79b5a94ad5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:17.357922 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8d9ac253-b49a-45f3-a0b3-7c79b5a94ad5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:17.365784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8d9ac253-b49a-45f3-a0b3-7c79b5a94ad5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.168781 Apr 07 13:23:17.366380 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1159/2199] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:17 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:18.089994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-61ef3d80-35b7-45a5-b316-95447e4d64d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:18.090649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-61ef3d80-35b7-45a5-b316-95447e4d64d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:18.096564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61ef3d80-35b7-45a5-b316-95447e4d64d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:18.097043 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61ef3d80-35b7-45a5-b316-95447e4d64d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:18.097834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61ef3d80-35b7-45a5-b316-95447e4d64d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:18.098275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61ef3d80-35b7-45a5-b316-95447e4d64d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:18.156808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-61ef3d80-35b7-45a5-b316-95447e4d64d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:18.165063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-61ef3d80-35b7-45a5-b316-95447e4d64d2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079555 Apr 07 13:23:18.165637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1041/2200] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:18 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:18.227271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-922a3c19-cbc2-4ef1-a167-0b28ace4459b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:18.227828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-922a3c19-cbc2-4ef1-a167-0b28ace4459b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:18.234917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-922a3c19-cbc2-4ef1-a167-0b28ace4459b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:18.235377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-922a3c19-cbc2-4ef1-a167-0b28ace4459b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:18.236178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-922a3c19-cbc2-4ef1-a167-0b28ace4459b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:18.236622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-922a3c19-cbc2-4ef1-a167-0b28ace4459b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:18.297149 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-922a3c19-cbc2-4ef1-a167-0b28ace4459b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:18.305337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-922a3c19-cbc2-4ef1-a167-0b28ace4459b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:18.306838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-922a3c19-cbc2-4ef1-a167-0b28ace4459b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:18.308057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-922a3c19-cbc2-4ef1-a167-0b28ace4459b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085055 Apr 07 13:23:18.308647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1160/2201] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:18 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:18.383022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1f95c6ce-37aa-4237-8018-f6f997b6fbbe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:18.383641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1f95c6ce-37aa-4237-8018-f6f997b6fbbe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:18.389612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f95c6ce-37aa-4237-8018-f6f997b6fbbe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:18.390066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f95c6ce-37aa-4237-8018-f6f997b6fbbe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:18.390829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f95c6ce-37aa-4237-8018-f6f997b6fbbe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:18.391268 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f95c6ce-37aa-4237-8018-f6f997b6fbbe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:18.531826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1f95c6ce-37aa-4237-8018-f6f997b6fbbe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:18.539784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1f95c6ce-37aa-4237-8018-f6f997b6fbbe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.160511 Apr 07 13:23:18.540382 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1042/2202] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:18 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:19.182975 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e8e46cf6-1918-4a40-8c20-5bbe7b504d86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:19.183507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e8e46cf6-1918-4a40-8c20-5bbe7b504d86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:19.189586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e8e46cf6-1918-4a40-8c20-5bbe7b504d86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:19.190039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e8e46cf6-1918-4a40-8c20-5bbe7b504d86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:19.190790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e8e46cf6-1918-4a40-8c20-5bbe7b504d86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:19.191220 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e8e46cf6-1918-4a40-8c20-5bbe7b504d86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:19.252352 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e8e46cf6-1918-4a40-8c20-5bbe7b504d86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:19.260279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e8e46cf6-1918-4a40-8c20-5bbe7b504d86 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081724 Apr 07 13:23:19.261219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1161/2203] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:19 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:19.326273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1a891ba1-7f00-426e-a149-f45cf84f9ff6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:19.326922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1a891ba1-7f00-426e-a149-f45cf84f9ff6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:19.333235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1a891ba1-7f00-426e-a149-f45cf84f9ff6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:19.333687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1a891ba1-7f00-426e-a149-f45cf84f9ff6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:19.334445 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1a891ba1-7f00-426e-a149-f45cf84f9ff6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:19.334886 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1a891ba1-7f00-426e-a149-f45cf84f9ff6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:19.393826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1a891ba1-7f00-426e-a149-f45cf84f9ff6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:19.402294 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1a891ba1-7f00-426e-a149-f45cf84f9ff6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:19.403774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1a891ba1-7f00-426e-a149-f45cf84f9ff6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:19.404938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1a891ba1-7f00-426e-a149-f45cf84f9ff6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083340 Apr 07 13:23:19.405744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1043/2204] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:19 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:19.556997 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d71ccc8b-e6fc-40c5-9bda-be1b7a6e52fe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:19.557554 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d71ccc8b-e6fc-40c5-9bda-be1b7a6e52fe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:19.563565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d71ccc8b-e6fc-40c5-9bda-be1b7a6e52fe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:19.564021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d71ccc8b-e6fc-40c5-9bda-be1b7a6e52fe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:19.564818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d71ccc8b-e6fc-40c5-9bda-be1b7a6e52fe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:19.565259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d71ccc8b-e6fc-40c5-9bda-be1b7a6e52fe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:19.699966 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d71ccc8b-e6fc-40c5-9bda-be1b7a6e52fe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:19.707981 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d71ccc8b-e6fc-40c5-9bda-be1b7a6e52fe tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154859 Apr 07 13:23:19.708579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1162/2205] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:19 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:20.277458 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-109bb8d2-13a4-4f92-b559-b25999f6f0f2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:20.277993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-109bb8d2-13a4-4f92-b559-b25999f6f0f2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:20.283867 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-109bb8d2-13a4-4f92-b559-b25999f6f0f2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:20.284359 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-109bb8d2-13a4-4f92-b559-b25999f6f0f2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:20.285378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-109bb8d2-13a4-4f92-b559-b25999f6f0f2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:20.285819 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-109bb8d2-13a4-4f92-b559-b25999f6f0f2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:20.344608 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-109bb8d2-13a4-4f92-b559-b25999f6f0f2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:20.352395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-109bb8d2-13a4-4f92-b559-b25999f6f0f2 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.078851 Apr 07 13:23:20.352959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1044/2206] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:20 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:20.423411 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6672198d-46f9-4a0c-89e7-f35d6816d2ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:20.424022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6672198d-46f9-4a0c-89e7-f35d6816d2ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:20.430231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6672198d-46f9-4a0c-89e7-f35d6816d2ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:20.430679 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6672198d-46f9-4a0c-89e7-f35d6816d2ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:20.431433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6672198d-46f9-4a0c-89e7-f35d6816d2ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:20.431866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6672198d-46f9-4a0c-89e7-f35d6816d2ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:20.492623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6672198d-46f9-4a0c-89e7-f35d6816d2ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:20.501800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6672198d-46f9-4a0c-89e7-f35d6816d2ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:20.503280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6672198d-46f9-4a0c-89e7-f35d6816d2ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:20.504485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6672198d-46f9-4a0c-89e7-f35d6816d2ef tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.084836 Apr 07 13:23:20.505476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1163/2207] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:20 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:20.725029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6ffe1379-12e6-4e44-a4bc-73aeaad68849 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:20.725647 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6ffe1379-12e6-4e44-a4bc-73aeaad68849 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:20.731574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6ffe1379-12e6-4e44-a4bc-73aeaad68849 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:20.732028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6ffe1379-12e6-4e44-a4bc-73aeaad68849 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:20.732820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6ffe1379-12e6-4e44-a4bc-73aeaad68849 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:20.733264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6ffe1379-12e6-4e44-a4bc-73aeaad68849 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:20.866876 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6ffe1379-12e6-4e44-a4bc-73aeaad68849 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:20.875221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6ffe1379-12e6-4e44-a4bc-73aeaad68849 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.154068 Apr 07 13:23:20.875955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1045/2208] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:20 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:21.370932 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fbaac7c1-ac52-4557-b02b-911aebe97ecc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:21.371565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fbaac7c1-ac52-4557-b02b-911aebe97ecc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:21.377534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fbaac7c1-ac52-4557-b02b-911aebe97ecc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:21.377986 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fbaac7c1-ac52-4557-b02b-911aebe97ecc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:21.378748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fbaac7c1-ac52-4557-b02b-911aebe97ecc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:21.379182 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fbaac7c1-ac52-4557-b02b-911aebe97ecc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:21.436317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fbaac7c1-ac52-4557-b02b-911aebe97ecc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:21.443910 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fbaac7c1-ac52-4557-b02b-911aebe97ecc tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.077550 Apr 07 13:23:21.444490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1164/2209] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:21 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:21.522825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eaff4b76-5200-49d0-a234-7bdc0dabb125 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:21.523584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-eaff4b76-5200-49d0-a234-7bdc0dabb125 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:21.530045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eaff4b76-5200-49d0-a234-7bdc0dabb125 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:21.530536 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eaff4b76-5200-49d0-a234-7bdc0dabb125 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:21.531306 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eaff4b76-5200-49d0-a234-7bdc0dabb125 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:21.531748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eaff4b76-5200-49d0-a234-7bdc0dabb125 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:21.590780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eaff4b76-5200-49d0-a234-7bdc0dabb125 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:21.599094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eaff4b76-5200-49d0-a234-7bdc0dabb125 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:21.600626 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eaff4b76-5200-49d0-a234-7bdc0dabb125 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:21.601822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eaff4b76-5200-49d0-a234-7bdc0dabb125 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082949 Apr 07 13:23:21.602378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1046/2210] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:21 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:21.892377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5d991d5d-01c4-447c-a968-0d95f631ffa8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:21.892994 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5d991d5d-01c4-447c-a968-0d95f631ffa8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:21.898979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5d991d5d-01c4-447c-a968-0d95f631ffa8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:21.899430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5d991d5d-01c4-447c-a968-0d95f631ffa8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:21.900217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5d991d5d-01c4-447c-a968-0d95f631ffa8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:21.900656 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5d991d5d-01c4-447c-a968-0d95f631ffa8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:22.044390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5d991d5d-01c4-447c-a968-0d95f631ffa8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:22.052207 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5d991d5d-01c4-447c-a968-0d95f631ffa8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.163736 Apr 07 13:23:22.052773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1165/2211] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:21 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:22.461175 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fb6bf1f7-cdfe-4c4a-833b-8d5750689fbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:22.461800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fb6bf1f7-cdfe-4c4a-833b-8d5750689fbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:22.468253 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb6bf1f7-cdfe-4c4a-833b-8d5750689fbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:22.468707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb6bf1f7-cdfe-4c4a-833b-8d5750689fbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:22.469467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb6bf1f7-cdfe-4c4a-833b-8d5750689fbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:22.469900 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb6bf1f7-cdfe-4c4a-833b-8d5750689fbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:22.529422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fb6bf1f7-cdfe-4c4a-833b-8d5750689fbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:22.539120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fb6bf1f7-cdfe-4c4a-833b-8d5750689fbe tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.081830 Apr 07 13:23:22.539680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1047/2212] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:22 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:22.620668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6d6c4cf1-0913-4916-be81-a815c18ed884 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:22.621308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6d6c4cf1-0913-4916-be81-a815c18ed884 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:22.627148 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d6c4cf1-0913-4916-be81-a815c18ed884 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:22.627633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d6c4cf1-0913-4916-be81-a815c18ed884 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:22.628432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d6c4cf1-0913-4916-be81-a815c18ed884 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:22.628871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6d6c4cf1-0913-4916-be81-a815c18ed884 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:22.688507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6d6c4cf1-0913-4916-be81-a815c18ed884 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:22.696709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6d6c4cf1-0913-4916-be81-a815c18ed884 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:22.698288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6d6c4cf1-0913-4916-be81-a815c18ed884 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:22.699415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6d6c4cf1-0913-4916-be81-a815c18ed884 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.083198 Apr 07 13:23:22.699973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1166/2213] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:22 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:23.069034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9a3f779b-a4f6-4d03-bf3c-dda767db7140 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:23.069658 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9a3f779b-a4f6-4d03-bf3c-dda767db7140 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 59fbdca4-9e5a-484d-a17d-bfe7f41b4860] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:23.078019 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a3f779b-a4f6-4d03-bf3c-dda767db7140 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:23.078689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a3f779b-a4f6-4d03-bf3c-dda767db7140 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:23.079901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a3f779b-a4f6-4d03-bf3c-dda767db7140 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:23.080687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a3f779b-a4f6-4d03-bf3c-dda767db7140 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:23.213281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9a3f779b-a4f6-4d03-bf3c-dda767db7140 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:23.221204 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9a3f779b-a4f6-4d03-bf3c-dda767db7140 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860" status: 200 len: 1559 microversion: 2.1 time: 0.155999 Apr 07 13:23:23.221778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1048/2214] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:23 2022] GET /compute/v2.1/servers/59fbdca4-9e5a-484d-a17d-bfe7f41b4860 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:23.556187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-34f95209-6436-4d1b-9917-584d8cb0ebe1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:23.556722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-34f95209-6436-4d1b-9917-584d8cb0ebe1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:23.563600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-34f95209-6436-4d1b-9917-584d8cb0ebe1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:23.564052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-34f95209-6436-4d1b-9917-584d8cb0ebe1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:23.564841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-34f95209-6436-4d1b-9917-584d8cb0ebe1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:23.565280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-34f95209-6436-4d1b-9917-584d8cb0ebe1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:23.623502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-34f95209-6436-4d1b-9917-584d8cb0ebe1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:23.631310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-34f95209-6436-4d1b-9917-584d8cb0ebe1 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.079108 Apr 07 13:23:23.631870 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1167/2215] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:23 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:23.717318 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8c73b736-8520-43ff-9ab2-ff1debd6b95c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:23.717935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8c73b736-8520-43ff-9ab2-ff1debd6b95c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:23.724215 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c73b736-8520-43ff-9ab2-ff1debd6b95c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:23.724665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c73b736-8520-43ff-9ab2-ff1debd6b95c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:23.725420 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c73b736-8520-43ff-9ab2-ff1debd6b95c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:23.725858 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c73b736-8520-43ff-9ab2-ff1debd6b95c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:23.783876 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8c73b736-8520-43ff-9ab2-ff1debd6b95c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:23.792893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8c73b736-8520-43ff-9ab2-ff1debd6b95c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:23.794390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8c73b736-8520-43ff-9ab2-ff1debd6b95c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:23.795526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8c73b736-8520-43ff-9ab2-ff1debd6b95c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.082039 Apr 07 13:23:23.796074 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1049/2216] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:23 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:24.648823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b083b0e9-3476-4c72-bda0-c17f51ec1338 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:24.649440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b083b0e9-3476-4c72-bda0-c17f51ec1338 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] [instance: 926785df-7955-4e58-a0ae-dc896b2b3f2c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:24.656526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b083b0e9-3476-4c72-bda0-c17f51ec1338 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:24.656976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b083b0e9-3476-4c72-bda0-c17f51ec1338 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:24.657739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b083b0e9-3476-4c72-bda0-c17f51ec1338 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:24.658176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b083b0e9-3476-4c72-bda0-c17f51ec1338 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:24.720165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b083b0e9-3476-4c72-bda0-c17f51ec1338 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e1e692e6f7454da7d5e40bd049132f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c0e24f0394eef8804893e1ca3f91b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:24.727848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b083b0e9-3476-4c72-bda0-c17f51ec1338 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c" status: 200 len: 1389 microversion: 2.1 time: 0.082869 Apr 07 13:23:24.728446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1168/2217] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:24 2022] GET /compute/v2.1/servers/926785df-7955-4e58-a0ae-dc896b2b3f2c => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:24.743873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bdb83ccd-f2ac-4a0d-bbe8-9d7f22080834 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] Calling method '.version_select at 0x7fde58797dc0>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:24.764023 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bdb83ccd-f2ac-4a0d-bbe8-9d7f22080834 tempest-TestMinimumBasicScenario-1660784968 tempest-TestMinimumBasicScenario-1660784968-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1818995414" status: 202 len: 0 microversion: 2.1 time: 0.023880 Apr 07 13:23:24.764607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1050/2218] 10.222.0.15 () {58 vars in 1271 bytes} [Thu Apr 7 13:23:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1818995414 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:23:24.813198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d30536f1-7d4f-49a9-95ef-b1cfeab9a57e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:24.813816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d30536f1-7d4f-49a9-95ef-b1cfeab9a57e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:24.819604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d30536f1-7d4f-49a9-95ef-b1cfeab9a57e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:24.820058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d30536f1-7d4f-49a9-95ef-b1cfeab9a57e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:24.820862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d30536f1-7d4f-49a9-95ef-b1cfeab9a57e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:24.821301 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d30536f1-7d4f-49a9-95ef-b1cfeab9a57e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:24.882555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d30536f1-7d4f-49a9-95ef-b1cfeab9a57e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:24.891897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d30536f1-7d4f-49a9-95ef-b1cfeab9a57e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:24.893453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d30536f1-7d4f-49a9-95ef-b1cfeab9a57e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:24.894594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d30536f1-7d4f-49a9-95ef-b1cfeab9a57e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.085307 Apr 07 13:23:24.895170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1169/2219] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:24 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:25.913603 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d0d6ef59-03bc-47be-9f65-73ace67d2c0b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:25.921869 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d0d6ef59-03bc-47be-9f65-73ace67d2c0b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:25.928589 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0d6ef59-03bc-47be-9f65-73ace67d2c0b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:25.929056 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0d6ef59-03bc-47be-9f65-73ace67d2c0b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:25.929894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0d6ef59-03bc-47be-9f65-73ace67d2c0b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:25.930403 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0d6ef59-03bc-47be-9f65-73ace67d2c0b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:25.999687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d0d6ef59-03bc-47be-9f65-73ace67d2c0b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:26.008570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d0d6ef59-03bc-47be-9f65-73ace67d2c0b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:26.010047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d0d6ef59-03bc-47be-9f65-73ace67d2c0b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:26.011921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d0d6ef59-03bc-47be-9f65-73ace67d2c0b tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 200 len: 1444 microversion: 2.20 time: 0.103007 Apr 07 13:23:26.012695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1051/2220] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:25 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:26.030561 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bd95d4b2-9261-4d2d-8f0b-6c04354ca7f0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '.version_select at 0x7fde583a0ee0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:26.052456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bd95d4b2-9261-4d2d-8f0b-6c04354ca7f0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1737221470" status: 204 len: 0 microversion: 2.20 time: 0.026302 Apr 07 13:23:26.053320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1170/2221] 10.222.0.15 () {60 vars in 1261 bytes} [Thu Apr 7 13:23:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1737221470 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 07 13:23:26.900672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-598ffeb8-17a6-4558-b60b-f1c096f028d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Action: 'create', calling method: .version_select at 0x7fde5cd88f70>, body: {"keypair": {"name": "tempest-keypair-182696521"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:23:26.925612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-598ffeb8-17a6-4558-b60b-f1c096f028d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Getting quotas for project 5bd01388259c4fe2be6df63ac77c05c1. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:23:26.929859 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-598ffeb8-17a6-4558-b60b-f1c096f028d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Getting quotas for user e1417845e6994b12a81febfff5e63ce2 and project 5bd01388259c4fe2be6df63ac77c05c1. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:23:27.325514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-598ffeb8-17a6-4558-b60b-f1c096f028d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Getting quotas for project 5bd01388259c4fe2be6df63ac77c05c1. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:23:27.329410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-598ffeb8-17a6-4558-b60b-f1c096f028d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Getting quotas for user e1417845e6994b12a81febfff5e63ce2 and project 5bd01388259c4fe2be6df63ac77c05c1. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:23:27.343306 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-598ffeb8-17a6-4558-b60b-f1c096f028d8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.446559 Apr 07 13:23:27.344090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1052/2222] 10.222.0.15 () {62 vars in 1198 bytes} [Thu Apr 7 13:23:26 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 448 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 07 13:23:28.205722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-26e2761d-108d-4794-ace6-b7fcb6f8caa3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:28.210726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-26e2761d-108d-4794-ace6-b7fcb6f8caa3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:28.217817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-26e2761d-108d-4794-ace6-b7fcb6f8caa3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:28.218379 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-26e2761d-108d-4794-ace6-b7fcb6f8caa3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:28.219352 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-26e2761d-108d-4794-ace6-b7fcb6f8caa3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:28.219881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-26e2761d-108d-4794-ace6-b7fcb6f8caa3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:28.244862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-26e2761d-108d-4794-ace6-b7fcb6f8caa3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:23:28.344119 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-26e2761d-108d-4794-ace6-b7fcb6f8caa3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 204 len: 0 microversion: 2.1 time: 0.142813 Apr 07 13:23:28.345137 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1171/2223] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:23:28 2022] DELETE /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:23:28.353234 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-81ee5f2f-fbde-431f-a35b-62f3adffee5f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:28.354361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-81ee5f2f-fbde-431f-a35b-62f3adffee5f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:28.361413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81ee5f2f-fbde-431f-a35b-62f3adffee5f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:28.361874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81ee5f2f-fbde-431f-a35b-62f3adffee5f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:28.362655 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81ee5f2f-fbde-431f-a35b-62f3adffee5f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:28.363101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81ee5f2f-fbde-431f-a35b-62f3adffee5f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:28.621754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-81ee5f2f-fbde-431f-a35b-62f3adffee5f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:28.643944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-81ee5f2f-fbde-431f-a35b-62f3adffee5f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.294879 Apr 07 13:23:28.647554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1053/2224] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:28 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:29.058018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-335320559", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0e470bc-57ea-4197-b4ec-4fc63c4ef6b2"}], "security_groups": [{"name": "tempest-securitygroup--315046670"}], "key_name": "tempest-keypair-182696521", "user_data": "}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:23:29.189634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.network.neutron [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] validate_networks() for [('f0e470bc-57ea-4197-b4ec-4fc63c4ef6b2', None, None, None, None, None)] {{(pid=116893) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 13:23:29.665071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-16b20dba-642a-4719-ac72-f0ebee03c4e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:29.665977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-16b20dba-642a-4719-ac72-f0ebee03c4e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:29.673961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-16b20dba-642a-4719-ac72-f0ebee03c4e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:29.674417 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-16b20dba-642a-4719-ac72-f0ebee03c4e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:29.675211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-16b20dba-642a-4719-ac72-f0ebee03c4e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:29.675660 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-16b20dba-642a-4719-ac72-f0ebee03c4e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:29.897348 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Flavor limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 13:23:29.897857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Image limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 13:23:29.898233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Flavor pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 13:23:29.898646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Image pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 13:23:29.899062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 13:23:29.908419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:29.908870 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:29.909665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:29.910357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:29.926705 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Getting quotas for project 5bd01388259c4fe2be6df63ac77c05c1. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:23:29.930492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Getting quotas for user e1417845e6994b12a81febfff5e63ce2 and project 5bd01388259c4fe2be6df63ac77c05c1. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:23:29.941714 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Going to run 1 instances... {{(pid=116893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 13:23:29.944170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 13:23:29.965692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-16b20dba-642a-4719-ac72-f0ebee03c4e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:29.977264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-16b20dba-642a-4719-ac72-f0ebee03c4e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.315515 Apr 07 13:23:29.978827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1054/2225] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:29 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:30.008785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9aae4c5f-5f6a-4085-9547-c276b1c490bf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.957489 Apr 07 13:23:30.009753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1172/2226] 10.222.0.15 () {62 vars in 1187 bytes} [Thu Apr 7 13:23:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 07 13:23:30.022833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-084d1393-e747-49cd-aabc-648d82ece4d4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:30.023715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-084d1393-e747-49cd-aabc-648d82ece4d4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:30.105641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-084d1393-e747-49cd-aabc-648d82ece4d4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:30.112880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-084d1393-e747-49cd-aabc-648d82ece4d4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:30.114435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-084d1393-e747-49cd-aabc-648d82ece4d4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:30.115533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-084d1393-e747-49cd-aabc-648d82ece4d4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1280 microversion: 2.20 time: 0.096539 Apr 07 13:23:30.116077 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1055/2227] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:30 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:30.997144 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-27860536-cd8d-49ea-b1c8-a1f27024496b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:30.998441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-27860536-cd8d-49ea-b1c8-a1f27024496b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:31.006672 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27860536-cd8d-49ea-b1c8-a1f27024496b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:31.007493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27860536-cd8d-49ea-b1c8-a1f27024496b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:31.008550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27860536-cd8d-49ea-b1c8-a1f27024496b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:31.009220 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27860536-cd8d-49ea-b1c8-a1f27024496b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:31.134127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9c6f8241-271f-469d-90c5-e7ce0e80d18a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:31.135606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9c6f8241-271f-469d-90c5-e7ce0e80d18a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:31.154160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c6f8241-271f-469d-90c5-e7ce0e80d18a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:31.154642 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c6f8241-271f-469d-90c5-e7ce0e80d18a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:31.155436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c6f8241-271f-469d-90c5-e7ce0e80d18a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:31.155882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9c6f8241-271f-469d-90c5-e7ce0e80d18a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:31.233438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9c6f8241-271f-469d-90c5-e7ce0e80d18a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:31.243790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9c6f8241-271f-469d-90c5-e7ce0e80d18a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:31.247765 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9c6f8241-271f-469d-90c5-e7ce0e80d18a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:31.249543 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9c6f8241-271f-469d-90c5-e7ce0e80d18a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1350 microversion: 2.20 time: 0.120867 Apr 07 13:23:31.250740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1056/2228] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:31 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:31.415209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-27860536-cd8d-49ea-b1c8-a1f27024496b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:31.423240 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-27860536-cd8d-49ea-b1c8-a1f27024496b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.430672 Apr 07 13:23:31.424270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1173/2229] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:30 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:32.270150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f280b1fc-1df1-4fe3-877c-fc3b4349930a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:32.270710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f280b1fc-1df1-4fe3-877c-fc3b4349930a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:32.277177 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f280b1fc-1df1-4fe3-877c-fc3b4349930a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:32.277649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f280b1fc-1df1-4fe3-877c-fc3b4349930a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:32.278409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f280b1fc-1df1-4fe3-877c-fc3b4349930a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:32.278848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f280b1fc-1df1-4fe3-877c-fc3b4349930a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:32.442028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-afd76408-447c-4e9a-a3ec-92f6daf6d32d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:32.443403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-afd76408-447c-4e9a-a3ec-92f6daf6d32d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:32.454653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f280b1fc-1df1-4fe3-877c-fc3b4349930a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:32.454901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afd76408-447c-4e9a-a3ec-92f6daf6d32d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:32.455360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afd76408-447c-4e9a-a3ec-92f6daf6d32d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:32.456131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afd76408-447c-4e9a-a3ec-92f6daf6d32d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:32.456624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afd76408-447c-4e9a-a3ec-92f6daf6d32d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:32.466750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f280b1fc-1df1-4fe3-877c-fc3b4349930a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:32.469628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f280b1fc-1df1-4fe3-877c-fc3b4349930a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:32.471213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f280b1fc-1df1-4fe3-877c-fc3b4349930a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1405 microversion: 2.20 time: 0.204952 Apr 07 13:23:32.473048 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1057/2230] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:32 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:32.831844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-afd76408-447c-4e9a-a3ec-92f6daf6d32d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:32.840489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-afd76408-447c-4e9a-a3ec-92f6daf6d32d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.402447 Apr 07 13:23:32.841050 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1174/2231] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:33.494392 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b8b67843-e720-4107-bceb-859273d37d32 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:33.495063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b8b67843-e720-4107-bceb-859273d37d32 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:33.515335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b8b67843-e720-4107-bceb-859273d37d32 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:33.517151 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b8b67843-e720-4107-bceb-859273d37d32 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:33.520402 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b8b67843-e720-4107-bceb-859273d37d32 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:33.520886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b8b67843-e720-4107-bceb-859273d37d32 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:33.586483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-b85d5eb9-1823-4719-a507-89c5257a5164 req-d612466c-ccb9-4741-bd17-0feda3bdc14b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac028ff8-ee5a-47e9-80b2-6633beac4e3f", "tag": "10915de2-db85-43a4-a04e-e11c60542301"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:23:33.611632 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-b85d5eb9-1823-4719-a507-89c5257a5164 req-d612466c-ccb9-4741-bd17-0feda3bdc14b service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:33.612318 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-b85d5eb9-1823-4719-a507-89c5257a5164 req-d612466c-ccb9-4741-bd17-0feda3bdc14b service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:33.625689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-b85d5eb9-1823-4719-a507-89c5257a5164 req-d612466c-ccb9-4741-bd17-0feda3bdc14b service nova] Creating event network-changed:10915de2-db85-43a4-a04e-e11c60542301 for instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f on hv-cinder-83694 Apr 07 13:23:33.633468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-b85d5eb9-1823-4719-a507-89c5257a5164 req-d612466c-ccb9-4741-bd17-0feda3bdc14b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167719 Apr 07 13:23:33.634738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1058/2232] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:23:33.795345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b8b67843-e720-4107-bceb-859273d37d32 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:33.814554 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b8b67843-e720-4107-bceb-859273d37d32 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:33.817332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b8b67843-e720-4107-bceb-859273d37d32 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:33.820338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b8b67843-e720-4107-bceb-859273d37d32 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1405 microversion: 2.20 time: 0.333446 Apr 07 13:23:33.822902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1175/2233] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:33 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1405 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:23:33.857957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cf787371-fb18-4be8-a33b-4d13accaa988 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:33.858810 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cf787371-fb18-4be8-a33b-4d13accaa988 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:33.865344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf787371-fb18-4be8-a33b-4d13accaa988 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:33.865936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf787371-fb18-4be8-a33b-4d13accaa988 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:33.866794 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf787371-fb18-4be8-a33b-4d13accaa988 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:33.867344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cf787371-fb18-4be8-a33b-4d13accaa988 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:34.062169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cf787371-fb18-4be8-a33b-4d13accaa988 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:34.070744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cf787371-fb18-4be8-a33b-4d13accaa988 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.216928 Apr 07 13:23:34.071677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1059/2234] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:33 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:34.840715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-451abc5d-57e7-4c97-995f-6290c35b8157 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:34.841336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-451abc5d-57e7-4c97-995f-6290c35b8157 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:34.849990 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-451abc5d-57e7-4c97-995f-6290c35b8157 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:34.850442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-451abc5d-57e7-4c97-995f-6290c35b8157 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:34.851224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-451abc5d-57e7-4c97-995f-6290c35b8157 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:34.851963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-451abc5d-57e7-4c97-995f-6290c35b8157 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:35.089185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-350ea95c-da96-42b0-bf73-628d0f77ea70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:35.089811 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-350ea95c-da96-42b0-bf73-628d0f77ea70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:35.096061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-350ea95c-da96-42b0-bf73-628d0f77ea70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:35.096545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-350ea95c-da96-42b0-bf73-628d0f77ea70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:35.097311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-350ea95c-da96-42b0-bf73-628d0f77ea70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:35.097746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-350ea95c-da96-42b0-bf73-628d0f77ea70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:35.110286 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-451abc5d-57e7-4c97-995f-6290c35b8157 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:35.119759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-451abc5d-57e7-4c97-995f-6290c35b8157 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:35.121370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-451abc5d-57e7-4c97-995f-6290c35b8157 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:35.122594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-451abc5d-57e7-4c97-995f-6290c35b8157 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1405 microversion: 2.20 time: 0.287617 Apr 07 13:23:35.128878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1176/2235] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:34 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1405 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:35.233844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-350ea95c-da96-42b0-bf73-628d0f77ea70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:35.241757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-350ea95c-da96-42b0-bf73-628d0f77ea70 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157099 Apr 07 13:23:35.242321 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1060/2236] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:35 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:36.140337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d70cff1a-9f6e-4089-b1e1-6e028e74c786 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:36.140977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d70cff1a-9f6e-4089-b1e1-6e028e74c786 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:36.147250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d70cff1a-9f6e-4089-b1e1-6e028e74c786 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:36.147702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d70cff1a-9f6e-4089-b1e1-6e028e74c786 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:36.148487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d70cff1a-9f6e-4089-b1e1-6e028e74c786 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:36.148925 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d70cff1a-9f6e-4089-b1e1-6e028e74c786 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:36.258628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f1b6b6e4-283b-444b-8038-4feb2567a38e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:36.259267 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f1b6b6e4-283b-444b-8038-4feb2567a38e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:36.265674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1b6b6e4-283b-444b-8038-4feb2567a38e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:36.266126 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1b6b6e4-283b-444b-8038-4feb2567a38e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:36.266892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1b6b6e4-283b-444b-8038-4feb2567a38e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:36.267329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f1b6b6e4-283b-444b-8038-4feb2567a38e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:36.282921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d70cff1a-9f6e-4089-b1e1-6e028e74c786 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:36.290907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d70cff1a-9f6e-4089-b1e1-6e028e74c786 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:36.293023 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d70cff1a-9f6e-4089-b1e1-6e028e74c786 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:36.294133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d70cff1a-9f6e-4089-b1e1-6e028e74c786 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1405 microversion: 2.20 time: 0.157653 Apr 07 13:23:36.294681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1177/2237] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:36 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:36.396247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f1b6b6e4-283b-444b-8038-4feb2567a38e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:36.404727 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f1b6b6e4-283b-444b-8038-4feb2567a38e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149927 Apr 07 13:23:36.405290 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1061/2238] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:36 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:37.311750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9a0596c6-93de-4a49-ba27-47b32801d09e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:37.312386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9a0596c6-93de-4a49-ba27-47b32801d09e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:37.318541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a0596c6-93de-4a49-ba27-47b32801d09e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:37.318986 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a0596c6-93de-4a49-ba27-47b32801d09e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:37.319771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a0596c6-93de-4a49-ba27-47b32801d09e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:37.320228 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9a0596c6-93de-4a49-ba27-47b32801d09e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:37.454407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9a0596c6-93de-4a49-ba27-47b32801d09e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:37.467920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9a0596c6-93de-4a49-ba27-47b32801d09e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:37.469440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9a0596c6-93de-4a49-ba27-47b32801d09e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:37.470548 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9a0596c6-93de-4a49-ba27-47b32801d09e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1405 microversion: 2.20 time: 0.162626 Apr 07 13:23:37.472370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1178/2239] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:37 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:37.667468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5f8101ce-6524-49c7-b6ee-e6e0bea56da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:37.668117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5f8101ce-6524-49c7-b6ee-e6e0bea56da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:37.673933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f8101ce-6524-49c7-b6ee-e6e0bea56da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:37.674381 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f8101ce-6524-49c7-b6ee-e6e0bea56da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:37.675145 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f8101ce-6524-49c7-b6ee-e6e0bea56da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:37.675581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f8101ce-6524-49c7-b6ee-e6e0bea56da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:37.813746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5f8101ce-6524-49c7-b6ee-e6e0bea56da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:37.821481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5f8101ce-6524-49c7-b6ee-e6e0bea56da0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.403914 Apr 07 13:23:37.822098 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1062/2240] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:38.489739 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9f14d6af-c8fc-41b4-ae76-b39b22600966 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:38.490356 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9f14d6af-c8fc-41b4-ae76-b39b22600966 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:38.496952 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9f14d6af-c8fc-41b4-ae76-b39b22600966 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:38.497407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9f14d6af-c8fc-41b4-ae76-b39b22600966 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:38.498178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9f14d6af-c8fc-41b4-ae76-b39b22600966 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:38.498616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9f14d6af-c8fc-41b4-ae76-b39b22600966 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:38.633841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9f14d6af-c8fc-41b4-ae76-b39b22600966 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:38.642023 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9f14d6af-c8fc-41b4-ae76-b39b22600966 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:38.643505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9f14d6af-c8fc-41b4-ae76-b39b22600966 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:38.644636 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9f14d6af-c8fc-41b4-ae76-b39b22600966 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1405 microversion: 2.20 time: 0.158814 Apr 07 13:23:38.645183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1179/2241] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:38 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:38.839460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d0bd9e1d-2d5c-41b9-a8b8-e478bfb5ee76 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:38.840030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d0bd9e1d-2d5c-41b9-a8b8-e478bfb5ee76 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:38.846370 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0bd9e1d-2d5c-41b9-a8b8-e478bfb5ee76 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:38.846824 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0bd9e1d-2d5c-41b9-a8b8-e478bfb5ee76 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:38.847591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0bd9e1d-2d5c-41b9-a8b8-e478bfb5ee76 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:38.848026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d0bd9e1d-2d5c-41b9-a8b8-e478bfb5ee76 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:38.977060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d0bd9e1d-2d5c-41b9-a8b8-e478bfb5ee76 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:38.984820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d0bd9e1d-2d5c-41b9-a8b8-e478bfb5ee76 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149913 Apr 07 13:23:38.985384 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1063/2242] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:39.510025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-15b2fb2b-7329-4965-b972-c636fe710760 req-e00138be-45a5-4319-ac41-d126fd5b0b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac028ff8-ee5a-47e9-80b2-6633beac4e3f", "name": "network-vif-plugged", "status": "completed", "tag": "10915de2-db85-43a4-a04e-e11c60542301"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:23:39.518504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-15b2fb2b-7329-4965-b972-c636fe710760 req-e00138be-45a5-4319-ac41-d126fd5b0b9b service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:39.518953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-15b2fb2b-7329-4965-b972-c636fe710760 req-e00138be-45a5-4319-ac41-d126fd5b0b9b service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:39.529593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-15b2fb2b-7329-4965-b972-c636fe710760 req-e00138be-45a5-4319-ac41-d126fd5b0b9b service nova] Creating event network-vif-plugged:10915de2-db85-43a4-a04e-e11c60542301 for instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f on hv-cinder-83694 Apr 07 13:23:39.534526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-15b2fb2b-7329-4965-b972-c636fe710760 req-e00138be-45a5-4319-ac41-d126fd5b0b9b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089810 Apr 07 13:23:39.535375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1180/2243] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:23:39.663586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f9e222f4-d334-460e-ac83-f956aa362e9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:39.664365 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f9e222f4-d334-460e-ac83-f956aa362e9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:39.671205 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f9e222f4-d334-460e-ac83-f956aa362e9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:39.671602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f9e222f4-d334-460e-ac83-f956aa362e9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:39.672413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f9e222f4-d334-460e-ac83-f956aa362e9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:39.672860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f9e222f4-d334-460e-ac83-f956aa362e9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:39.817232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f9e222f4-d334-460e-ac83-f956aa362e9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:39.825667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f9e222f4-d334-460e-ac83-f956aa362e9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:39.827216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f9e222f4-d334-460e-ac83-f956aa362e9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:39.828398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f9e222f4-d334-460e-ac83-f956aa362e9a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1405 microversion: 2.20 time: 0.169100 Apr 07 13:23:39.828970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1064/2244] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:39 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:40.002514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2876e22e-c451-4bf9-bc62-fbe622ffe061 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:40.003215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2876e22e-c451-4bf9-bc62-fbe622ffe061 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:40.009209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2876e22e-c451-4bf9-bc62-fbe622ffe061 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:40.009665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2876e22e-c451-4bf9-bc62-fbe622ffe061 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:40.011007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2876e22e-c451-4bf9-bc62-fbe622ffe061 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:40.011449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2876e22e-c451-4bf9-bc62-fbe622ffe061 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:40.140044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2876e22e-c451-4bf9-bc62-fbe622ffe061 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:40.147752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2876e22e-c451-4bf9-bc62-fbe622ffe061 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149656 Apr 07 13:23:40.148340 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1181/2245] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:39 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:40.847126 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8d216e14-90f5-40b9-bc26-d7fc229e9f15 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:40.847706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8d216e14-90f5-40b9-bc26-d7fc229e9f15 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:40.855270 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d216e14-90f5-40b9-bc26-d7fc229e9f15 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:40.855721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d216e14-90f5-40b9-bc26-d7fc229e9f15 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:40.856548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d216e14-90f5-40b9-bc26-d7fc229e9f15 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:40.856987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8d216e14-90f5-40b9-bc26-d7fc229e9f15 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:40.988426 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8d216e14-90f5-40b9-bc26-d7fc229e9f15 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:40.996088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8d216e14-90f5-40b9-bc26-d7fc229e9f15 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:40.997608 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8d216e14-90f5-40b9-bc26-d7fc229e9f15 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:40.998724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8d216e14-90f5-40b9-bc26-d7fc229e9f15 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1405 microversion: 2.20 time: 0.155656 Apr 07 13:23:40.999275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1065/2246] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:40 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:41.164186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e76bafbd-df8f-40d5-8831-7f460094c65c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:41.164813 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e76bafbd-df8f-40d5-8831-7f460094c65c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:41.171292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e76bafbd-df8f-40d5-8831-7f460094c65c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:41.171749 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e76bafbd-df8f-40d5-8831-7f460094c65c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:41.172549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e76bafbd-df8f-40d5-8831-7f460094c65c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:41.172993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e76bafbd-df8f-40d5-8831-7f460094c65c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:41.303297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e76bafbd-df8f-40d5-8831-7f460094c65c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:41.311495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e76bafbd-df8f-40d5-8831-7f460094c65c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151409 Apr 07 13:23:41.312061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1182/2247] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:41 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:42.018374 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5be2cb5b-35e8-47ab-87eb-504a672b1779 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:42.019804 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5be2cb5b-35e8-47ab-87eb-504a672b1779 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:42.030850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5be2cb5b-35e8-47ab-87eb-504a672b1779 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:42.031300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5be2cb5b-35e8-47ab-87eb-504a672b1779 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:42.032070 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5be2cb5b-35e8-47ab-87eb-504a672b1779 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:42.032531 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5be2cb5b-35e8-47ab-87eb-504a672b1779 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:42.162420 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5be2cb5b-35e8-47ab-87eb-504a672b1779 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:42.170233 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5be2cb5b-35e8-47ab-87eb-504a672b1779 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:42.171713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5be2cb5b-35e8-47ab-87eb-504a672b1779 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:42.172906 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5be2cb5b-35e8-47ab-87eb-504a672b1779 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1596 microversion: 2.20 time: 0.159727 Apr 07 13:23:42.173454 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1066/2248] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:23:42 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1596 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:23:42.190458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-42893180-2dd3-4af4-b3b9-cfdeeaf54478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:42.190974 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-42893180-2dd3-4af4-b3b9-cfdeeaf54478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:42.198077 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-42893180-2dd3-4af4-b3b9-cfdeeaf54478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:42.198622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-42893180-2dd3-4af4-b3b9-cfdeeaf54478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:42.199393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-42893180-2dd3-4af4-b3b9-cfdeeaf54478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:42.199834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-42893180-2dd3-4af4-b3b9-cfdeeaf54478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:42.281674 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-42893180-2dd3-4af4-b3b9-cfdeeaf54478 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095080 Apr 07 13:23:42.282334 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1183/2249] 10.222.0.15 () {60 vars in 1315 bytes} [Thu Apr 7 13:23:42 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:23:42.329171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ff66f955-c8b8-4e69-a229-5d3cfd242c2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:42.329823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ff66f955-c8b8-4e69-a229-5d3cfd242c2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:42.335670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff66f955-c8b8-4e69-a229-5d3cfd242c2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:42.336131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff66f955-c8b8-4e69-a229-5d3cfd242c2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:42.336933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff66f955-c8b8-4e69-a229-5d3cfd242c2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:42.337375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff66f955-c8b8-4e69-a229-5d3cfd242c2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:42.473509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ff66f955-c8b8-4e69-a229-5d3cfd242c2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:42.482444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ff66f955-c8b8-4e69-a229-5d3cfd242c2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157055 Apr 07 13:23:42.483031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1067/2250] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:42 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:43.242898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-1d82dcc4-ac7a-4521-b05d-300d0447e29f req-2b232707-6997-4a71-acc4-d0a0bdd33d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac028ff8-ee5a-47e9-80b2-6633beac4e3f", "tag": "10915de2-db85-43a4-a04e-e11c60542301"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:23:43.251387 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-1d82dcc4-ac7a-4521-b05d-300d0447e29f req-2b232707-6997-4a71-acc4-d0a0bdd33d6c service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:43.251844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-1d82dcc4-ac7a-4521-b05d-300d0447e29f req-2b232707-6997-4a71-acc4-d0a0bdd33d6c service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:43.263600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-1d82dcc4-ac7a-4521-b05d-300d0447e29f req-2b232707-6997-4a71-acc4-d0a0bdd33d6c service nova] Creating event network-changed:10915de2-db85-43a4-a04e-e11c60542301 for instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f on hv-cinder-83694 Apr 07 13:23:43.268640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-1d82dcc4-ac7a-4521-b05d-300d0447e29f req-2b232707-6997-4a71-acc4-d0a0bdd33d6c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029808 Apr 07 13:23:43.269245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1184/2251] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:23:43.499484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ce35bce8-4e27-4dae-8e23-39c8b62e4659 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:43.500113 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ce35bce8-4e27-4dae-8e23-39c8b62e4659 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:43.506637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ce35bce8-4e27-4dae-8e23-39c8b62e4659 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:43.507102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ce35bce8-4e27-4dae-8e23-39c8b62e4659 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:43.507895 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ce35bce8-4e27-4dae-8e23-39c8b62e4659 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:43.508367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ce35bce8-4e27-4dae-8e23-39c8b62e4659 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:43.652174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ce35bce8-4e27-4dae-8e23-39c8b62e4659 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:43.659983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ce35bce8-4e27-4dae-8e23-39c8b62e4659 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.164752 Apr 07 13:23:43.664337 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1068/2252] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:43 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:44.678491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a21e072e-2618-44ca-a330-8cbfa4984ff2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:44.679200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a21e072e-2618-44ca-a330-8cbfa4984ff2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:44.685555 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a21e072e-2618-44ca-a330-8cbfa4984ff2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:44.686012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a21e072e-2618-44ca-a330-8cbfa4984ff2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:44.686794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a21e072e-2618-44ca-a330-8cbfa4984ff2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:44.687215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a21e072e-2618-44ca-a330-8cbfa4984ff2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:44.819441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a21e072e-2618-44ca-a330-8cbfa4984ff2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:44.827752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a21e072e-2618-44ca-a330-8cbfa4984ff2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153877 Apr 07 13:23:44.828340 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1185/2253] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:44 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:45.844681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8620418d-12dd-415a-ae1e-3ad180b29aaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:45.845239 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8620418d-12dd-415a-ae1e-3ad180b29aaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:45.851508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8620418d-12dd-415a-ae1e-3ad180b29aaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:45.851961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8620418d-12dd-415a-ae1e-3ad180b29aaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:45.852751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8620418d-12dd-415a-ae1e-3ad180b29aaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:45.853193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8620418d-12dd-415a-ae1e-3ad180b29aaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:45.991551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8620418d-12dd-415a-ae1e-3ad180b29aaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:46.000017 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8620418d-12dd-415a-ae1e-3ad180b29aaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.159213 Apr 07 13:23:46.000863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1069/2254] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:45 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:47.017998 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3d53095b-d21a-4f50-b907-e9f4c33cf57c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:47.018608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3d53095b-d21a-4f50-b907-e9f4c33cf57c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:47.024900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d53095b-d21a-4f50-b907-e9f4c33cf57c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:47.025345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d53095b-d21a-4f50-b907-e9f4c33cf57c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:47.026100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d53095b-d21a-4f50-b907-e9f4c33cf57c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:47.026534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3d53095b-d21a-4f50-b907-e9f4c33cf57c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:47.155154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3d53095b-d21a-4f50-b907-e9f4c33cf57c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:47.163162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3d53095b-d21a-4f50-b907-e9f4c33cf57c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149016 Apr 07 13:23:47.163727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1186/2255] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:47 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:48.180409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7c2f9894-efd2-44e4-87dd-7639dd8a25b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:48.181018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7c2f9894-efd2-44e4-87dd-7639dd8a25b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:48.187792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7c2f9894-efd2-44e4-87dd-7639dd8a25b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:48.188296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7c2f9894-efd2-44e4-87dd-7639dd8a25b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:48.189055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7c2f9894-efd2-44e4-87dd-7639dd8a25b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:48.189492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7c2f9894-efd2-44e4-87dd-7639dd8a25b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:48.319462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7c2f9894-efd2-44e4-87dd-7639dd8a25b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:48.327796 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7c2f9894-efd2-44e4-87dd-7639dd8a25b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151303 Apr 07 13:23:48.328402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1070/2256] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:48 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:49.344485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f57abfc7-16ab-4cf3-9655-b71912076558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:49.345102 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f57abfc7-16ab-4cf3-9655-b71912076558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:49.351350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f57abfc7-16ab-4cf3-9655-b71912076558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:49.351799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f57abfc7-16ab-4cf3-9655-b71912076558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:49.352594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f57abfc7-16ab-4cf3-9655-b71912076558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:49.353034 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f57abfc7-16ab-4cf3-9655-b71912076558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:49.480213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f57abfc7-16ab-4cf3-9655-b71912076558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:49.487876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f57abfc7-16ab-4cf3-9655-b71912076558 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.147164 Apr 07 13:23:49.488465 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1187/2257] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:49 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:23:50.505081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e93cb31c-4532-42f8-b896-79fa22249d89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:50.505731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e93cb31c-4532-42f8-b896-79fa22249d89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:50.512103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e93cb31c-4532-42f8-b896-79fa22249d89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:50.512589 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e93cb31c-4532-42f8-b896-79fa22249d89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:50.513355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e93cb31c-4532-42f8-b896-79fa22249d89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:50.513797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e93cb31c-4532-42f8-b896-79fa22249d89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:50.657993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e93cb31c-4532-42f8-b896-79fa22249d89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:50.666074 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e93cb31c-4532-42f8-b896-79fa22249d89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.164839 Apr 07 13:23:50.666628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1071/2258] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:51.684646 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d6922e8d-6106-4573-8f0f-b545967309b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:51.685265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d6922e8d-6106-4573-8f0f-b545967309b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:51.691521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6922e8d-6106-4573-8f0f-b545967309b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:51.691974 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6922e8d-6106-4573-8f0f-b545967309b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:51.692761 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6922e8d-6106-4573-8f0f-b545967309b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:51.693201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6922e8d-6106-4573-8f0f-b545967309b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:51.826697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d6922e8d-6106-4573-8f0f-b545967309b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:51.834492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d6922e8d-6106-4573-8f0f-b545967309b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154401 Apr 07 13:23:51.834993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1188/2259] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:51 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:52.851674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5ed1cb86-058b-42d0-8a60-da44b55bae30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:52.852317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5ed1cb86-058b-42d0-8a60-da44b55bae30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:52.859251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ed1cb86-058b-42d0-8a60-da44b55bae30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:52.859699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ed1cb86-058b-42d0-8a60-da44b55bae30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:52.860495 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ed1cb86-058b-42d0-8a60-da44b55bae30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:52.860931 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ed1cb86-058b-42d0-8a60-da44b55bae30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:52.990976 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5ed1cb86-058b-42d0-8a60-da44b55bae30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:52.999337 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5ed1cb86-058b-42d0-8a60-da44b55bae30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151351 Apr 07 13:23:52.999900 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1072/2260] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:52 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:54.016459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4ed6f953-49bf-4758-b484-80a582668d1f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:54.017074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4ed6f953-49bf-4758-b484-80a582668d1f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:54.022806 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4ed6f953-49bf-4758-b484-80a582668d1f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:54.023264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4ed6f953-49bf-4758-b484-80a582668d1f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:54.024028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4ed6f953-49bf-4758-b484-80a582668d1f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:54.024504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4ed6f953-49bf-4758-b484-80a582668d1f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:54.153449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4ed6f953-49bf-4758-b484-80a582668d1f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:54.161395 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4ed6f953-49bf-4758-b484-80a582668d1f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.148967 Apr 07 13:23:54.161962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1189/2261] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:54 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:55.178597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b27f2959-08ea-4bfd-b000-985e97b6b197 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:55.179213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b27f2959-08ea-4bfd-b000-985e97b6b197 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:55.185785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b27f2959-08ea-4bfd-b000-985e97b6b197 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:55.186223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b27f2959-08ea-4bfd-b000-985e97b6b197 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:55.187015 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b27f2959-08ea-4bfd-b000-985e97b6b197 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:55.187462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b27f2959-08ea-4bfd-b000-985e97b6b197 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:55.322869 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b27f2959-08ea-4bfd-b000-985e97b6b197 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:55.331222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b27f2959-08ea-4bfd-b000-985e97b6b197 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156516 Apr 07 13:23:55.331791 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1073/2262] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:55 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:56.348341 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4b792551-53dc-4fbc-ae3e-e4d80a1841b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:56.348947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4b792551-53dc-4fbc-ae3e-e4d80a1841b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:56.355767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b792551-53dc-4fbc-ae3e-e4d80a1841b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:56.356394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b792551-53dc-4fbc-ae3e-e4d80a1841b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:56.357149 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b792551-53dc-4fbc-ae3e-e4d80a1841b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:56.357582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4b792551-53dc-4fbc-ae3e-e4d80a1841b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:56.499001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4b792551-53dc-4fbc-ae3e-e4d80a1841b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:56.506840 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4b792551-53dc-4fbc-ae3e-e4d80a1841b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.162344 Apr 07 13:23:56.507407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1190/2263] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:56 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:57.523252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3d98773b-7dad-4f86-b143-3a8c103d2b09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:57.523862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3d98773b-7dad-4f86-b143-3a8c103d2b09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:57.531093 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d98773b-7dad-4f86-b143-3a8c103d2b09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:57.531554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d98773b-7dad-4f86-b143-3a8c103d2b09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:57.532367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d98773b-7dad-4f86-b143-3a8c103d2b09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:57.532812 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d98773b-7dad-4f86-b143-3a8c103d2b09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:57.666852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3d98773b-7dad-4f86-b143-3a8c103d2b09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:57.674578 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3d98773b-7dad-4f86-b143-3a8c103d2b09 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155206 Apr 07 13:23:57.675137 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1074/2264] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:58.691370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-92874484-3b0e-4554-9109-b9a0e722a3b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:58.691985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-92874484-3b0e-4554-9109-b9a0e722a3b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:58.698469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-92874484-3b0e-4554-9109-b9a0e722a3b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:58.699033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-92874484-3b0e-4554-9109-b9a0e722a3b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:58.699833 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-92874484-3b0e-4554-9109-b9a0e722a3b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:58.700311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-92874484-3b0e-4554-9109-b9a0e722a3b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:58.831910 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-92874484-3b0e-4554-9109-b9a0e722a3b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:23:58.840220 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-92874484-3b0e-4554-9109-b9a0e722a3b4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152672 Apr 07 13:23:58.840784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1191/2265] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:23:59.857720 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-419f5576-359f-44af-a82e-1469ee1ffb69 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:23:59.858343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-419f5576-359f-44af-a82e-1469ee1ffb69 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:23:59.864693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-419f5576-359f-44af-a82e-1469ee1ffb69 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:59.865150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-419f5576-359f-44af-a82e-1469ee1ffb69 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:59.865920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-419f5576-359f-44af-a82e-1469ee1ffb69 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:23:59.866363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-419f5576-359f-44af-a82e-1469ee1ffb69 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:23:59.995992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-419f5576-359f-44af-a82e-1469ee1ffb69 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:00.003812 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-419f5576-359f-44af-a82e-1469ee1ffb69 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150681 Apr 07 13:24:00.004411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1075/2266] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:23:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:01.020777 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-01b23f3b-29e6-4417-9380-7e301b91d47f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:01.021388 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-01b23f3b-29e6-4417-9380-7e301b91d47f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:01.028243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-01b23f3b-29e6-4417-9380-7e301b91d47f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:01.028698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-01b23f3b-29e6-4417-9380-7e301b91d47f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:01.029476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-01b23f3b-29e6-4417-9380-7e301b91d47f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:01.030070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-01b23f3b-29e6-4417-9380-7e301b91d47f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:01.174247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-01b23f3b-29e6-4417-9380-7e301b91d47f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:01.181916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-01b23f3b-29e6-4417-9380-7e301b91d47f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.164991 Apr 07 13:24:01.183128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1192/2267] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:01 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:02.199515 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-76cae189-b2e2-4c8a-b467-28b4df7e802f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:02.200083 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-76cae189-b2e2-4c8a-b467-28b4df7e802f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:02.206312 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76cae189-b2e2-4c8a-b467-28b4df7e802f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:02.206764 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76cae189-b2e2-4c8a-b467-28b4df7e802f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:02.207526 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76cae189-b2e2-4c8a-b467-28b4df7e802f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:02.207960 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-76cae189-b2e2-4c8a-b467-28b4df7e802f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:02.343486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-76cae189-b2e2-4c8a-b467-28b4df7e802f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:02.351283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-76cae189-b2e2-4c8a-b467-28b4df7e802f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156333 Apr 07 13:24:02.351840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1076/2268] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:02 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:03.368695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9bbbc817-0ef7-4abc-b313-902666d6db66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:03.369310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9bbbc817-0ef7-4abc-b313-902666d6db66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:03.376101 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9bbbc817-0ef7-4abc-b313-902666d6db66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:03.376598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9bbbc817-0ef7-4abc-b313-902666d6db66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:03.377390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9bbbc817-0ef7-4abc-b313-902666d6db66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:03.377829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9bbbc817-0ef7-4abc-b313-902666d6db66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:03.506991 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9bbbc817-0ef7-4abc-b313-902666d6db66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:03.515015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9bbbc817-0ef7-4abc-b313-902666d6db66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150117 Apr 07 13:24:03.515585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1193/2269] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:03 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:04.532699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4ca3fd72-0c85-4745-9339-758105eabf3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:04.533372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4ca3fd72-0c85-4745-9339-758105eabf3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:04.539525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ca3fd72-0c85-4745-9339-758105eabf3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:04.539980 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ca3fd72-0c85-4745-9339-758105eabf3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:04.540780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ca3fd72-0c85-4745-9339-758105eabf3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:04.541225 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ca3fd72-0c85-4745-9339-758105eabf3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:04.672224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4ca3fd72-0c85-4745-9339-758105eabf3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:04.679941 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4ca3fd72-0c85-4745-9339-758105eabf3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151365 Apr 07 13:24:04.680544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1077/2270] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:04 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:05.697723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-09546101-e822-4ddd-97b3-9e29774266f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:05.698339 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-09546101-e822-4ddd-97b3-9e29774266f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:05.705112 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-09546101-e822-4ddd-97b3-9e29774266f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:05.705566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-09546101-e822-4ddd-97b3-9e29774266f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:05.706325 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-09546101-e822-4ddd-97b3-9e29774266f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:05.706762 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-09546101-e822-4ddd-97b3-9e29774266f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:05.838418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-09546101-e822-4ddd-97b3-9e29774266f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:05.846878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-09546101-e822-4ddd-97b3-9e29774266f1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152982 Apr 07 13:24:05.847444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1194/2271] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:05 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:06.863713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-56d3f0d8-0ef4-4731-a11d-a4793a68b02d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:06.864480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-56d3f0d8-0ef4-4731-a11d-a4793a68b02d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:06.871306 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-56d3f0d8-0ef4-4731-a11d-a4793a68b02d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:06.871759 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-56d3f0d8-0ef4-4731-a11d-a4793a68b02d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:06.872553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-56d3f0d8-0ef4-4731-a11d-a4793a68b02d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:06.872996 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-56d3f0d8-0ef4-4731-a11d-a4793a68b02d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:07.002874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-56d3f0d8-0ef4-4731-a11d-a4793a68b02d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:07.010720 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-56d3f0d8-0ef4-4731-a11d-a4793a68b02d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150857 Apr 07 13:24:07.011873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1078/2272] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:06 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:08.028814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-666f57b2-c5c2-4e2a-af52-804427397018 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:08.029436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-666f57b2-c5c2-4e2a-af52-804427397018 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:08.036005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-666f57b2-c5c2-4e2a-af52-804427397018 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:08.036492 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-666f57b2-c5c2-4e2a-af52-804427397018 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:08.037252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-666f57b2-c5c2-4e2a-af52-804427397018 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:08.037693 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-666f57b2-c5c2-4e2a-af52-804427397018 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:08.170316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-666f57b2-c5c2-4e2a-af52-804427397018 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:08.178120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-666f57b2-c5c2-4e2a-af52-804427397018 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153827 Apr 07 13:24:08.178686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1195/2273] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:08 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:09.195184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a6a23c69-a8b4-4aae-aa0f-e6f8971a648a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:09.195806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a6a23c69-a8b4-4aae-aa0f-e6f8971a648a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:09.202307 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a6a23c69-a8b4-4aae-aa0f-e6f8971a648a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:09.202684 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a6a23c69-a8b4-4aae-aa0f-e6f8971a648a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:09.203451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a6a23c69-a8b4-4aae-aa0f-e6f8971a648a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:09.203891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a6a23c69-a8b4-4aae-aa0f-e6f8971a648a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:09.335083 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a6a23c69-a8b4-4aae-aa0f-e6f8971a648a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:09.343710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a6a23c69-a8b4-4aae-aa0f-e6f8971a648a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152430 Apr 07 13:24:09.344306 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1079/2274] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:09 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:10.361056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-27cbce3d-a2c4-4510-80bd-648b7cbd81a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:10.361687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-27cbce3d-a2c4-4510-80bd-648b7cbd81a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:10.367907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27cbce3d-a2c4-4510-80bd-648b7cbd81a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:10.368391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27cbce3d-a2c4-4510-80bd-648b7cbd81a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:10.369152 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27cbce3d-a2c4-4510-80bd-648b7cbd81a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:10.369592 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27cbce3d-a2c4-4510-80bd-648b7cbd81a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:10.498923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-27cbce3d-a2c4-4510-80bd-648b7cbd81a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:10.506663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-27cbce3d-a2c4-4510-80bd-648b7cbd81a0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149423 Apr 07 13:24:10.507228 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1196/2275] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:10 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:11.523849 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3c5fa45c-e7ba-4950-9d42-e426a50cbcaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:11.524482 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3c5fa45c-e7ba-4950-9d42-e426a50cbcaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:11.531269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c5fa45c-e7ba-4950-9d42-e426a50cbcaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:11.531719 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c5fa45c-e7ba-4950-9d42-e426a50cbcaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:11.532512 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c5fa45c-e7ba-4950-9d42-e426a50cbcaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:11.532949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3c5fa45c-e7ba-4950-9d42-e426a50cbcaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:11.663032 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3c5fa45c-e7ba-4950-9d42-e426a50cbcaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:11.671139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3c5fa45c-e7ba-4950-9d42-e426a50cbcaf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151144 Apr 07 13:24:11.671703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1080/2276] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:11 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:12.687968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c333bcb9-276e-41ac-95d1-68b989ed79ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:12.688604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c333bcb9-276e-41ac-95d1-68b989ed79ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:12.694866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c333bcb9-276e-41ac-95d1-68b989ed79ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:12.695346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c333bcb9-276e-41ac-95d1-68b989ed79ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:12.696110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c333bcb9-276e-41ac-95d1-68b989ed79ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:12.696576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c333bcb9-276e-41ac-95d1-68b989ed79ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:12.845239 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c333bcb9-276e-41ac-95d1-68b989ed79ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:12.852994 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c333bcb9-276e-41ac-95d1-68b989ed79ab tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.168941 Apr 07 13:24:12.853545 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1197/2277] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:12 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:13.869913 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bbaee994-75a2-400a-b264-1420b3a030e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:13.870530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bbaee994-75a2-400a-b264-1420b3a030e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:13.877432 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bbaee994-75a2-400a-b264-1420b3a030e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:13.877883 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bbaee994-75a2-400a-b264-1420b3a030e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:13.878645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bbaee994-75a2-400a-b264-1420b3a030e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:13.879081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bbaee994-75a2-400a-b264-1420b3a030e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:14.012917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bbaee994-75a2-400a-b264-1420b3a030e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:14.020693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bbaee994-75a2-400a-b264-1420b3a030e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154656 Apr 07 13:24:14.021263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1081/2278] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:13 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:15.037857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2413dad2-474e-49ad-9eea-33d5f333468f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:15.038476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2413dad2-474e-49ad-9eea-33d5f333468f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:15.045488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2413dad2-474e-49ad-9eea-33d5f333468f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:15.045975 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2413dad2-474e-49ad-9eea-33d5f333468f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:15.046740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2413dad2-474e-49ad-9eea-33d5f333468f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:15.047177 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2413dad2-474e-49ad-9eea-33d5f333468f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:15.176794 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2413dad2-474e-49ad-9eea-33d5f333468f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:15.184609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2413dad2-474e-49ad-9eea-33d5f333468f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150853 Apr 07 13:24:15.185172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1198/2279] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:15 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:16.202125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e011601b-4b4c-4bfb-8662-a932e0f08818 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:16.202750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e011601b-4b4c-4bfb-8662-a932e0f08818 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:16.209174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e011601b-4b4c-4bfb-8662-a932e0f08818 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:16.209584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e011601b-4b4c-4bfb-8662-a932e0f08818 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:16.210356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e011601b-4b4c-4bfb-8662-a932e0f08818 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:16.210803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e011601b-4b4c-4bfb-8662-a932e0f08818 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:16.341115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e011601b-4b4c-4bfb-8662-a932e0f08818 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:16.348813 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e011601b-4b4c-4bfb-8662-a932e0f08818 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151170 Apr 07 13:24:16.349380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1082/2280] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:16 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:17.366051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2c59a0a2-f4db-4de9-94b9-4a17928e766f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:17.366664 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2c59a0a2-f4db-4de9-94b9-4a17928e766f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:17.373480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c59a0a2-f4db-4de9-94b9-4a17928e766f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:17.373921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c59a0a2-f4db-4de9-94b9-4a17928e766f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:17.374669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c59a0a2-f4db-4de9-94b9-4a17928e766f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:17.375104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c59a0a2-f4db-4de9-94b9-4a17928e766f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:17.506222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2c59a0a2-f4db-4de9-94b9-4a17928e766f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:17.514157 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2c59a0a2-f4db-4de9-94b9-4a17928e766f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151918 Apr 07 13:24:17.514710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1199/2281] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:17 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:18.530395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ad92033b-81ea-4ab6-add1-f732073dcb95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:18.531044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ad92033b-81ea-4ab6-add1-f732073dcb95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:18.537747 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad92033b-81ea-4ab6-add1-f732073dcb95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:18.538204 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad92033b-81ea-4ab6-add1-f732073dcb95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:18.538983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad92033b-81ea-4ab6-add1-f732073dcb95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:18.539424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad92033b-81ea-4ab6-add1-f732073dcb95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:18.676042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ad92033b-81ea-4ab6-add1-f732073dcb95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:18.685593 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ad92033b-81ea-4ab6-add1-f732073dcb95 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.159271 Apr 07 13:24:18.686168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1083/2282] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:19.415174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1bb81596-91ec-4cac-b11a-8ea4aa6b430f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:19.415724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1bb81596-91ec-4cac-b11a-8ea4aa6b430f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:19.421861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1bb81596-91ec-4cac-b11a-8ea4aa6b430f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:19.422305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1bb81596-91ec-4cac-b11a-8ea4aa6b430f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:19.423054 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1bb81596-91ec-4cac-b11a-8ea4aa6b430f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:19.423488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1bb81596-91ec-4cac-b11a-8ea4aa6b430f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:19.444705 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1bb81596-91ec-4cac-b11a-8ea4aa6b430f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/ips" status: 200 len: 151 microversion: 2.20 time: 0.033436 Apr 07 13:24:19.445248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1200/2283] 10.222.0.15 () {60 vars in 1288 bytes} [Thu Apr 7 13:24:19 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/ips => generated 151 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:24:19.703224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b025ed55-6f8e-4952-bda2-8224172d416f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:19.703775 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b025ed55-6f8e-4952-bda2-8224172d416f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:19.710012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b025ed55-6f8e-4952-bda2-8224172d416f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:19.710462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b025ed55-6f8e-4952-bda2-8224172d416f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:19.711224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b025ed55-6f8e-4952-bda2-8224172d416f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:19.711676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b025ed55-6f8e-4952-bda2-8224172d416f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:19.841379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b025ed55-6f8e-4952-bda2-8224172d416f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:19.849086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b025ed55-6f8e-4952-bda2-8224172d416f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150532 Apr 07 13:24:19.849643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1084/2284] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:19 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:20.866752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d29f5cab-392a-481e-a0ab-5327dec33a7f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:20.867367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d29f5cab-392a-481e-a0ab-5327dec33a7f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:20.874249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d29f5cab-392a-481e-a0ab-5327dec33a7f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:20.874699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d29f5cab-392a-481e-a0ab-5327dec33a7f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:20.875461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d29f5cab-392a-481e-a0ab-5327dec33a7f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:20.875897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d29f5cab-392a-481e-a0ab-5327dec33a7f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:21.009730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d29f5cab-392a-481e-a0ab-5327dec33a7f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:21.017713 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d29f5cab-392a-481e-a0ab-5327dec33a7f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154837 Apr 07 13:24:21.018277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1201/2285] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:20 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:22.035241 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2a998a2b-5ec5-4649-a00e-f7cf5fe34aa6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:22.035866 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2a998a2b-5ec5-4649-a00e-f7cf5fe34aa6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:22.042163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a998a2b-5ec5-4649-a00e-f7cf5fe34aa6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:22.042619 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a998a2b-5ec5-4649-a00e-f7cf5fe34aa6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:22.044094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a998a2b-5ec5-4649-a00e-f7cf5fe34aa6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:22.044557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a998a2b-5ec5-4649-a00e-f7cf5fe34aa6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:22.172380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2a998a2b-5ec5-4649-a00e-f7cf5fe34aa6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:22.180386 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2a998a2b-5ec5-4649-a00e-f7cf5fe34aa6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149223 Apr 07 13:24:22.180958 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1085/2286] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:22 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:23.197575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-afa02fd9-b3a0-4b62-9c85-888f1514f78b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:23.198190 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-afa02fd9-b3a0-4b62-9c85-888f1514f78b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:23.204853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afa02fd9-b3a0-4b62-9c85-888f1514f78b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:23.205300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afa02fd9-b3a0-4b62-9c85-888f1514f78b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:23.206051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afa02fd9-b3a0-4b62-9c85-888f1514f78b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:23.206487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-afa02fd9-b3a0-4b62-9c85-888f1514f78b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:23.334044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-afa02fd9-b3a0-4b62-9c85-888f1514f78b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:23.342322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-afa02fd9-b3a0-4b62-9c85-888f1514f78b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.148829 Apr 07 13:24:23.342882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1202/2287] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:23 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:24.359640 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-01a5cfcd-4c8c-4e61-804f-51942bda474a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:24.360260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-01a5cfcd-4c8c-4e61-804f-51942bda474a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:24.366544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-01a5cfcd-4c8c-4e61-804f-51942bda474a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:24.366991 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-01a5cfcd-4c8c-4e61-804f-51942bda474a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:24.367746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-01a5cfcd-4c8c-4e61-804f-51942bda474a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:24.368208 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-01a5cfcd-4c8c-4e61-804f-51942bda474a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:24.499688 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-01a5cfcd-4c8c-4e61-804f-51942bda474a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:24.507434 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-01a5cfcd-4c8c-4e61-804f-51942bda474a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152005 Apr 07 13:24:24.508002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1086/2288] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:24 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:25.524638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1488d534-5a19-4c66-b25f-067307d5e81f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:25.525247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1488d534-5a19-4c66-b25f-067307d5e81f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:25.531958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1488d534-5a19-4c66-b25f-067307d5e81f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:25.532440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1488d534-5a19-4c66-b25f-067307d5e81f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:25.533236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1488d534-5a19-4c66-b25f-067307d5e81f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:25.533670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1488d534-5a19-4c66-b25f-067307d5e81f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:25.667365 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1488d534-5a19-4c66-b25f-067307d5e81f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:25.675217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1488d534-5a19-4c66-b25f-067307d5e81f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154348 Apr 07 13:24:25.675787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1203/2289] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:25 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:26.691927 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4c0c45eb-aa6d-4396-8185-6f2e54943bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:26.692581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4c0c45eb-aa6d-4396-8185-6f2e54943bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:26.698815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c0c45eb-aa6d-4396-8185-6f2e54943bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:26.699264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c0c45eb-aa6d-4396-8185-6f2e54943bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:26.700015 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c0c45eb-aa6d-4396-8185-6f2e54943bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:26.701467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4c0c45eb-aa6d-4396-8185-6f2e54943bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:26.835494 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4c0c45eb-aa6d-4396-8185-6f2e54943bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:26.844100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4c0c45eb-aa6d-4396-8185-6f2e54943bba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155940 Apr 07 13:24:26.844683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1087/2290] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:26 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:27.862987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9c535fb5-629a-447c-901b-a95cb4a78e18 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:27.863608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9c535fb5-629a-447c-901b-a95cb4a78e18 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:27.869967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c535fb5-629a-447c-901b-a95cb4a78e18 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:27.870420 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c535fb5-629a-447c-901b-a95cb4a78e18 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:27.871183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c535fb5-629a-447c-901b-a95cb4a78e18 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:27.871622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9c535fb5-629a-447c-901b-a95cb4a78e18 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:28.002930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9c535fb5-629a-447c-901b-a95cb4a78e18 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:28.010637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9c535fb5-629a-447c-901b-a95cb4a78e18 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151531 Apr 07 13:24:28.011197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1204/2291] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:29.027218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-75ea6ec0-5156-478e-91e7-0b7dd64afb87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:29.027838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-75ea6ec0-5156-478e-91e7-0b7dd64afb87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:29.034576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-75ea6ec0-5156-478e-91e7-0b7dd64afb87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:29.035306 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-75ea6ec0-5156-478e-91e7-0b7dd64afb87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:29.036070 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-75ea6ec0-5156-478e-91e7-0b7dd64afb87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:29.036535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-75ea6ec0-5156-478e-91e7-0b7dd64afb87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:29.167966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-75ea6ec0-5156-478e-91e7-0b7dd64afb87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:29.176343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-75ea6ec0-5156-478e-91e7-0b7dd64afb87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152972 Apr 07 13:24:29.176908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1088/2292] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:29 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:30.193827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b89b12a3-8c6c-4919-863a-54d37423e33e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:30.194416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b89b12a3-8c6c-4919-863a-54d37423e33e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:30.201316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b89b12a3-8c6c-4919-863a-54d37423e33e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:30.201773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b89b12a3-8c6c-4919-863a-54d37423e33e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:30.202526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b89b12a3-8c6c-4919-863a-54d37423e33e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:30.202956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b89b12a3-8c6c-4919-863a-54d37423e33e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:30.335316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b89b12a3-8c6c-4919-863a-54d37423e33e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:30.343122 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b89b12a3-8c6c-4919-863a-54d37423e33e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153066 Apr 07 13:24:30.343673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1205/2293] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:30 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:31.360814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5d1f741d-334c-4bc0-be10-56dd3835d014 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:31.361438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5d1f741d-334c-4bc0-be10-56dd3835d014 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:31.367715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d1f741d-334c-4bc0-be10-56dd3835d014 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:31.368197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d1f741d-334c-4bc0-be10-56dd3835d014 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:31.368969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d1f741d-334c-4bc0-be10-56dd3835d014 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:31.369405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d1f741d-334c-4bc0-be10-56dd3835d014 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:31.501852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5d1f741d-334c-4bc0-be10-56dd3835d014 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:31.509638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5d1f741d-334c-4bc0-be10-56dd3835d014 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153498 Apr 07 13:24:31.510206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1089/2294] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:31 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:32.526647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1f286238-b445-451c-897b-10baf2cc8d79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:32.527250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1f286238-b445-451c-897b-10baf2cc8d79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:32.533675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1f286238-b445-451c-897b-10baf2cc8d79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:32.534131 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1f286238-b445-451c-897b-10baf2cc8d79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:32.534894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1f286238-b445-451c-897b-10baf2cc8d79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:32.535582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1f286238-b445-451c-897b-10baf2cc8d79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:32.619734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:24:32.620229 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:24:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:24:32.668044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1f286238-b445-451c-897b-10baf2cc8d79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:32.677516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1f286238-b445-451c-897b-10baf2cc8d79 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154693 Apr 07 13:24:32.678485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1206/2295] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:33.698046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-333b6185-3fd5-4e45-8ff5-bd911b58ace9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:33.698661 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-333b6185-3fd5-4e45-8ff5-bd911b58ace9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:33.705612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-333b6185-3fd5-4e45-8ff5-bd911b58ace9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:33.706067 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-333b6185-3fd5-4e45-8ff5-bd911b58ace9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:33.706834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-333b6185-3fd5-4e45-8ff5-bd911b58ace9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:33.707271 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-333b6185-3fd5-4e45-8ff5-bd911b58ace9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:33.835901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-333b6185-3fd5-4e45-8ff5-bd911b58ace9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:33.844310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-333b6185-3fd5-4e45-8ff5-bd911b58ace9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150114 Apr 07 13:24:33.844893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1090/2296] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:33 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:34.868210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-80b3040d-a950-4948-b6d9-919fe4f9b3eb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:34.868906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-80b3040d-a950-4948-b6d9-919fe4f9b3eb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:34.875546 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80b3040d-a950-4948-b6d9-919fe4f9b3eb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:34.875995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80b3040d-a950-4948-b6d9-919fe4f9b3eb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:34.876814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80b3040d-a950-4948-b6d9-919fe4f9b3eb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:34.877245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80b3040d-a950-4948-b6d9-919fe4f9b3eb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:35.011448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-80b3040d-a950-4948-b6d9-919fe4f9b3eb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:35.019992 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-80b3040d-a950-4948-b6d9-919fe4f9b3eb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155746 Apr 07 13:24:35.020595 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1207/2297] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:34 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:36.037491 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fe36aed3-0fe9-4ba9-83df-8eaaf8103f3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:36.038094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fe36aed3-0fe9-4ba9-83df-8eaaf8103f3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:36.044774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fe36aed3-0fe9-4ba9-83df-8eaaf8103f3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:36.045239 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fe36aed3-0fe9-4ba9-83df-8eaaf8103f3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:36.046009 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fe36aed3-0fe9-4ba9-83df-8eaaf8103f3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:36.046451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fe36aed3-0fe9-4ba9-83df-8eaaf8103f3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:36.178272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fe36aed3-0fe9-4ba9-83df-8eaaf8103f3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:36.186197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fe36aed3-0fe9-4ba9-83df-8eaaf8103f3d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152929 Apr 07 13:24:36.186771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1091/2298] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:36 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:37.202845 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-645036ba-f53c-4ef1-a2bf-b44c5fac2a02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:37.203403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-645036ba-f53c-4ef1-a2bf-b44c5fac2a02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:37.209720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-645036ba-f53c-4ef1-a2bf-b44c5fac2a02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:37.210169 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-645036ba-f53c-4ef1-a2bf-b44c5fac2a02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:37.210927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-645036ba-f53c-4ef1-a2bf-b44c5fac2a02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:37.211370 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-645036ba-f53c-4ef1-a2bf-b44c5fac2a02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:37.341000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-645036ba-f53c-4ef1-a2bf-b44c5fac2a02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:37.348742 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-645036ba-f53c-4ef1-a2bf-b44c5fac2a02 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149858 Apr 07 13:24:37.349300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1208/2299] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:38.366115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-48e9ba70-7f83-4966-ab66-c9b6ee3aa67b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:38.366732 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-48e9ba70-7f83-4966-ab66-c9b6ee3aa67b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:38.373527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48e9ba70-7f83-4966-ab66-c9b6ee3aa67b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:38.373977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48e9ba70-7f83-4966-ab66-c9b6ee3aa67b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:38.374740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48e9ba70-7f83-4966-ab66-c9b6ee3aa67b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:38.375214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48e9ba70-7f83-4966-ab66-c9b6ee3aa67b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:38.509703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-48e9ba70-7f83-4966-ab66-c9b6ee3aa67b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:38.518772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-48e9ba70-7f83-4966-ab66-c9b6ee3aa67b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156494 Apr 07 13:24:38.519508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1092/2300] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:39.535893 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e79954d7-0019-4f5c-9ce4-75fcef71e8cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:39.536515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e79954d7-0019-4f5c-9ce4-75fcef71e8cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:39.542760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e79954d7-0019-4f5c-9ce4-75fcef71e8cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:39.543245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e79954d7-0019-4f5c-9ce4-75fcef71e8cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:39.544230 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e79954d7-0019-4f5c-9ce4-75fcef71e8cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:39.544596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e79954d7-0019-4f5c-9ce4-75fcef71e8cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:39.675213 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e79954d7-0019-4f5c-9ce4-75fcef71e8cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:39.682919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e79954d7-0019-4f5c-9ce4-75fcef71e8cd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151127 Apr 07 13:24:39.683479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1209/2301] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:39 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:40.699351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f0d86fcc-5add-45a8-8091-6867a6560e99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:40.700545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f0d86fcc-5add-45a8-8091-6867a6560e99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:40.706903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0d86fcc-5add-45a8-8091-6867a6560e99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:40.707364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0d86fcc-5add-45a8-8091-6867a6560e99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:40.708184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0d86fcc-5add-45a8-8091-6867a6560e99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:40.708635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0d86fcc-5add-45a8-8091-6867a6560e99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:41.057543 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f0d86fcc-5add-45a8-8091-6867a6560e99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:41.065763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f0d86fcc-5add-45a8-8091-6867a6560e99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.370233 Apr 07 13:24:41.066325 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1093/2302] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:40 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:42.082455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b652af26-4bc2-4ef7-9ffb-eb353789f1c8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:42.083095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b652af26-4bc2-4ef7-9ffb-eb353789f1c8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:42.089495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b652af26-4bc2-4ef7-9ffb-eb353789f1c8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:42.089944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b652af26-4bc2-4ef7-9ffb-eb353789f1c8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:42.091518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b652af26-4bc2-4ef7-9ffb-eb353789f1c8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:42.091954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b652af26-4bc2-4ef7-9ffb-eb353789f1c8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:42.224393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b652af26-4bc2-4ef7-9ffb-eb353789f1c8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:42.233705 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b652af26-4bc2-4ef7-9ffb-eb353789f1c8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155099 Apr 07 13:24:42.234267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1210/2303] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:42 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:43.250680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-40b4c8bd-fa29-4252-bab8-88290398e601 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:43.251252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-40b4c8bd-fa29-4252-bab8-88290398e601 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:43.257513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-40b4c8bd-fa29-4252-bab8-88290398e601 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:43.257972 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-40b4c8bd-fa29-4252-bab8-88290398e601 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:43.258769 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-40b4c8bd-fa29-4252-bab8-88290398e601 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:43.259216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-40b4c8bd-fa29-4252-bab8-88290398e601 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:43.397365 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-40b4c8bd-fa29-4252-bab8-88290398e601 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:43.406134 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-40b4c8bd-fa29-4252-bab8-88290398e601 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.159450 Apr 07 13:24:43.406705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1094/2304] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:43 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:44.423338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-56e7f39f-7c95-4464-9354-0c1349bb2332 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:44.423933 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-56e7f39f-7c95-4464-9354-0c1349bb2332 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:44.430264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56e7f39f-7c95-4464-9354-0c1349bb2332 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:44.430716 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56e7f39f-7c95-4464-9354-0c1349bb2332 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:44.431473 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56e7f39f-7c95-4464-9354-0c1349bb2332 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:44.431912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56e7f39f-7c95-4464-9354-0c1349bb2332 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:44.562208 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-56e7f39f-7c95-4464-9354-0c1349bb2332 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:44.569918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-56e7f39f-7c95-4464-9354-0c1349bb2332 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150461 Apr 07 13:24:44.570484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1211/2305] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:44 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:45.588679 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7d8b499b-b060-4dae-8038-1a5a1b9de12a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:45.589297 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7d8b499b-b060-4dae-8038-1a5a1b9de12a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:45.596658 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d8b499b-b060-4dae-8038-1a5a1b9de12a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:45.597113 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d8b499b-b060-4dae-8038-1a5a1b9de12a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:45.597903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d8b499b-b060-4dae-8038-1a5a1b9de12a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:45.598391 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d8b499b-b060-4dae-8038-1a5a1b9de12a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:45.733195 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7d8b499b-b060-4dae-8038-1a5a1b9de12a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:45.740902 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7d8b499b-b060-4dae-8038-1a5a1b9de12a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157245 Apr 07 13:24:45.741470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1095/2306] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:45 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:46.758519 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e8d50ccb-c406-487b-b687-fb684c34db00 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:46.759132 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e8d50ccb-c406-487b-b687-fb684c34db00 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:46.766386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e8d50ccb-c406-487b-b687-fb684c34db00 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:46.766837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e8d50ccb-c406-487b-b687-fb684c34db00 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:46.767601 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e8d50ccb-c406-487b-b687-fb684c34db00 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:46.768037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e8d50ccb-c406-487b-b687-fb684c34db00 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:46.902270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e8d50ccb-c406-487b-b687-fb684c34db00 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:46.910679 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e8d50ccb-c406-487b-b687-fb684c34db00 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156065 Apr 07 13:24:46.911233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1212/2307] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:46 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:47.928539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0a0604f5-fda2-4a68-97f9-865688b14699 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:47.929185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0a0604f5-fda2-4a68-97f9-865688b14699 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:47.935477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a0604f5-fda2-4a68-97f9-865688b14699 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:47.935936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a0604f5-fda2-4a68-97f9-865688b14699 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:47.936735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a0604f5-fda2-4a68-97f9-865688b14699 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:47.937184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a0604f5-fda2-4a68-97f9-865688b14699 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:48.081766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0a0604f5-fda2-4a68-97f9-865688b14699 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:48.089488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0a0604f5-fda2-4a68-97f9-865688b14699 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.164836 Apr 07 13:24:48.090072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1096/2308] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:47 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:49.106644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6a3fd197-2e16-4276-b069-b60a5338d678 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:49.107261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6a3fd197-2e16-4276-b069-b60a5338d678 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:49.113529 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a3fd197-2e16-4276-b069-b60a5338d678 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:49.113979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a3fd197-2e16-4276-b069-b60a5338d678 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:49.114737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a3fd197-2e16-4276-b069-b60a5338d678 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:49.115173 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a3fd197-2e16-4276-b069-b60a5338d678 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:49.246528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6a3fd197-2e16-4276-b069-b60a5338d678 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:49.254324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6a3fd197-2e16-4276-b069-b60a5338d678 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151790 Apr 07 13:24:49.254891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1213/2309] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:49 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:50.271774 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0863cd90-1994-4f24-84cf-2e348c2d9f3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:50.272412 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0863cd90-1994-4f24-84cf-2e348c2d9f3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:50.278892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0863cd90-1994-4f24-84cf-2e348c2d9f3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:50.279347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0863cd90-1994-4f24-84cf-2e348c2d9f3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:50.280119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0863cd90-1994-4f24-84cf-2e348c2d9f3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:50.280582 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0863cd90-1994-4f24-84cf-2e348c2d9f3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:50.410825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0863cd90-1994-4f24-84cf-2e348c2d9f3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:50.419165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0863cd90-1994-4f24-84cf-2e348c2d9f3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150660 Apr 07 13:24:50.419754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1097/2310] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:51.437446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e60cbcf0-747c-4bff-aa00-6d6742e8d04c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:51.438058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e60cbcf0-747c-4bff-aa00-6d6742e8d04c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:51.444541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e60cbcf0-747c-4bff-aa00-6d6742e8d04c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:51.444998 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e60cbcf0-747c-4bff-aa00-6d6742e8d04c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:51.445795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e60cbcf0-747c-4bff-aa00-6d6742e8d04c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:51.446234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e60cbcf0-747c-4bff-aa00-6d6742e8d04c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:51.577192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e60cbcf0-747c-4bff-aa00-6d6742e8d04c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:51.584978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e60cbcf0-747c-4bff-aa00-6d6742e8d04c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152491 Apr 07 13:24:51.585535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1214/2311] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:51 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:52.602657 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-df0ace3d-0732-4685-ae89-f0d7f2dbc40a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:52.603371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-df0ace3d-0732-4685-ae89-f0d7f2dbc40a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:52.610413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df0ace3d-0732-4685-ae89-f0d7f2dbc40a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:52.610870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df0ace3d-0732-4685-ae89-f0d7f2dbc40a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:52.611635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df0ace3d-0732-4685-ae89-f0d7f2dbc40a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:52.612076 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df0ace3d-0732-4685-ae89-f0d7f2dbc40a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:52.744677 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-df0ace3d-0732-4685-ae89-f0d7f2dbc40a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:52.752614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-df0ace3d-0732-4685-ae89-f0d7f2dbc40a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153790 Apr 07 13:24:52.753177 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1098/2312] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:52 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:53.769684 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-361f75db-25d2-4c8c-bac1-6a64d1e2f1bf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:53.770301 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-361f75db-25d2-4c8c-bac1-6a64d1e2f1bf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:53.776133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-361f75db-25d2-4c8c-bac1-6a64d1e2f1bf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:53.776605 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-361f75db-25d2-4c8c-bac1-6a64d1e2f1bf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:53.777357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-361f75db-25d2-4c8c-bac1-6a64d1e2f1bf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:53.777787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-361f75db-25d2-4c8c-bac1-6a64d1e2f1bf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:53.910562 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-361f75db-25d2-4c8c-bac1-6a64d1e2f1bf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:53.918321 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-361f75db-25d2-4c8c-bac1-6a64d1e2f1bf tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152599 Apr 07 13:24:53.918878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1215/2313] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:53 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:54.934599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6fd0aa08-22ac-4439-a731-deb0d516aec8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:54.935217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6fd0aa08-22ac-4439-a731-deb0d516aec8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:54.942054 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6fd0aa08-22ac-4439-a731-deb0d516aec8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:54.942508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6fd0aa08-22ac-4439-a731-deb0d516aec8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:54.943271 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6fd0aa08-22ac-4439-a731-deb0d516aec8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:54.943711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6fd0aa08-22ac-4439-a731-deb0d516aec8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:55.073003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6fd0aa08-22ac-4439-a731-deb0d516aec8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:55.081308 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6fd0aa08-22ac-4439-a731-deb0d516aec8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150495 Apr 07 13:24:55.081871 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1099/2314] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:54 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:56.097612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b2c05a14-fb3c-4c1c-857f-af1c8a12be85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:56.098207 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b2c05a14-fb3c-4c1c-857f-af1c8a12be85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:56.104511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b2c05a14-fb3c-4c1c-857f-af1c8a12be85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:56.104973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b2c05a14-fb3c-4c1c-857f-af1c8a12be85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:56.105743 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b2c05a14-fb3c-4c1c-857f-af1c8a12be85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:56.106214 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b2c05a14-fb3c-4c1c-857f-af1c8a12be85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:56.236511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b2c05a14-fb3c-4c1c-857f-af1c8a12be85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:56.244308 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b2c05a14-fb3c-4c1c-857f-af1c8a12be85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150521 Apr 07 13:24:56.244877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1216/2315] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:56 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:57.260680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a23df5cd-7850-4aa8-925f-0ff8866f1abe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:57.261298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a23df5cd-7850-4aa8-925f-0ff8866f1abe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:57.268180 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a23df5cd-7850-4aa8-925f-0ff8866f1abe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:57.268645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a23df5cd-7850-4aa8-925f-0ff8866f1abe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:57.269414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a23df5cd-7850-4aa8-925f-0ff8866f1abe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:57.269860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a23df5cd-7850-4aa8-925f-0ff8866f1abe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:57.409831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a23df5cd-7850-4aa8-925f-0ff8866f1abe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:57.417843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a23df5cd-7850-4aa8-925f-0ff8866f1abe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.161019 Apr 07 13:24:57.418403 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1100/2316] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:58.434981 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5791dd16-3c88-4081-828d-38aea9b12128 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:58.436094 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5791dd16-3c88-4081-828d-38aea9b12128 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:58.442461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5791dd16-3c88-4081-828d-38aea9b12128 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:58.442906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5791dd16-3c88-4081-828d-38aea9b12128 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:58.443659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5791dd16-3c88-4081-828d-38aea9b12128 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:58.444090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5791dd16-3c88-4081-828d-38aea9b12128 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:58.577243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5791dd16-3c88-4081-828d-38aea9b12128 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:58.585110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5791dd16-3c88-4081-828d-38aea9b12128 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153929 Apr 07 13:24:58.585671 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1217/2317] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:24:59.601967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-93001625-f10d-4676-bf66-79a19072cff6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:24:59.602584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-93001625-f10d-4676-bf66-79a19072cff6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:24:59.609176 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93001625-f10d-4676-bf66-79a19072cff6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:59.609639 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93001625-f10d-4676-bf66-79a19072cff6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:59.610412 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93001625-f10d-4676-bf66-79a19072cff6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:24:59.610862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-93001625-f10d-4676-bf66-79a19072cff6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:24:59.740290 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-93001625-f10d-4676-bf66-79a19072cff6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:24:59.748538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-93001625-f10d-4676-bf66-79a19072cff6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149811 Apr 07 13:24:59.749515 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1101/2318] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:24:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:00.766136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-11786fcd-f46f-4f4d-88f6-90388ec65c4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:00.766761 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-11786fcd-f46f-4f4d-88f6-90388ec65c4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:00.773193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11786fcd-f46f-4f4d-88f6-90388ec65c4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:00.773648 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11786fcd-f46f-4f4d-88f6-90388ec65c4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:00.774408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11786fcd-f46f-4f4d-88f6-90388ec65c4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:00.774846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11786fcd-f46f-4f4d-88f6-90388ec65c4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:00.907177 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-11786fcd-f46f-4f4d-88f6-90388ec65c4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:00.915224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-11786fcd-f46f-4f4d-88f6-90388ec65c4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152998 Apr 07 13:25:00.915805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1218/2319] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:00 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:01.932792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-df05b9f3-e9db-4fce-b49d-50491c09c36b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:01.933408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-df05b9f3-e9db-4fce-b49d-50491c09c36b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:01.940246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df05b9f3-e9db-4fce-b49d-50491c09c36b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:01.940698 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df05b9f3-e9db-4fce-b49d-50491c09c36b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:01.941460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df05b9f3-e9db-4fce-b49d-50491c09c36b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:01.941896 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df05b9f3-e9db-4fce-b49d-50491c09c36b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:02.075752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-df05b9f3-e9db-4fce-b49d-50491c09c36b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:02.084277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-df05b9f3-e9db-4fce-b49d-50491c09c36b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155330 Apr 07 13:25:02.084843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1102/2320] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:01 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:25:03.101222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a085f15b-1bdb-41c6-bb37-8bb08f6cb729 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:03.101862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a085f15b-1bdb-41c6-bb37-8bb08f6cb729 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:03.108163 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a085f15b-1bdb-41c6-bb37-8bb08f6cb729 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:03.108617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a085f15b-1bdb-41c6-bb37-8bb08f6cb729 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:03.109375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a085f15b-1bdb-41c6-bb37-8bb08f6cb729 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:03.109808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a085f15b-1bdb-41c6-bb37-8bb08f6cb729 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:03.241381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a085f15b-1bdb-41c6-bb37-8bb08f6cb729 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:03.249310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a085f15b-1bdb-41c6-bb37-8bb08f6cb729 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151903 Apr 07 13:25:03.249877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1219/2321] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:03 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:04.266884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9b4bb2c0-90b7-47b7-945d-7faf25fd8c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:04.267501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9b4bb2c0-90b7-47b7-945d-7faf25fd8c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:04.273382 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b4bb2c0-90b7-47b7-945d-7faf25fd8c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:04.273831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b4bb2c0-90b7-47b7-945d-7faf25fd8c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:04.274592 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b4bb2c0-90b7-47b7-945d-7faf25fd8c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:04.275026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b4bb2c0-90b7-47b7-945d-7faf25fd8c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:04.421144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9b4bb2c0-90b7-47b7-945d-7faf25fd8c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:04.428961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9b4bb2c0-90b7-47b7-945d-7faf25fd8c7d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.166673 Apr 07 13:25:04.429522 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1103/2322] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:04 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:05.446612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b57948a2-d690-4c66-ae6e-54599524f9a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:05.447225 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b57948a2-d690-4c66-ae6e-54599524f9a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:05.454233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b57948a2-d690-4c66-ae6e-54599524f9a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:05.454684 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b57948a2-d690-4c66-ae6e-54599524f9a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:05.455446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b57948a2-d690-4c66-ae6e-54599524f9a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:05.455879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b57948a2-d690-4c66-ae6e-54599524f9a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:05.585166 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b57948a2-d690-4c66-ae6e-54599524f9a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:05.593579 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b57948a2-d690-4c66-ae6e-54599524f9a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150488 Apr 07 13:25:05.594111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1220/2323] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:05 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:06.611103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-22a33398-1ff6-492a-933a-7369f75d0257 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:06.611712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-22a33398-1ff6-492a-933a-7369f75d0257 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:06.617969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-22a33398-1ff6-492a-933a-7369f75d0257 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:06.618417 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-22a33398-1ff6-492a-933a-7369f75d0257 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:06.619167 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-22a33398-1ff6-492a-933a-7369f75d0257 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:06.619601 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-22a33398-1ff6-492a-933a-7369f75d0257 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:06.748949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-22a33398-1ff6-492a-933a-7369f75d0257 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:06.756633 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-22a33398-1ff6-492a-933a-7369f75d0257 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150492 Apr 07 13:25:06.757198 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1104/2324] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:06 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:07.774106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7ce46f58-e1b3-4c30-9780-1fae6f4609b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:07.774718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7ce46f58-e1b3-4c30-9780-1fae6f4609b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:07.781578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ce46f58-e1b3-4c30-9780-1fae6f4609b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:07.782040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ce46f58-e1b3-4c30-9780-1fae6f4609b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:07.782805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ce46f58-e1b3-4c30-9780-1fae6f4609b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:07.783249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7ce46f58-e1b3-4c30-9780-1fae6f4609b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:07.914377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7ce46f58-e1b3-4c30-9780-1fae6f4609b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:07.922655 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7ce46f58-e1b3-4c30-9780-1fae6f4609b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152449 Apr 07 13:25:07.923216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1221/2325] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:07 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:08.940477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cdf8a9e5-9ca8-48f7-84bd-c259e7125eef tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:08.941121 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cdf8a9e5-9ca8-48f7-84bd-c259e7125eef tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:08.947383 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cdf8a9e5-9ca8-48f7-84bd-c259e7125eef tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:08.947829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cdf8a9e5-9ca8-48f7-84bd-c259e7125eef tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:08.948615 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cdf8a9e5-9ca8-48f7-84bd-c259e7125eef tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:08.949057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cdf8a9e5-9ca8-48f7-84bd-c259e7125eef tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:09.085799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cdf8a9e5-9ca8-48f7-84bd-c259e7125eef tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:09.093582 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cdf8a9e5-9ca8-48f7-84bd-c259e7125eef tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.158148 Apr 07 13:25:09.094143 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1105/2326] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:08 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:10.111484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-13e04724-9acb-4a28-a955-dd93324a4f99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:10.112099 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-13e04724-9acb-4a28-a955-dd93324a4f99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:10.118351 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13e04724-9acb-4a28-a955-dd93324a4f99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:10.118809 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13e04724-9acb-4a28-a955-dd93324a4f99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:10.119569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13e04724-9acb-4a28-a955-dd93324a4f99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:10.120006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13e04724-9acb-4a28-a955-dd93324a4f99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:10.253627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-13e04724-9acb-4a28-a955-dd93324a4f99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:10.261362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-13e04724-9acb-4a28-a955-dd93324a4f99 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154343 Apr 07 13:25:10.261930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1222/2327] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:10 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:11.277874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-20fa3414-cecb-4986-86ab-6ee8eaee5715 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:11.278473 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-20fa3414-cecb-4986-86ab-6ee8eaee5715 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:11.285297 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-20fa3414-cecb-4986-86ab-6ee8eaee5715 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:11.285752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-20fa3414-cecb-4986-86ab-6ee8eaee5715 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:11.286514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-20fa3414-cecb-4986-86ab-6ee8eaee5715 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:11.286954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-20fa3414-cecb-4986-86ab-6ee8eaee5715 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:11.416529 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-20fa3414-cecb-4986-86ab-6ee8eaee5715 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:11.424999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-20fa3414-cecb-4986-86ab-6ee8eaee5715 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150971 Apr 07 13:25:11.425566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1106/2328] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:11 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:12.442281 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-46e8b44e-8afe-4111-a7f9-556af08d1789 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:12.442883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-46e8b44e-8afe-4111-a7f9-556af08d1789 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:12.449165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46e8b44e-8afe-4111-a7f9-556af08d1789 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:12.449620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46e8b44e-8afe-4111-a7f9-556af08d1789 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:12.450376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46e8b44e-8afe-4111-a7f9-556af08d1789 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:12.450816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-46e8b44e-8afe-4111-a7f9-556af08d1789 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:12.579776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-46e8b44e-8afe-4111-a7f9-556af08d1789 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:12.587587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-46e8b44e-8afe-4111-a7f9-556af08d1789 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149182 Apr 07 13:25:12.588172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1223/2329] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:12 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:13.604209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-68cd05ac-1111-4740-8d39-2ddc6d5ba77e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:13.604835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-68cd05ac-1111-4740-8d39-2ddc6d5ba77e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:13.611208 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68cd05ac-1111-4740-8d39-2ddc6d5ba77e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:13.611667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68cd05ac-1111-4740-8d39-2ddc6d5ba77e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:13.612467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68cd05ac-1111-4740-8d39-2ddc6d5ba77e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:13.612914 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68cd05ac-1111-4740-8d39-2ddc6d5ba77e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:13.745936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-68cd05ac-1111-4740-8d39-2ddc6d5ba77e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:13.753649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-68cd05ac-1111-4740-8d39-2ddc6d5ba77e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153294 Apr 07 13:25:13.754215 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1107/2330] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:13 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:14.770904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2f350bcc-3083-4563-9c6a-ac6cc4dffce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:14.771513 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2f350bcc-3083-4563-9c6a-ac6cc4dffce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:14.777820 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f350bcc-3083-4563-9c6a-ac6cc4dffce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:14.778268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f350bcc-3083-4563-9c6a-ac6cc4dffce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:14.779021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f350bcc-3083-4563-9c6a-ac6cc4dffce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:14.779452 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f350bcc-3083-4563-9c6a-ac6cc4dffce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:14.919976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2f350bcc-3083-4563-9c6a-ac6cc4dffce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:14.933393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2f350bcc-3083-4563-9c6a-ac6cc4dffce8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.166284 Apr 07 13:25:14.933980 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1224/2331] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:14 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:15.950509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6a1f4d15-6386-4b1f-bbf9-1c7710bd8c3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:15.951110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6a1f4d15-6386-4b1f-bbf9-1c7710bd8c3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:15.957535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6a1f4d15-6386-4b1f-bbf9-1c7710bd8c3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:15.958012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6a1f4d15-6386-4b1f-bbf9-1c7710bd8c3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:15.958790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6a1f4d15-6386-4b1f-bbf9-1c7710bd8c3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:15.959227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6a1f4d15-6386-4b1f-bbf9-1c7710bd8c3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:16.091349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6a1f4d15-6386-4b1f-bbf9-1c7710bd8c3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:16.099875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6a1f4d15-6386-4b1f-bbf9-1c7710bd8c3a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153147 Apr 07 13:25:16.100488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1108/2332] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:15 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:17.117376 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e4a7362e-71f1-4eb3-91d1-7c95256d5757 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:17.117983 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e4a7362e-71f1-4eb3-91d1-7c95256d5757 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:17.125020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e4a7362e-71f1-4eb3-91d1-7c95256d5757 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:17.125467 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e4a7362e-71f1-4eb3-91d1-7c95256d5757 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:17.126219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e4a7362e-71f1-4eb3-91d1-7c95256d5757 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:17.126647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e4a7362e-71f1-4eb3-91d1-7c95256d5757 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:17.255114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e4a7362e-71f1-4eb3-91d1-7c95256d5757 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:17.262885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e4a7362e-71f1-4eb3-91d1-7c95256d5757 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149440 Apr 07 13:25:17.263442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1225/2333] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:17 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:18.281765 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ab5e0e58-5ec9-4088-99ac-f1df4566a5d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:18.282814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ab5e0e58-5ec9-4088-99ac-f1df4566a5d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:18.290102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ab5e0e58-5ec9-4088-99ac-f1df4566a5d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:18.290570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ab5e0e58-5ec9-4088-99ac-f1df4566a5d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:18.291385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ab5e0e58-5ec9-4088-99ac-f1df4566a5d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:18.291847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ab5e0e58-5ec9-4088-99ac-f1df4566a5d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:18.440097 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ab5e0e58-5ec9-4088-99ac-f1df4566a5d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:18.448174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ab5e0e58-5ec9-4088-99ac-f1df4566a5d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.172230 Apr 07 13:25:18.448772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1109/2334] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:19.466346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-653c3e49-f1ea-4fd3-a3ba-abef62abce77 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:19.466931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-653c3e49-f1ea-4fd3-a3ba-abef62abce77 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:19.473862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-653c3e49-f1ea-4fd3-a3ba-abef62abce77 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:19.474311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-653c3e49-f1ea-4fd3-a3ba-abef62abce77 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:19.475227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-653c3e49-f1ea-4fd3-a3ba-abef62abce77 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:19.475675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-653c3e49-f1ea-4fd3-a3ba-abef62abce77 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:19.606405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-653c3e49-f1ea-4fd3-a3ba-abef62abce77 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:19.614581 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-653c3e49-f1ea-4fd3-a3ba-abef62abce77 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152021 Apr 07 13:25:19.615315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1226/2335] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:19 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:20.632243 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7d743646-88a3-4701-9d38-0e238cf002cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:20.632840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7d743646-88a3-4701-9d38-0e238cf002cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:20.639173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d743646-88a3-4701-9d38-0e238cf002cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:20.640262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d743646-88a3-4701-9d38-0e238cf002cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:20.641031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d743646-88a3-4701-9d38-0e238cf002cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:20.641476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7d743646-88a3-4701-9d38-0e238cf002cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:20.775916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7d743646-88a3-4701-9d38-0e238cf002cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:20.783609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7d743646-88a3-4701-9d38-0e238cf002cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155344 Apr 07 13:25:20.784184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1110/2336] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:20 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:21.802316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ea5bd70c-55d2-49cb-98c9-6104b0e22067 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:21.802930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ea5bd70c-55d2-49cb-98c9-6104b0e22067 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:21.809315 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea5bd70c-55d2-49cb-98c9-6104b0e22067 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:21.809770 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea5bd70c-55d2-49cb-98c9-6104b0e22067 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:21.810535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea5bd70c-55d2-49cb-98c9-6104b0e22067 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:21.811085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea5bd70c-55d2-49cb-98c9-6104b0e22067 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:21.946039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ea5bd70c-55d2-49cb-98c9-6104b0e22067 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:21.954181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ea5bd70c-55d2-49cb-98c9-6104b0e22067 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156224 Apr 07 13:25:21.954735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1227/2337] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:21 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:22.971112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1ffbf1f5-6ed5-4317-afa5-3301611542d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:22.971709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1ffbf1f5-6ed5-4317-afa5-3301611542d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:22.978061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1ffbf1f5-6ed5-4317-afa5-3301611542d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:22.978514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1ffbf1f5-6ed5-4317-afa5-3301611542d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:22.979283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1ffbf1f5-6ed5-4317-afa5-3301611542d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:22.979724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1ffbf1f5-6ed5-4317-afa5-3301611542d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:23.109059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1ffbf1f5-6ed5-4317-afa5-3301611542d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:23.116812 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1ffbf1f5-6ed5-4317-afa5-3301611542d6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149777 Apr 07 13:25:23.117375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1111/2338] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:22 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:25:24.134278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8774c152-bccd-4c79-a2dd-478ededc3812 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:24.134878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8774c152-bccd-4c79-a2dd-478ededc3812 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:24.141324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8774c152-bccd-4c79-a2dd-478ededc3812 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:24.141770 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8774c152-bccd-4c79-a2dd-478ededc3812 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:24.142520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8774c152-bccd-4c79-a2dd-478ededc3812 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:24.142958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8774c152-bccd-4c79-a2dd-478ededc3812 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:24.271107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8774c152-bccd-4c79-a2dd-478ededc3812 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:24.278807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8774c152-bccd-4c79-a2dd-478ededc3812 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.148324 Apr 07 13:25:24.279385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1228/2339] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:24 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:25.297460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-62c84538-5c9b-4120-9b02-886251046d33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:25.298018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-62c84538-5c9b-4120-9b02-886251046d33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:25.304231 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-62c84538-5c9b-4120-9b02-886251046d33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:25.304692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-62c84538-5c9b-4120-9b02-886251046d33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:25.305453 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-62c84538-5c9b-4120-9b02-886251046d33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:25.305893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-62c84538-5c9b-4120-9b02-886251046d33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:25.438215 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-62c84538-5c9b-4120-9b02-886251046d33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:25.445958 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-62c84538-5c9b-4120-9b02-886251046d33 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153214 Apr 07 13:25:25.446517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1112/2340] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:25 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:26.462783 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-208c1d93-56cf-47cc-8ae6-80b572a8a6c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:26.463372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-208c1d93-56cf-47cc-8ae6-80b572a8a6c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:26.470064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-208c1d93-56cf-47cc-8ae6-80b572a8a6c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:26.470514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-208c1d93-56cf-47cc-8ae6-80b572a8a6c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:26.471268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-208c1d93-56cf-47cc-8ae6-80b572a8a6c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:26.471707 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-208c1d93-56cf-47cc-8ae6-80b572a8a6c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:26.605434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-208c1d93-56cf-47cc-8ae6-80b572a8a6c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:26.613568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-208c1d93-56cf-47cc-8ae6-80b572a8a6c1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154638 Apr 07 13:25:26.614125 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1229/2341] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:26 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:27.631428 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9ed8a081-2b54-4a4c-986d-7dc7befa559e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:27.632051 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9ed8a081-2b54-4a4c-986d-7dc7befa559e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:27.638520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9ed8a081-2b54-4a4c-986d-7dc7befa559e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:27.639542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9ed8a081-2b54-4a4c-986d-7dc7befa559e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:27.640484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9ed8a081-2b54-4a4c-986d-7dc7befa559e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:27.640935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9ed8a081-2b54-4a4c-986d-7dc7befa559e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:27.770705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9ed8a081-2b54-4a4c-986d-7dc7befa559e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:27.778441 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9ed8a081-2b54-4a4c-986d-7dc7befa559e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150908 Apr 07 13:25:27.778995 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1113/2342] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:28.273880 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-70f75296-87fb-4649-aaf2-5f626b03f8ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:28.274402 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-70f75296-87fb-4649-aaf2-5f626b03f8ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:28.281969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-70f75296-87fb-4649-aaf2-5f626b03f8ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:28.282449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-70f75296-87fb-4649-aaf2-5f626b03f8ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:28.283219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-70f75296-87fb-4649-aaf2-5f626b03f8ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:28.283653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-70f75296-87fb-4649-aaf2-5f626b03f8ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:28.298076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-70f75296-87fb-4649-aaf2-5f626b03f8ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] HTTP exception thrown: Instance 34baf697-0c75-496f-a1fe-fef1314f1a9a could not be found. Apr 07 13:25:28.298659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-70f75296-87fb-4649-aaf2-5f626b03f8ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Returning 404 to user: Instance 34baf697-0c75-496f-a1fe-fef1314f1a9a could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:25:28.299484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-70f75296-87fb-4649-aaf2-5f626b03f8ee tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "DELETE /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 404 len: 111 microversion: 2.1 time: 0.029407 Apr 07 13:25:28.300011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1230/2343] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:25:28 2022] DELETE /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:25:28.307892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bb1d628e-848e-4861-b320-8f9ee7511c3f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:28.308541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bb1d628e-848e-4861-b320-8f9ee7511c3f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] [instance: 34baf697-0c75-496f-a1fe-fef1314f1a9a] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:28.314597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bb1d628e-848e-4861-b320-8f9ee7511c3f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:28.315053 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bb1d628e-848e-4861-b320-8f9ee7511c3f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:28.315817 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bb1d628e-848e-4861-b320-8f9ee7511c3f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:28.316291 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bb1d628e-848e-4861-b320-8f9ee7511c3f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:28.329380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-bb1d628e-848e-4861-b320-8f9ee7511c3f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] HTTP exception thrown: Instance 34baf697-0c75-496f-a1fe-fef1314f1a9a could not be found. Apr 07 13:25:28.329967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bb1d628e-848e-4861-b320-8f9ee7511c3f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] Returning 404 to user: Instance 34baf697-0c75-496f-a1fe-fef1314f1a9a could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:25:28.330778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bb1d628e-848e-4861-b320-8f9ee7511c3f tempest-AttachVolumeTestJSON-1170891473 tempest-AttachVolumeTestJSON-1170891473-project] 10.222.0.15 "GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a" status: 404 len: 111 microversion: 2.1 time: 0.026689 Apr 07 13:25:28.331282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1114/2344] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:28 2022] GET /compute/v2.1/servers/34baf697-0c75-496f-a1fe-fef1314f1a9a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:25:28.796495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6de3dac6-679e-4315-81a3-12dda6ed2ba6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:28.797144 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6de3dac6-679e-4315-81a3-12dda6ed2ba6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:28.803472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6de3dac6-679e-4315-81a3-12dda6ed2ba6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:28.803930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6de3dac6-679e-4315-81a3-12dda6ed2ba6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:28.804746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6de3dac6-679e-4315-81a3-12dda6ed2ba6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:28.805187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6de3dac6-679e-4315-81a3-12dda6ed2ba6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:29.105022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6de3dac6-679e-4315-81a3-12dda6ed2ba6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:29.112834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6de3dac6-679e-4315-81a3-12dda6ed2ba6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.320382 Apr 07 13:25:29.113403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1231/2345] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:28 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:30.129604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9abb248f-eeae-46f3-bb74-6711ab38616d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:30.130225 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9abb248f-eeae-46f3-bb74-6711ab38616d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:30.136590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9abb248f-eeae-46f3-bb74-6711ab38616d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:30.137055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9abb248f-eeae-46f3-bb74-6711ab38616d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:30.137828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9abb248f-eeae-46f3-bb74-6711ab38616d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:30.138272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9abb248f-eeae-46f3-bb74-6711ab38616d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:30.279142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9abb248f-eeae-46f3-bb74-6711ab38616d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:30.289487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9abb248f-eeae-46f3-bb74-6711ab38616d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.163595 Apr 07 13:25:30.290432 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1115/2346] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:30 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:31.316992 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-11942550-2227-4eac-92e2-da61c86c99d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:31.318482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-11942550-2227-4eac-92e2-da61c86c99d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:31.325752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11942550-2227-4eac-92e2-da61c86c99d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:31.327038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11942550-2227-4eac-92e2-da61c86c99d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:31.327878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11942550-2227-4eac-92e2-da61c86c99d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:31.328359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11942550-2227-4eac-92e2-da61c86c99d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:31.487901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-11942550-2227-4eac-92e2-da61c86c99d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:31.503523 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-11942550-2227-4eac-92e2-da61c86c99d5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.193339 Apr 07 13:25:31.504110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1232/2347] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:31 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:25:32.521047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1a9d80ff-7b58-44f3-80e7-c2136b04a0b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:32.521664 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1a9d80ff-7b58-44f3-80e7-c2136b04a0b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:32.527966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1a9d80ff-7b58-44f3-80e7-c2136b04a0b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:32.528457 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1a9d80ff-7b58-44f3-80e7-c2136b04a0b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:32.529220 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1a9d80ff-7b58-44f3-80e7-c2136b04a0b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:32.530200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1a9d80ff-7b58-44f3-80e7-c2136b04a0b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:32.666388 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1a9d80ff-7b58-44f3-80e7-c2136b04a0b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:32.674880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1a9d80ff-7b58-44f3-80e7-c2136b04a0b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157903 Apr 07 13:25:32.675449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1116/2348] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:33.690971 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1039deb5-5889-4dff-a74c-b3686ee1faa4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:33.691878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1039deb5-5889-4dff-a74c-b3686ee1faa4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:33.703293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1039deb5-5889-4dff-a74c-b3686ee1faa4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:33.704087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1039deb5-5889-4dff-a74c-b3686ee1faa4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:33.705533 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1039deb5-5889-4dff-a74c-b3686ee1faa4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:33.706864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1039deb5-5889-4dff-a74c-b3686ee1faa4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:33.876577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1039deb5-5889-4dff-a74c-b3686ee1faa4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:33.884458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1039deb5-5889-4dff-a74c-b3686ee1faa4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.197362 Apr 07 13:25:33.885333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1233/2349] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:33 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:34.903627 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e51d4616-3064-4511-8179-f24bad0b4207 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:34.905470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e51d4616-3064-4511-8179-f24bad0b4207 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:34.912327 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e51d4616-3064-4511-8179-f24bad0b4207 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:34.913310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e51d4616-3064-4511-8179-f24bad0b4207 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:34.914424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e51d4616-3064-4511-8179-f24bad0b4207 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:34.915259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e51d4616-3064-4511-8179-f24bad0b4207 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:35.391636 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e51d4616-3064-4511-8179-f24bad0b4207 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:35.399964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e51d4616-3064-4511-8179-f24bad0b4207 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.501506 Apr 07 13:25:35.400994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1117/2350] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:34 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:36.417632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2e904e0c-814c-45a9-9c92-d33c181b82c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:36.418251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2e904e0c-814c-45a9-9c92-d33c181b82c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:36.424933 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2e904e0c-814c-45a9-9c92-d33c181b82c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:36.425384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2e904e0c-814c-45a9-9c92-d33c181b82c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:36.426368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2e904e0c-814c-45a9-9c92-d33c181b82c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:36.426807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2e904e0c-814c-45a9-9c92-d33c181b82c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:36.706267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2e904e0c-814c-45a9-9c92-d33c181b82c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:36.715225 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2e904e0c-814c-45a9-9c92-d33c181b82c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.301588 Apr 07 13:25:36.715861 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1234/2351] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:36 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:37.696298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4870fa37-64ed-43bc-9f46-3702bef20267 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: .version_select at 0x7fde586681f0>, body: {"keypair": {"name": "tempest-keypair-1391290786"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:25:37.710862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-4870fa37-64ed-43bc-9f46-3702bef20267 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:25:37.714669 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-4870fa37-64ed-43bc-9f46-3702bef20267 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for user 16a8cd81c8064dc087a8f735cb0b78eb and project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:25:37.732890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6c22ef70-7d2d-4cd8-8b02-9a9375601dd6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:37.733686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6c22ef70-7d2d-4cd8-8b02-9a9375601dd6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:37.740034 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c22ef70-7d2d-4cd8-8b02-9a9375601dd6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:37.740540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c22ef70-7d2d-4cd8-8b02-9a9375601dd6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:37.741358 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c22ef70-7d2d-4cd8-8b02-9a9375601dd6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:37.741799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6c22ef70-7d2d-4cd8-8b02-9a9375601dd6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:37.876332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6c22ef70-7d2d-4cd8-8b02-9a9375601dd6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:37.886402 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6c22ef70-7d2d-4cd8-8b02-9a9375601dd6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157788 Apr 07 13:25:37.886978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1235/2352] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:25:37.962148 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-4870fa37-64ed-43bc-9f46-3702bef20267 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:25:37.965741 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-4870fa37-64ed-43bc-9f46-3702bef20267 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for user 16a8cd81c8064dc087a8f735cb0b78eb and project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:25:37.980096 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4870fa37-64ed-43bc-9f46-3702bef20267 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.392876 Apr 07 13:25:37.980749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1118/2353] 10.222.0.15 () {60 vars in 1157 bytes} [Thu Apr 7 13:25:37 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:38.904438 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-df26028e-143f-4874-a7b7-f4d34d11ac85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:38.905142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-df26028e-143f-4874-a7b7-f4d34d11ac85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:38.913273 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-df26028e-143f-4874-a7b7-f4d34d11ac85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:38.913773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-df26028e-143f-4874-a7b7-f4d34d11ac85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:38.914518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-df26028e-143f-4874-a7b7-f4d34d11ac85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:38.915406 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-df26028e-143f-4874-a7b7-f4d34d11ac85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:39.085950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-df26028e-143f-4874-a7b7-f4d34d11ac85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:39.097105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-df26028e-143f-4874-a7b7-f4d34d11ac85 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.196064 Apr 07 13:25:39.098263 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1236/2354] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:39.312366 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-196442559", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e3eed74-adac-4076-a10b-beef7f6c6aa3"}], "security_groups": [{"name": "tempest-securitygroup--126912342"}], "key_name": "tempest-keypair-1391290786", "user_data": "}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:25:39.418884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.network.neutron [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] validate_networks() for [('3e3eed74-adac-4076-a10b-beef7f6c6aa3', None, None, None, None, None)] {{(pid=116892) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 13:25:39.879797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Flavor limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 13:25:39.880417 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Image limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 13:25:39.880893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Flavor pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 13:25:39.881309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Image pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 13:25:39.881726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 13:25:39.891341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:39.891827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:39.892733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:39.893172 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:39.918865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:25:39.925510 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for user 16a8cd81c8064dc087a8f735cb0b78eb and project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:25:39.937280 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Going to run 1 instances... {{(pid=116892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 13:25:39.939735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 13:25:39.992863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-352fb21f-d7de-429b-8e6f-7d2bc083c94a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.685708 Apr 07 13:25:39.993514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1119/2355] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 13:25:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 13:25:40.004037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-325cf67d-1180-47e5-8f9a-4d183f31f4d6 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:40.005303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-325cf67d-1180-47e5-8f9a-4d183f31f4d6 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:40.061729 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-325cf67d-1180-47e5-8f9a-4d183f31f4d6 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:40.069560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-325cf67d-1180-47e5-8f9a-4d183f31f4d6 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 200 len: 1241 microversion: 2.1 time: 0.069105 Apr 07 13:25:40.070455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1237/2356] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:39 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:40.116514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-275a6f45-ee8b-4268-9df6-ae60f4d44028 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:40.117627 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-275a6f45-ee8b-4268-9df6-ae60f4d44028 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:40.123279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-275a6f45-ee8b-4268-9df6-ae60f4d44028 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:40.123738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-275a6f45-ee8b-4268-9df6-ae60f4d44028 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:40.124539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-275a6f45-ee8b-4268-9df6-ae60f4d44028 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:40.125056 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-275a6f45-ee8b-4268-9df6-ae60f4d44028 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:40.267021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-275a6f45-ee8b-4268-9df6-ae60f4d44028 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:40.281251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-275a6f45-ee8b-4268-9df6-ae60f4d44028 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.168498 Apr 07 13:25:40.289422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1120/2357] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:40 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:41.086990 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0de90ff3-0e4f-4055-aa9e-de1bd7e9e223 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:41.087866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0de90ff3-0e4f-4055-aa9e-de1bd7e9e223 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:41.095036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0de90ff3-0e4f-4055-aa9e-de1bd7e9e223 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:41.096067 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0de90ff3-0e4f-4055-aa9e-de1bd7e9e223 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:41.097142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0de90ff3-0e4f-4055-aa9e-de1bd7e9e223 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:41.098659 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0de90ff3-0e4f-4055-aa9e-de1bd7e9e223 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:41.201399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0de90ff3-0e4f-4055-aa9e-de1bd7e9e223 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:41.208850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0de90ff3-0e4f-4055-aa9e-de1bd7e9e223 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 200 len: 1299 microversion: 2.1 time: 0.125838 Apr 07 13:25:41.209412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1238/2358] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:41 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 1299 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:41.298921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b0e52f87-7427-464a-b6aa-38107be61032 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:41.299468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b0e52f87-7427-464a-b6aa-38107be61032 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:41.305550 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0e52f87-7427-464a-b6aa-38107be61032 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:41.306014 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0e52f87-7427-464a-b6aa-38107be61032 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:41.306790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0e52f87-7427-464a-b6aa-38107be61032 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:41.307268 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b0e52f87-7427-464a-b6aa-38107be61032 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:41.445221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b0e52f87-7427-464a-b6aa-38107be61032 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:41.453452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b0e52f87-7427-464a-b6aa-38107be61032 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.159011 Apr 07 13:25:41.455884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1121/2359] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:41 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:42.226285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c9836581-d790-4140-ac0d-957f1bed9e47 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:42.226908 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c9836581-d790-4140-ac0d-957f1bed9e47 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:42.234303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9836581-d790-4140-ac0d-957f1bed9e47 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:42.234766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9836581-d790-4140-ac0d-957f1bed9e47 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:42.235711 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9836581-d790-4140-ac0d-957f1bed9e47 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:42.236178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9836581-d790-4140-ac0d-957f1bed9e47 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:42.358863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-75a54d68-be2f-4a26-8304-0b92fc1bc66d req-bf1264eb-3e45-4565-a685-ac573cfac78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3f987d-04a9-4057-b8ef-370f57761259", "tag": "f60ac850-6e0b-4144-bd3d-3318c926f6ba"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:25:42.371222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-75a54d68-be2f-4a26-8304-0b92fc1bc66d req-bf1264eb-3e45-4565-a685-ac573cfac78e service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:42.371613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-75a54d68-be2f-4a26-8304-0b92fc1bc66d req-bf1264eb-3e45-4565-a685-ac573cfac78e service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:42.384029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-75a54d68-be2f-4a26-8304-0b92fc1bc66d req-bf1264eb-3e45-4565-a685-ac573cfac78e service nova] Creating event network-changed:f60ac850-6e0b-4144-bd3d-3318c926f6ba for instance ef3f987d-04a9-4057-b8ef-370f57761259 on hv-cinder-83694 Apr 07 13:25:42.390116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-75a54d68-be2f-4a26-8304-0b92fc1bc66d req-bf1264eb-3e45-4565-a685-ac573cfac78e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039943 Apr 07 13:25:42.391088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1122/2360] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:25:42.471354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2940042e-31d9-4216-8621-6a950df29ada tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:42.472470 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2940042e-31d9-4216-8621-6a950df29ada tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:42.476191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c9836581-d790-4140-ac0d-957f1bed9e47 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:42.480115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2940042e-31d9-4216-8621-6a950df29ada tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:42.480598 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2940042e-31d9-4216-8621-6a950df29ada tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:42.481628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2940042e-31d9-4216-8621-6a950df29ada tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:42.482102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2940042e-31d9-4216-8621-6a950df29ada tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:42.485597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c9836581-d790-4140-ac0d-957f1bed9e47 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 200 len: 1366 microversion: 2.1 time: 0.263398 Apr 07 13:25:42.486879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1239/2361] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:42 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:42.621495 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2940042e-31d9-4216-8621-6a950df29ada tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:42.638081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2940042e-31d9-4216-8621-6a950df29ada tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.170926 Apr 07 13:25:42.639378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1123/2362] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:42 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:43.502476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5edf4998-027d-4967-ba66-885f6036a56e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:43.503090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5edf4998-027d-4967-ba66-885f6036a56e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:43.509461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5edf4998-027d-4967-ba66-885f6036a56e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:43.509907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5edf4998-027d-4967-ba66-885f6036a56e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:43.510656 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5edf4998-027d-4967-ba66-885f6036a56e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:43.511087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5edf4998-027d-4967-ba66-885f6036a56e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:43.658726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-25626719-f14c-4859-9379-43b7a48a229a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:43.659231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5edf4998-027d-4967-ba66-885f6036a56e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:43.659385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-25626719-f14c-4859-9379-43b7a48a229a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:43.666037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25626719-f14c-4859-9379-43b7a48a229a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:43.666782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25626719-f14c-4859-9379-43b7a48a229a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:43.667293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5edf4998-027d-4967-ba66-885f6036a56e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 200 len: 1366 microversion: 2.1 time: 0.169196 Apr 07 13:25:43.667564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25626719-f14c-4859-9379-43b7a48a229a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:43.667999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1240/2363] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:43 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:43.673993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-25626719-f14c-4859-9379-43b7a48a229a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:43.814519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-25626719-f14c-4859-9379-43b7a48a229a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:43.822302 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-25626719-f14c-4859-9379-43b7a48a229a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.168591 Apr 07 13:25:43.822891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1124/2364] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:43 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:44.685572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b69c0652-9262-47cc-a719-d9e7fec2303d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:44.686331 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b69c0652-9262-47cc-a719-d9e7fec2303d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:44.692843 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b69c0652-9262-47cc-a719-d9e7fec2303d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:44.693302 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b69c0652-9262-47cc-a719-d9e7fec2303d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:44.694071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b69c0652-9262-47cc-a719-d9e7fec2303d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:44.694514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b69c0652-9262-47cc-a719-d9e7fec2303d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:44.828480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b69c0652-9262-47cc-a719-d9e7fec2303d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:44.836047 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b69c0652-9262-47cc-a719-d9e7fec2303d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 200 len: 1366 microversion: 2.1 time: 0.154321 Apr 07 13:25:44.836575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1241/2365] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:44 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:44.838648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ca5d70a5-e60c-4091-91c3-845d7ac41da5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:44.839268 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ca5d70a5-e60c-4091-91c3-845d7ac41da5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:44.846319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca5d70a5-e60c-4091-91c3-845d7ac41da5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:44.846792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca5d70a5-e60c-4091-91c3-845d7ac41da5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:44.847541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca5d70a5-e60c-4091-91c3-845d7ac41da5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:44.847985 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ca5d70a5-e60c-4091-91c3-845d7ac41da5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:44.983988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ca5d70a5-e60c-4091-91c3-845d7ac41da5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:44.991767 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ca5d70a5-e60c-4091-91c3-845d7ac41da5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156904 Apr 07 13:25:44.992364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1125/2366] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:44 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:25:45.853309 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6347840a-51c4-400e-8271-6203d2f782df tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:45.853788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6347840a-51c4-400e-8271-6203d2f782df tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:45.861275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6347840a-51c4-400e-8271-6203d2f782df tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:45.861722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6347840a-51c4-400e-8271-6203d2f782df tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:45.862520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6347840a-51c4-400e-8271-6203d2f782df tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:45.862950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6347840a-51c4-400e-8271-6203d2f782df tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:45.993913 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6347840a-51c4-400e-8271-6203d2f782df tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:46.002931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6347840a-51c4-400e-8271-6203d2f782df tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 200 len: 1366 microversion: 2.1 time: 0.153573 Apr 07 13:25:46.004073 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1242/2367] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:45 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:46.010513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-68b4eedd-1f14-4edf-96e9-9bbf55b40703 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:46.011930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-68b4eedd-1f14-4edf-96e9-9bbf55b40703 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:46.019380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68b4eedd-1f14-4edf-96e9-9bbf55b40703 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:46.019833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68b4eedd-1f14-4edf-96e9-9bbf55b40703 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:46.020648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68b4eedd-1f14-4edf-96e9-9bbf55b40703 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:46.021084 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-68b4eedd-1f14-4edf-96e9-9bbf55b40703 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:46.161620 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-68b4eedd-1f14-4edf-96e9-9bbf55b40703 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:46.170140 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-68b4eedd-1f14-4edf-96e9-9bbf55b40703 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.163770 Apr 07 13:25:46.171331 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1126/2368] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:46 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:47.020733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5c71aaa9-b98b-47e7-9787-0dc3f95ffb2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:47.021267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5c71aaa9-b98b-47e7-9787-0dc3f95ffb2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:47.027495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c71aaa9-b98b-47e7-9787-0dc3f95ffb2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:47.027948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c71aaa9-b98b-47e7-9787-0dc3f95ffb2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:47.028750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c71aaa9-b98b-47e7-9787-0dc3f95ffb2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:47.029289 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c71aaa9-b98b-47e7-9787-0dc3f95ffb2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:47.156815 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5c71aaa9-b98b-47e7-9787-0dc3f95ffb2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:47.164247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5c71aaa9-b98b-47e7-9787-0dc3f95ffb2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 200 len: 1366 microversion: 2.1 time: 0.147439 Apr 07 13:25:47.164808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1243/2369] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:47 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:47.187254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5a807f94-1bd0-4bc1-9559-87b58471ab3f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:47.187861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5a807f94-1bd0-4bc1-9559-87b58471ab3f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:47.194124 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5a807f94-1bd0-4bc1-9559-87b58471ab3f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:47.194579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5a807f94-1bd0-4bc1-9559-87b58471ab3f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:47.195352 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5a807f94-1bd0-4bc1-9559-87b58471ab3f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:47.195792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5a807f94-1bd0-4bc1-9559-87b58471ab3f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:47.330762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5a807f94-1bd0-4bc1-9559-87b58471ab3f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:47.338518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5a807f94-1bd0-4bc1-9559-87b58471ab3f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155786 Apr 07 13:25:47.339082 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1127/2370] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:47 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:48.181689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fbe8ea64-da84-46c6-bca8-63a447feadfb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:48.182303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fbe8ea64-da84-46c6-bca8-63a447feadfb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:48.189523 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fbe8ea64-da84-46c6-bca8-63a447feadfb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:48.189773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fbe8ea64-da84-46c6-bca8-63a447feadfb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:48.190532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fbe8ea64-da84-46c6-bca8-63a447feadfb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:48.190966 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fbe8ea64-da84-46c6-bca8-63a447feadfb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:48.199116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-468a6573-bbd1-46b3-a7d2-ad8b12c5336c req-c30f07f1-cddf-4ed7-873b-916ff5528cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3f987d-04a9-4057-b8ef-370f57761259", "name": "network-vif-plugged", "status": "completed", "tag": "f60ac850-6e0b-4144-bd3d-3318c926f6ba"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:25:48.208487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-468a6573-bbd1-46b3-a7d2-ad8b12c5336c req-c30f07f1-cddf-4ed7-873b-916ff5528cc8 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:48.209046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-468a6573-bbd1-46b3-a7d2-ad8b12c5336c req-c30f07f1-cddf-4ed7-873b-916ff5528cc8 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:48.221547 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-468a6573-bbd1-46b3-a7d2-ad8b12c5336c req-c30f07f1-cddf-4ed7-873b-916ff5528cc8 service nova] Creating event network-vif-plugged:f60ac850-6e0b-4144-bd3d-3318c926f6ba for instance ef3f987d-04a9-4057-b8ef-370f57761259 on hv-cinder-83694 Apr 07 13:25:48.226575 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-468a6573-bbd1-46b3-a7d2-ad8b12c5336c req-c30f07f1-cddf-4ed7-873b-916ff5528cc8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031247 Apr 07 13:25:48.227157 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1128/2371] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:25:48.336933 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fbe8ea64-da84-46c6-bca8-63a447feadfb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:48.344836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fbe8ea64-da84-46c6-bca8-63a447feadfb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 200 len: 1366 microversion: 2.1 time: 0.166955 Apr 07 13:25:48.345887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1244/2372] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:48 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:48.355181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8ec2d9c2-953a-4409-ac06-81706f8f4bea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:48.355895 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8ec2d9c2-953a-4409-ac06-81706f8f4bea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:48.362914 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8ec2d9c2-953a-4409-ac06-81706f8f4bea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:48.363376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8ec2d9c2-953a-4409-ac06-81706f8f4bea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:48.364166 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8ec2d9c2-953a-4409-ac06-81706f8f4bea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:48.364625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8ec2d9c2-953a-4409-ac06-81706f8f4bea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:48.497133 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8ec2d9c2-953a-4409-ac06-81706f8f4bea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:48.505785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8ec2d9c2-953a-4409-ac06-81706f8f4bea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154787 Apr 07 13:25:48.506355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1129/2373] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:48 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:49.361625 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bd56b5cc-fe85-4b57-a0d6-0f5208292d2e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:49.362249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bd56b5cc-fe85-4b57-a0d6-0f5208292d2e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:49.368591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bd56b5cc-fe85-4b57-a0d6-0f5208292d2e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:49.369050 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bd56b5cc-fe85-4b57-a0d6-0f5208292d2e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:49.369816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bd56b5cc-fe85-4b57-a0d6-0f5208292d2e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:49.370252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bd56b5cc-fe85-4b57-a0d6-0f5208292d2e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:49.513743 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bd56b5cc-fe85-4b57-a0d6-0f5208292d2e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:49.521380 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bd56b5cc-fe85-4b57-a0d6-0f5208292d2e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 200 len: 1366 microversion: 2.1 time: 0.164123 Apr 07 13:25:49.521954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1245/2374] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:49 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:49.523830 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-af5db5b9-0e63-4356-87e1-8a786dd7ef37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:49.524478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-af5db5b9-0e63-4356-87e1-8a786dd7ef37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:49.530968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-af5db5b9-0e63-4356-87e1-8a786dd7ef37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:49.531431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-af5db5b9-0e63-4356-87e1-8a786dd7ef37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:49.532265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-af5db5b9-0e63-4356-87e1-8a786dd7ef37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:49.532714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-af5db5b9-0e63-4356-87e1-8a786dd7ef37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:49.665480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-af5db5b9-0e63-4356-87e1-8a786dd7ef37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:49.673986 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-af5db5b9-0e63-4356-87e1-8a786dd7ef37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154149 Apr 07 13:25:49.674555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1130/2375] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:49 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:25:50.538489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-008d0df5-3173-4326-9271-f21059ac7aa5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:50.539111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-008d0df5-3173-4326-9271-f21059ac7aa5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:50.546344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-008d0df5-3173-4326-9271-f21059ac7aa5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:50.546808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-008d0df5-3173-4326-9271-f21059ac7aa5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:50.547573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-008d0df5-3173-4326-9271-f21059ac7aa5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:50.548016 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-008d0df5-3173-4326-9271-f21059ac7aa5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:50.676860 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-008d0df5-3173-4326-9271-f21059ac7aa5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:50.684065 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-008d0df5-3173-4326-9271-f21059ac7aa5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 200 len: 1555 microversion: 2.1 time: 0.149715 Apr 07 13:25:50.686422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1246/2376] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:50 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:50.691046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a5c0010e-ef91-49f0-9ef3-c32011d594c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:50.691670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a5c0010e-ef91-49f0-9ef3-c32011d594c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:50.700587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a5c0010e-ef91-49f0-9ef3-c32011d594c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:50.701067 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a5c0010e-ef91-49f0-9ef3-c32011d594c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:50.701850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a5c0010e-ef91-49f0-9ef3-c32011d594c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:50.702331 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a5c0010e-ef91-49f0-9ef3-c32011d594c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:50.702542 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-56c994f2-5f6a-45ca-b33e-91a871d1a383 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:50.702844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-56c994f2-5f6a-45ca-b33e-91a871d1a383 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:50.709612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56c994f2-5f6a-45ca-b33e-91a871d1a383 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:50.710191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56c994f2-5f6a-45ca-b33e-91a871d1a383 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:50.711106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56c994f2-5f6a-45ca-b33e-91a871d1a383 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:50.711842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56c994f2-5f6a-45ca-b33e-91a871d1a383 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:50.796710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-56c994f2-5f6a-45ca-b33e-91a871d1a383 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098413 Apr 07 13:25:50.797303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1247/2377] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Apr 7 13:25:50 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:25:50.835091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a5c0010e-ef91-49f0-9ef3-c32011d594c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:50.844502 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a5c0010e-ef91-49f0-9ef3-c32011d594c4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157198 Apr 07 13:25:50.845324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1131/2378] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:25:51.862283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c51c73c3-522e-4b74-a3ac-4f933453d3a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:51.863104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c51c73c3-522e-4b74-a3ac-4f933453d3a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:51.869025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c51c73c3-522e-4b74-a3ac-4f933453d3a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:51.869473 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c51c73c3-522e-4b74-a3ac-4f933453d3a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:51.870236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c51c73c3-522e-4b74-a3ac-4f933453d3a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:51.870961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c51c73c3-522e-4b74-a3ac-4f933453d3a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:52.109501 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c51c73c3-522e-4b74-a3ac-4f933453d3a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:52.120487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-ea431f7d-11bf-479b-8875-801f4409256c req-b2817320-abdd-4b32-ac5b-959567e08c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3f987d-04a9-4057-b8ef-370f57761259", "tag": "f60ac850-6e0b-4144-bd3d-3318c926f6ba"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:25:52.127485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c51c73c3-522e-4b74-a3ac-4f933453d3a5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.269381 Apr 07 13:25:52.128065 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1248/2379] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:51 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:52.129369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-ea431f7d-11bf-479b-8875-801f4409256c req-b2817320-abdd-4b32-ac5b-959567e08c33 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:52.129910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-ea431f7d-11bf-479b-8875-801f4409256c req-b2817320-abdd-4b32-ac5b-959567e08c33 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:52.142806 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-ea431f7d-11bf-479b-8875-801f4409256c req-b2817320-abdd-4b32-ac5b-959567e08c33 service nova] Creating event network-changed:f60ac850-6e0b-4144-bd3d-3318c926f6ba for instance ef3f987d-04a9-4057-b8ef-370f57761259 on hv-cinder-83694 Apr 07 13:25:52.147974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-ea431f7d-11bf-479b-8875-801f4409256c req-b2817320-abdd-4b32-ac5b-959567e08c33 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031673 Apr 07 13:25:52.148713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1132/2380] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:25:53.144623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2d9cafb3-ddb2-43a0-a9f2-b25611af66b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:53.145227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2d9cafb3-ddb2-43a0-a9f2-b25611af66b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:53.151407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2d9cafb3-ddb2-43a0-a9f2-b25611af66b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:53.151851 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2d9cafb3-ddb2-43a0-a9f2-b25611af66b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:53.152699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2d9cafb3-ddb2-43a0-a9f2-b25611af66b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:53.153066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2d9cafb3-ddb2-43a0-a9f2-b25611af66b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:53.290081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2d9cafb3-ddb2-43a0-a9f2-b25611af66b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:53.298594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2d9cafb3-ddb2-43a0-a9f2-b25611af66b7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157758 Apr 07 13:25:53.299150 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1249/2381] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:53 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:54.317006 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a19f1e9f-417c-4bf2-8f2d-58fe16d78236 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:54.317710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a19f1e9f-417c-4bf2-8f2d-58fe16d78236 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:54.323824 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a19f1e9f-417c-4bf2-8f2d-58fe16d78236 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:54.324321 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a19f1e9f-417c-4bf2-8f2d-58fe16d78236 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:54.325086 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a19f1e9f-417c-4bf2-8f2d-58fe16d78236 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:54.326202 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a19f1e9f-417c-4bf2-8f2d-58fe16d78236 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:54.345375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:25:54.345964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:25:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:25:54.456283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a19f1e9f-417c-4bf2-8f2d-58fe16d78236 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:54.464022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a19f1e9f-417c-4bf2-8f2d-58fe16d78236 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151723 Apr 07 13:25:54.464614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1133/2382] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:54 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:55.481345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-eddfe56c-f1b8-4225-9969-00c4effe928e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:55.482183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-eddfe56c-f1b8-4225-9969-00c4effe928e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:55.488768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eddfe56c-f1b8-4225-9969-00c4effe928e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:55.489227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eddfe56c-f1b8-4225-9969-00c4effe928e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:55.489997 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eddfe56c-f1b8-4225-9969-00c4effe928e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:55.490441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eddfe56c-f1b8-4225-9969-00c4effe928e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:55.620076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-eddfe56c-f1b8-4225-9969-00c4effe928e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:55.627936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-eddfe56c-f1b8-4225-9969-00c4effe928e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150440 Apr 07 13:25:55.628524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1250/2383] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:55 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:56.644918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c626f6ac-eba0-46b3-8986-1cf71761378b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:56.645554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c626f6ac-eba0-46b3-8986-1cf71761378b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:56.651826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c626f6ac-eba0-46b3-8986-1cf71761378b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:56.652320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c626f6ac-eba0-46b3-8986-1cf71761378b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:56.653090 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c626f6ac-eba0-46b3-8986-1cf71761378b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:56.654071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c626f6ac-eba0-46b3-8986-1cf71761378b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:56.788303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c626f6ac-eba0-46b3-8986-1cf71761378b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:56.796781 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c626f6ac-eba0-46b3-8986-1cf71761378b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155724 Apr 07 13:25:56.797347 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1134/2384] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:56 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:57.813759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-05a40353-8925-4616-b604-78a17a7ec069 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:57.814373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-05a40353-8925-4616-b604-78a17a7ec069 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:57.820652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-05a40353-8925-4616-b604-78a17a7ec069 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:57.821102 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-05a40353-8925-4616-b604-78a17a7ec069 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:57.821862 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-05a40353-8925-4616-b604-78a17a7ec069 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:57.822297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-05a40353-8925-4616-b604-78a17a7ec069 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:57.953463 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-05a40353-8925-4616-b604-78a17a7ec069 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:57.961222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-05a40353-8925-4616-b604-78a17a7ec069 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151442 Apr 07 13:25:57.961782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1251/2385] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:25:58.980835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-28ea71cf-b125-4800-b321-d607aca07614 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:25:58.981524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-28ea71cf-b125-4800-b321-d607aca07614 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:25:58.988020 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-28ea71cf-b125-4800-b321-d607aca07614 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:58.988516 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-28ea71cf-b125-4800-b321-d607aca07614 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:58.989289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-28ea71cf-b125-4800-b321-d607aca07614 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:25:58.989737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-28ea71cf-b125-4800-b321-d607aca07614 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:25:59.124484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-28ea71cf-b125-4800-b321-d607aca07614 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:25:59.132189 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-28ea71cf-b125-4800-b321-d607aca07614 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155188 Apr 07 13:25:59.132753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1135/2386] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:25:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:00.149881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-70a9cb2a-cb47-4acc-92db-85ef73da9a54 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:00.150481 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-70a9cb2a-cb47-4acc-92db-85ef73da9a54 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:00.156927 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-70a9cb2a-cb47-4acc-92db-85ef73da9a54 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:00.157372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-70a9cb2a-cb47-4acc-92db-85ef73da9a54 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:00.158124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-70a9cb2a-cb47-4acc-92db-85ef73da9a54 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:00.158557 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-70a9cb2a-cb47-4acc-92db-85ef73da9a54 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:00.293727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-70a9cb2a-cb47-4acc-92db-85ef73da9a54 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:00.302173 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-70a9cb2a-cb47-4acc-92db-85ef73da9a54 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156168 Apr 07 13:26:00.302734 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1252/2387] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:00 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:01.318465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-74b1b727-d627-458c-a8b9-cf8fbf17cfb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:01.319106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-74b1b727-d627-458c-a8b9-cf8fbf17cfb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:01.326336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74b1b727-d627-458c-a8b9-cf8fbf17cfb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:01.326797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74b1b727-d627-458c-a8b9-cf8fbf17cfb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:01.327564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74b1b727-d627-458c-a8b9-cf8fbf17cfb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:01.327998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74b1b727-d627-458c-a8b9-cf8fbf17cfb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:01.461428 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-74b1b727-d627-458c-a8b9-cf8fbf17cfb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:01.470299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-74b1b727-d627-458c-a8b9-cf8fbf17cfb4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155681 Apr 07 13:26:01.470906 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1136/2388] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:01 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:02.486963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8cfb80f2-8312-478d-acd9-ed95a835f869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:02.487564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8cfb80f2-8312-478d-acd9-ed95a835f869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:02.493843 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8cfb80f2-8312-478d-acd9-ed95a835f869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:02.494423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8cfb80f2-8312-478d-acd9-ed95a835f869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:02.495185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8cfb80f2-8312-478d-acd9-ed95a835f869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:02.495621 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8cfb80f2-8312-478d-acd9-ed95a835f869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:02.628825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8cfb80f2-8312-478d-acd9-ed95a835f869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:02.636550 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8cfb80f2-8312-478d-acd9-ed95a835f869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153414 Apr 07 13:26:02.637147 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1253/2389] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:02 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:03.654813 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a4bdf056-6087-4087-9f97-2ccbee9c6f97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:03.655493 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a4bdf056-6087-4087-9f97-2ccbee9c6f97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:03.662174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a4bdf056-6087-4087-9f97-2ccbee9c6f97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:03.662628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a4bdf056-6087-4087-9f97-2ccbee9c6f97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:03.663400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a4bdf056-6087-4087-9f97-2ccbee9c6f97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:03.663841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a4bdf056-6087-4087-9f97-2ccbee9c6f97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:03.792811 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a4bdf056-6087-4087-9f97-2ccbee9c6f97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:03.801165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a4bdf056-6087-4087-9f97-2ccbee9c6f97 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150493 Apr 07 13:26:03.801728 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1137/2390] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:03 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:04.818408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8308787e-f3c3-49c4-b10e-0642091945dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:04.819070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8308787e-f3c3-49c4-b10e-0642091945dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:04.826071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8308787e-f3c3-49c4-b10e-0642091945dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:04.826522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8308787e-f3c3-49c4-b10e-0642091945dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:04.827282 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8308787e-f3c3-49c4-b10e-0642091945dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:04.827719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8308787e-f3c3-49c4-b10e-0642091945dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:04.962612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8308787e-f3c3-49c4-b10e-0642091945dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:04.970779 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8308787e-f3c3-49c4-b10e-0642091945dc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156274 Apr 07 13:26:04.971429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1254/2391] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:04 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:05.987939 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5963ea95-e097-44a8-99fe-85679f20f6cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:05.988571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5963ea95-e097-44a8-99fe-85679f20f6cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:05.994607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5963ea95-e097-44a8-99fe-85679f20f6cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:05.995058 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5963ea95-e097-44a8-99fe-85679f20f6cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:05.995818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5963ea95-e097-44a8-99fe-85679f20f6cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:05.996297 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5963ea95-e097-44a8-99fe-85679f20f6cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:06.141541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5963ea95-e097-44a8-99fe-85679f20f6cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:06.150318 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5963ea95-e097-44a8-99fe-85679f20f6cc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.166201 Apr 07 13:26:06.150893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1138/2392] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:05 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:07.168166 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b720b01c-f187-4fe2-baa9-7ef0ae2891ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:07.169879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b720b01c-f187-4fe2-baa9-7ef0ae2891ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:07.176134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b720b01c-f187-4fe2-baa9-7ef0ae2891ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:07.176617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b720b01c-f187-4fe2-baa9-7ef0ae2891ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:07.177366 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b720b01c-f187-4fe2-baa9-7ef0ae2891ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:07.177798 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b720b01c-f187-4fe2-baa9-7ef0ae2891ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:07.305667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b720b01c-f187-4fe2-baa9-7ef0ae2891ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:07.313882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b720b01c-f187-4fe2-baa9-7ef0ae2891ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149548 Apr 07 13:26:07.314495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1255/2393] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:07 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:08.331251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-80b3cfe5-9c32-4624-a388-a55e7a442199 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:08.331940 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-80b3cfe5-9c32-4624-a388-a55e7a442199 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:08.338139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-80b3cfe5-9c32-4624-a388-a55e7a442199 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:08.338585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-80b3cfe5-9c32-4624-a388-a55e7a442199 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:08.339336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-80b3cfe5-9c32-4624-a388-a55e7a442199 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:08.339769 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-80b3cfe5-9c32-4624-a388-a55e7a442199 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:08.470084 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-80b3cfe5-9c32-4624-a388-a55e7a442199 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:08.477868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-80b3cfe5-9c32-4624-a388-a55e7a442199 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150455 Apr 07 13:26:08.478438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1139/2394] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:08 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:09.494759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-311ea3ab-6517-4405-ae5d-a8b6cea02ae9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:09.495368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-311ea3ab-6517-4405-ae5d-a8b6cea02ae9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:09.502118 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-311ea3ab-6517-4405-ae5d-a8b6cea02ae9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:09.502565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-311ea3ab-6517-4405-ae5d-a8b6cea02ae9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:09.503318 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-311ea3ab-6517-4405-ae5d-a8b6cea02ae9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:09.503751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-311ea3ab-6517-4405-ae5d-a8b6cea02ae9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:09.636846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-311ea3ab-6517-4405-ae5d-a8b6cea02ae9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:09.645473 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-311ea3ab-6517-4405-ae5d-a8b6cea02ae9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154519 Apr 07 13:26:09.646028 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1256/2395] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:09 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:10.662671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2b273501-c3eb-4a06-b635-c04149d504b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:10.663286 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2b273501-c3eb-4a06-b635-c04149d504b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:10.670440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2b273501-c3eb-4a06-b635-c04149d504b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:10.670899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2b273501-c3eb-4a06-b635-c04149d504b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:10.671657 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2b273501-c3eb-4a06-b635-c04149d504b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:10.672093 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2b273501-c3eb-4a06-b635-c04149d504b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:10.803922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2b273501-c3eb-4a06-b635-c04149d504b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:10.811893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2b273501-c3eb-4a06-b635-c04149d504b6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153295 Apr 07 13:26:10.812489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1140/2396] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:10 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:11.828892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5f2b6d91-c84d-4232-9064-8807c9d01a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:11.829503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5f2b6d91-c84d-4232-9064-8807c9d01a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:11.835776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5f2b6d91-c84d-4232-9064-8807c9d01a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:11.836214 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5f2b6d91-c84d-4232-9064-8807c9d01a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:11.836980 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5f2b6d91-c84d-4232-9064-8807c9d01a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:11.837415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5f2b6d91-c84d-4232-9064-8807c9d01a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:11.967779 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5f2b6d91-c84d-4232-9064-8807c9d01a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:11.975954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5f2b6d91-c84d-4232-9064-8807c9d01a9f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151072 Apr 07 13:26:11.976590 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1257/2397] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:11 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:12.993050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e06870ce-d999-463f-86c8-5fa1669fac94 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:12.993672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e06870ce-d999-463f-86c8-5fa1669fac94 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:13.001101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e06870ce-d999-463f-86c8-5fa1669fac94 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:13.001567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e06870ce-d999-463f-86c8-5fa1669fac94 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:13.002361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e06870ce-d999-463f-86c8-5fa1669fac94 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:13.002805 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e06870ce-d999-463f-86c8-5fa1669fac94 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:13.140092 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e06870ce-d999-463f-86c8-5fa1669fac94 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:13.147834 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e06870ce-d999-463f-86c8-5fa1669fac94 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.158611 Apr 07 13:26:13.148429 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1141/2398] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:12 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:13.852506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:26:13.853005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:26:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:26:14.165631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d02c552d-0e6a-4d57-9d1f-d2a699b1a075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:14.166164 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d02c552d-0e6a-4d57-9d1f-d2a699b1a075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:14.173007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d02c552d-0e6a-4d57-9d1f-d2a699b1a075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:14.173454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d02c552d-0e6a-4d57-9d1f-d2a699b1a075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:14.174204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d02c552d-0e6a-4d57-9d1f-d2a699b1a075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:14.174634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d02c552d-0e6a-4d57-9d1f-d2a699b1a075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:14.304197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d02c552d-0e6a-4d57-9d1f-d2a699b1a075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:14.312516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d02c552d-0e6a-4d57-9d1f-d2a699b1a075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150721 Apr 07 13:26:14.313080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1258/2399] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:14 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:15.330540 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-174edb1f-8c98-440d-a771-804c498dc97c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:15.331097 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-174edb1f-8c98-440d-a771-804c498dc97c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:15.337370 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-174edb1f-8c98-440d-a771-804c498dc97c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:15.337816 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-174edb1f-8c98-440d-a771-804c498dc97c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:15.338570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-174edb1f-8c98-440d-a771-804c498dc97c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:15.339001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-174edb1f-8c98-440d-a771-804c498dc97c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:15.468360 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-174edb1f-8c98-440d-a771-804c498dc97c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:15.476025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-174edb1f-8c98-440d-a771-804c498dc97c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149406 Apr 07 13:26:15.476615 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1142/2400] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:15 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:16.493462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1e90c6fe-6fcd-4cca-9085-86b5a3ad33a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:16.494061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1e90c6fe-6fcd-4cca-9085-86b5a3ad33a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:16.501076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e90c6fe-6fcd-4cca-9085-86b5a3ad33a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:16.501536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e90c6fe-6fcd-4cca-9085-86b5a3ad33a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:16.502296 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e90c6fe-6fcd-4cca-9085-86b5a3ad33a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:16.502734 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e90c6fe-6fcd-4cca-9085-86b5a3ad33a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:16.638063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1e90c6fe-6fcd-4cca-9085-86b5a3ad33a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:16.645951 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1e90c6fe-6fcd-4cca-9085-86b5a3ad33a8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156371 Apr 07 13:26:16.646515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1259/2401] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:16 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:17.663573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-606d9f2f-fc4e-4702-9d39-99ccf53afa87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:17.664106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-606d9f2f-fc4e-4702-9d39-99ccf53afa87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:17.670973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-606d9f2f-fc4e-4702-9d39-99ccf53afa87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:17.671422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-606d9f2f-fc4e-4702-9d39-99ccf53afa87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:17.672202 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-606d9f2f-fc4e-4702-9d39-99ccf53afa87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:17.672639 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-606d9f2f-fc4e-4702-9d39-99ccf53afa87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:17.807827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-606d9f2f-fc4e-4702-9d39-99ccf53afa87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:17.816460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-606d9f2f-fc4e-4702-9d39-99ccf53afa87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157222 Apr 07 13:26:17.817039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1143/2402] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:17 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:18.833993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0fe0f3ae-7360-434c-bf0e-80deb4a83cdd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:18.834549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0fe0f3ae-7360-434c-bf0e-80deb4a83cdd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:18.841342 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0fe0f3ae-7360-434c-bf0e-80deb4a83cdd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:18.841788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0fe0f3ae-7360-434c-bf0e-80deb4a83cdd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:18.842544 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0fe0f3ae-7360-434c-bf0e-80deb4a83cdd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:18.842973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0fe0f3ae-7360-434c-bf0e-80deb4a83cdd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:19.086582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0fe0f3ae-7360-434c-bf0e-80deb4a83cdd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:19.098944 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0fe0f3ae-7360-434c-bf0e-80deb4a83cdd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.268760 Apr 07 13:26:19.099544 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1260/2403] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:20.116104 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-90cec111-a1a5-4c5b-b933-8e94c29d56ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:20.116912 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-90cec111-a1a5-4c5b-b933-8e94c29d56ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:20.124997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90cec111-a1a5-4c5b-b933-8e94c29d56ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:20.125455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90cec111-a1a5-4c5b-b933-8e94c29d56ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:20.126232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90cec111-a1a5-4c5b-b933-8e94c29d56ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:20.126675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-90cec111-a1a5-4c5b-b933-8e94c29d56ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:20.283977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-90cec111-a1a5-4c5b-b933-8e94c29d56ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:20.292207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-90cec111-a1a5-4c5b-b933-8e94c29d56ed tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.179927 Apr 07 13:26:20.292780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1144/2404] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:20 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:21.309413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-096a7a3e-6ef1-4558-b407-ca63e05a3314 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:21.310660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-096a7a3e-6ef1-4558-b407-ca63e05a3314 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:21.317082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-096a7a3e-6ef1-4558-b407-ca63e05a3314 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:21.317538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-096a7a3e-6ef1-4558-b407-ca63e05a3314 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:21.318307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-096a7a3e-6ef1-4558-b407-ca63e05a3314 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:21.318752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-096a7a3e-6ef1-4558-b407-ca63e05a3314 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:21.452669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-096a7a3e-6ef1-4558-b407-ca63e05a3314 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:21.463267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-096a7a3e-6ef1-4558-b407-ca63e05a3314 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157351 Apr 07 13:26:21.464051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1261/2405] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:21 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:22.479973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f8944760-50d0-463d-87ca-ad90c2a4d869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:22.480625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f8944760-50d0-463d-87ca-ad90c2a4d869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:22.486942 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f8944760-50d0-463d-87ca-ad90c2a4d869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:22.487395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f8944760-50d0-463d-87ca-ad90c2a4d869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:22.488168 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f8944760-50d0-463d-87ca-ad90c2a4d869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:22.488618 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f8944760-50d0-463d-87ca-ad90c2a4d869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:22.620585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f8944760-50d0-463d-87ca-ad90c2a4d869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:22.628557 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f8944760-50d0-463d-87ca-ad90c2a4d869 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152489 Apr 07 13:26:22.629122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1145/2406] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:22 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:23.645216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c117e20f-2b2b-4c78-973a-6047d07998ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:23.645850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c117e20f-2b2b-4c78-973a-6047d07998ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:23.651888 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c117e20f-2b2b-4c78-973a-6047d07998ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:23.652381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c117e20f-2b2b-4c78-973a-6047d07998ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:23.653141 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c117e20f-2b2b-4c78-973a-6047d07998ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:23.653578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c117e20f-2b2b-4c78-973a-6047d07998ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:23.782759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c117e20f-2b2b-4c78-973a-6047d07998ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:23.790715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c117e20f-2b2b-4c78-973a-6047d07998ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149443 Apr 07 13:26:23.791272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1262/2407] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:23 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:24.806729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f59482de-f333-48fb-bb15-d17e561662fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:24.807345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f59482de-f333-48fb-bb15-d17e561662fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:24.813679 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f59482de-f333-48fb-bb15-d17e561662fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:24.814138 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f59482de-f333-48fb-bb15-d17e561662fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:24.814903 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f59482de-f333-48fb-bb15-d17e561662fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:24.815346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f59482de-f333-48fb-bb15-d17e561662fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:24.948361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f59482de-f333-48fb-bb15-d17e561662fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:24.957018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f59482de-f333-48fb-bb15-d17e561662fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154088 Apr 07 13:26:24.957636 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1146/2408] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:24 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:25.967185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5bce9674-0d07-423a-a5d2-26d5b8c18df3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:25.967751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5bce9674-0d07-423a-a5d2-26d5b8c18df3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:25.974745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bce9674-0d07-423a-a5d2-26d5b8c18df3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:25.975191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bce9674-0d07-423a-a5d2-26d5b8c18df3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:25.975315 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-118f1178-b70b-4309-b4cf-ed011148dc3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:25.975955 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bce9674-0d07-423a-a5d2-26d5b8c18df3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:25.976084 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-118f1178-b70b-4309-b4cf-ed011148dc3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:25.976411 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5bce9674-0d07-423a-a5d2-26d5b8c18df3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:25.982334 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-118f1178-b70b-4309-b4cf-ed011148dc3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:25.982810 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-118f1178-b70b-4309-b4cf-ed011148dc3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:25.983585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-118f1178-b70b-4309-b4cf-ed011148dc3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:25.984025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-118f1178-b70b-4309-b4cf-ed011148dc3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:25.999165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5bce9674-0d07-423a-a5d2-26d5b8c18df3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259/ips" status: 200 len: 149 microversion: 2.1 time: 0.035932 Apr 07 13:26:26.004969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1263/2409] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Apr 7 13:26:25 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:26:26.115603 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-118f1178-b70b-4309-b4cf-ed011148dc3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:26.124396 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-118f1178-b70b-4309-b4cf-ed011148dc3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153573 Apr 07 13:26:26.124959 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1147/2410] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:25 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:26:27.141719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a3cbe2f0-5cab-401a-a7cb-268645bdba8b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:27.142362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a3cbe2f0-5cab-401a-a7cb-268645bdba8b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:27.148702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a3cbe2f0-5cab-401a-a7cb-268645bdba8b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:27.149161 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a3cbe2f0-5cab-401a-a7cb-268645bdba8b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:27.149925 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a3cbe2f0-5cab-401a-a7cb-268645bdba8b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:27.150365 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a3cbe2f0-5cab-401a-a7cb-268645bdba8b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:27.282937 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a3cbe2f0-5cab-401a-a7cb-268645bdba8b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:27.290975 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a3cbe2f0-5cab-401a-a7cb-268645bdba8b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153613 Apr 07 13:26:27.291536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1264/2411] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:28.308103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d2e3eb40-cfc4-4b36-b41c-a9b8055c96c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:28.308688 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d2e3eb40-cfc4-4b36-b41c-a9b8055c96c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:28.315528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d2e3eb40-cfc4-4b36-b41c-a9b8055c96c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:28.315976 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d2e3eb40-cfc4-4b36-b41c-a9b8055c96c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:28.316762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d2e3eb40-cfc4-4b36-b41c-a9b8055c96c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:28.317201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d2e3eb40-cfc4-4b36-b41c-a9b8055c96c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:28.449777 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d2e3eb40-cfc4-4b36-b41c-a9b8055c96c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:28.458203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d2e3eb40-cfc4-4b36-b41c-a9b8055c96c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153999 Apr 07 13:26:28.458771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1148/2412] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:28 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:29.475694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-eac1b957-c8a7-4c45-a4cd-fba3438e7f04 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:29.476938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-eac1b957-c8a7-4c45-a4cd-fba3438e7f04 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:29.483731 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eac1b957-c8a7-4c45-a4cd-fba3438e7f04 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:29.484199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eac1b957-c8a7-4c45-a4cd-fba3438e7f04 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:29.484985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eac1b957-c8a7-4c45-a4cd-fba3438e7f04 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:29.485415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-eac1b957-c8a7-4c45-a4cd-fba3438e7f04 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:29.621069 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-eac1b957-c8a7-4c45-a4cd-fba3438e7f04 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:29.628956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-eac1b957-c8a7-4c45-a4cd-fba3438e7f04 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157202 Apr 07 13:26:29.629506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1265/2413] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:29 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:30.645528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-118623e2-0540-4a3c-a758-b54906f5542f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:30.646151 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-118623e2-0540-4a3c-a758-b54906f5542f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:30.652462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-118623e2-0540-4a3c-a758-b54906f5542f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:30.652920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-118623e2-0540-4a3c-a758-b54906f5542f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:30.653691 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-118623e2-0540-4a3c-a758-b54906f5542f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:30.654186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-118623e2-0540-4a3c-a758-b54906f5542f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:30.789574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-118623e2-0540-4a3c-a758-b54906f5542f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:30.797859 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-118623e2-0540-4a3c-a758-b54906f5542f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156196 Apr 07 13:26:30.798426 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1149/2414] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:30 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:31.815366 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-616ee341-42fc-4f13-9a3d-204c422efb1a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:31.816005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-616ee341-42fc-4f13-9a3d-204c422efb1a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:31.822347 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-616ee341-42fc-4f13-9a3d-204c422efb1a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:31.822825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-616ee341-42fc-4f13-9a3d-204c422efb1a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:31.823574 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-616ee341-42fc-4f13-9a3d-204c422efb1a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:31.824006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-616ee341-42fc-4f13-9a3d-204c422efb1a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:31.960393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-616ee341-42fc-4f13-9a3d-204c422efb1a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:31.968681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-616ee341-42fc-4f13-9a3d-204c422efb1a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157276 Apr 07 13:26:31.969244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1266/2415] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:31 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:32.986296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-446ab066-403f-4798-a58c-30e12df197d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:32.986916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-446ab066-403f-4798-a58c-30e12df197d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:32.993217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-446ab066-403f-4798-a58c-30e12df197d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:32.993665 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-446ab066-403f-4798-a58c-30e12df197d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:32.994422 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-446ab066-403f-4798-a58c-30e12df197d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:32.994855 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-446ab066-403f-4798-a58c-30e12df197d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:33.127341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-446ab066-403f-4798-a58c-30e12df197d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:33.136025 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-446ab066-403f-4798-a58c-30e12df197d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154262 Apr 07 13:26:33.136616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1150/2416] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:34.153050 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-493f9eca-28b5-4041-8bc4-b7cb21cafbd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:34.153676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-493f9eca-28b5-4041-8bc4-b7cb21cafbd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:34.160874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-493f9eca-28b5-4041-8bc4-b7cb21cafbd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:34.161322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-493f9eca-28b5-4041-8bc4-b7cb21cafbd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:34.162073 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-493f9eca-28b5-4041-8bc4-b7cb21cafbd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:34.162509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-493f9eca-28b5-4041-8bc4-b7cb21cafbd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:34.292541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-493f9eca-28b5-4041-8bc4-b7cb21cafbd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:34.300476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-493f9eca-28b5-4041-8bc4-b7cb21cafbd9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151202 Apr 07 13:26:34.301030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1267/2417] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:34 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:35.318046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a427ccc0-3652-42e0-9a23-fefc0185c9ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:35.318648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a427ccc0-3652-42e0-9a23-fefc0185c9ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:35.324790 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a427ccc0-3652-42e0-9a23-fefc0185c9ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:35.325247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a427ccc0-3652-42e0-9a23-fefc0185c9ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:35.326006 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a427ccc0-3652-42e0-9a23-fefc0185c9ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:35.326445 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a427ccc0-3652-42e0-9a23-fefc0185c9ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:35.457022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a427ccc0-3652-42e0-9a23-fefc0185c9ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:35.464625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a427ccc0-3652-42e0-9a23-fefc0185c9ad tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150440 Apr 07 13:26:35.465191 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1151/2418] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:35 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:26:36.481657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d7b26d5a-ecd6-40ee-8ff0-edc3ff8e8d2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:36.482271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d7b26d5a-ecd6-40ee-8ff0-edc3ff8e8d2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:36.489209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7b26d5a-ecd6-40ee-8ff0-edc3ff8e8d2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:36.489663 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7b26d5a-ecd6-40ee-8ff0-edc3ff8e8d2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:36.490419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7b26d5a-ecd6-40ee-8ff0-edc3ff8e8d2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:36.490855 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d7b26d5a-ecd6-40ee-8ff0-edc3ff8e8d2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:36.622321 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d7b26d5a-ecd6-40ee-8ff0-edc3ff8e8d2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:36.629932 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d7b26d5a-ecd6-40ee-8ff0-edc3ff8e8d2f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152186 Apr 07 13:26:36.630487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1268/2419] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:36 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:37.646831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f092ee74-d3fb-444a-ae3a-9f34426c6af7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:37.647446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f092ee74-d3fb-444a-ae3a-9f34426c6af7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:37.653715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f092ee74-d3fb-444a-ae3a-9f34426c6af7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:37.654174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f092ee74-d3fb-444a-ae3a-9f34426c6af7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:37.654935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f092ee74-d3fb-444a-ae3a-9f34426c6af7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:37.655378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f092ee74-d3fb-444a-ae3a-9f34426c6af7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:37.787570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f092ee74-d3fb-444a-ae3a-9f34426c6af7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:37.795336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f092ee74-d3fb-444a-ae3a-9f34426c6af7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152318 Apr 07 13:26:37.795929 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1152/2420] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:38.813827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-02b44819-c677-4619-9ada-bcfd2596709c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:38.814434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-02b44819-c677-4619-9ada-bcfd2596709c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:38.820693 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02b44819-c677-4619-9ada-bcfd2596709c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:38.821138 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02b44819-c677-4619-9ada-bcfd2596709c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:38.821883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02b44819-c677-4619-9ada-bcfd2596709c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:38.822317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-02b44819-c677-4619-9ada-bcfd2596709c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:38.961216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-02b44819-c677-4619-9ada-bcfd2596709c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:38.969049 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-02b44819-c677-4619-9ada-bcfd2596709c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.159620 Apr 07 13:26:38.969600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1269/2421] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:39.987009 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-03a13162-0c51-4e76-a512-00fd5c26098c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:39.987615 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-03a13162-0c51-4e76-a512-00fd5c26098c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:39.993907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-03a13162-0c51-4e76-a512-00fd5c26098c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:39.994361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-03a13162-0c51-4e76-a512-00fd5c26098c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:39.995117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-03a13162-0c51-4e76-a512-00fd5c26098c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:39.995553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-03a13162-0c51-4e76-a512-00fd5c26098c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:40.130114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-03a13162-0c51-4e76-a512-00fd5c26098c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:40.137784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-03a13162-0c51-4e76-a512-00fd5c26098c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155343 Apr 07 13:26:40.138349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1153/2422] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:39 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:41.156471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-69a43edb-7ddf-4755-b337-be6d5d4a7e01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:41.157093 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-69a43edb-7ddf-4755-b337-be6d5d4a7e01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:41.163809 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-69a43edb-7ddf-4755-b337-be6d5d4a7e01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:41.164301 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-69a43edb-7ddf-4755-b337-be6d5d4a7e01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:41.165069 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-69a43edb-7ddf-4755-b337-be6d5d4a7e01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:41.165506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-69a43edb-7ddf-4755-b337-be6d5d4a7e01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:41.296381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-69a43edb-7ddf-4755-b337-be6d5d4a7e01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:41.304235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-69a43edb-7ddf-4755-b337-be6d5d4a7e01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152393 Apr 07 13:26:41.304800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1270/2423] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:41 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:42.321419 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e35f3f3a-479b-4484-b00c-4adae66d5a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:42.321961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e35f3f3a-479b-4484-b00c-4adae66d5a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:42.328383 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e35f3f3a-479b-4484-b00c-4adae66d5a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:42.328845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e35f3f3a-479b-4484-b00c-4adae66d5a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:42.329619 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e35f3f3a-479b-4484-b00c-4adae66d5a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:42.330058 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e35f3f3a-479b-4484-b00c-4adae66d5a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:42.460667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e35f3f3a-479b-4484-b00c-4adae66d5a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:42.468950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e35f3f3a-479b-4484-b00c-4adae66d5a19 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151604 Apr 07 13:26:42.469514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1154/2424] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:42 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:43.485793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-53bcb249-ab02-4a67-babf-9bd43de9e519 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:43.486408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-53bcb249-ab02-4a67-babf-9bd43de9e519 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:43.492687 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53bcb249-ab02-4a67-babf-9bd43de9e519 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:43.493133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53bcb249-ab02-4a67-babf-9bd43de9e519 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:43.493889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53bcb249-ab02-4a67-babf-9bd43de9e519 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:43.494325 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53bcb249-ab02-4a67-babf-9bd43de9e519 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:43.627132 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-53bcb249-ab02-4a67-babf-9bd43de9e519 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:43.634775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-53bcb249-ab02-4a67-babf-9bd43de9e519 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152851 Apr 07 13:26:43.635326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1271/2425] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:43 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:44.653656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8c5e58ce-09b7-4a6f-9029-bbe4e0434fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:44.654276 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8c5e58ce-09b7-4a6f-9029-bbe4e0434fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:44.661240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c5e58ce-09b7-4a6f-9029-bbe4e0434fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:44.661701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c5e58ce-09b7-4a6f-9029-bbe4e0434fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:44.662465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c5e58ce-09b7-4a6f-9029-bbe4e0434fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:44.662907 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c5e58ce-09b7-4a6f-9029-bbe4e0434fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:44.795054 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8c5e58ce-09b7-4a6f-9029-bbe4e0434fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:44.803538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8c5e58ce-09b7-4a6f-9029-bbe4e0434fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153790 Apr 07 13:26:44.804108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1155/2426] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:44 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:45.820160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6bd1081e-3781-4892-b6e3-bd44e385224c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:45.820776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6bd1081e-3781-4892-b6e3-bd44e385224c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:45.828085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bd1081e-3781-4892-b6e3-bd44e385224c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:45.828577 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bd1081e-3781-4892-b6e3-bd44e385224c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:45.829337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bd1081e-3781-4892-b6e3-bd44e385224c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:45.829775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bd1081e-3781-4892-b6e3-bd44e385224c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:45.959062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6bd1081e-3781-4892-b6e3-bd44e385224c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:45.966702 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6bd1081e-3781-4892-b6e3-bd44e385224c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150391 Apr 07 13:26:45.967270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1272/2427] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:45 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:46.984220 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6142ac9c-cd57-4709-845d-0edb632c8ef2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:46.984841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6142ac9c-cd57-4709-845d-0edb632c8ef2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:46.991108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6142ac9c-cd57-4709-845d-0edb632c8ef2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:46.991562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6142ac9c-cd57-4709-845d-0edb632c8ef2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:46.992368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6142ac9c-cd57-4709-845d-0edb632c8ef2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:46.992809 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6142ac9c-cd57-4709-845d-0edb632c8ef2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:47.126518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6142ac9c-cd57-4709-845d-0edb632c8ef2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:47.134284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6142ac9c-cd57-4709-845d-0edb632c8ef2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154081 Apr 07 13:26:47.134862 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1156/2428] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:46 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:48.151186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-16464d24-2d5d-4a57-a8d6-6438d24d177d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:48.151786 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-16464d24-2d5d-4a57-a8d6-6438d24d177d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:48.159155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16464d24-2d5d-4a57-a8d6-6438d24d177d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:48.159602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16464d24-2d5d-4a57-a8d6-6438d24d177d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:48.160641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16464d24-2d5d-4a57-a8d6-6438d24d177d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:48.161076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16464d24-2d5d-4a57-a8d6-6438d24d177d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:48.291336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-16464d24-2d5d-4a57-a8d6-6438d24d177d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:48.299041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-16464d24-2d5d-4a57-a8d6-6438d24d177d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151688 Apr 07 13:26:48.299606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1273/2429] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:48 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:49.316205 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-770674e0-e938-4fd0-a197-0a5173954c0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:49.316818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-770674e0-e938-4fd0-a197-0a5173954c0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:49.323039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-770674e0-e938-4fd0-a197-0a5173954c0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:49.323489 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-770674e0-e938-4fd0-a197-0a5173954c0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:49.324274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-770674e0-e938-4fd0-a197-0a5173954c0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:49.324742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-770674e0-e938-4fd0-a197-0a5173954c0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:49.456559 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-770674e0-e938-4fd0-a197-0a5173954c0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:49.464450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-770674e0-e938-4fd0-a197-0a5173954c0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152011 Apr 07 13:26:49.465004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1157/2430] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:49 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:50.484287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e96cb759-3e08-4e90-9be0-57a1022a1a52 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:50.485368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e96cb759-3e08-4e90-9be0-57a1022a1a52 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:50.491785 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e96cb759-3e08-4e90-9be0-57a1022a1a52 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:50.492272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e96cb759-3e08-4e90-9be0-57a1022a1a52 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:50.493063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e96cb759-3e08-4e90-9be0-57a1022a1a52 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:50.493483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e96cb759-3e08-4e90-9be0-57a1022a1a52 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:50.627945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e96cb759-3e08-4e90-9be0-57a1022a1a52 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:50.636012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e96cb759-3e08-4e90-9be0-57a1022a1a52 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.158865 Apr 07 13:26:50.636651 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1274/2431] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:51.653979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d180e96f-9a8d-42cc-a699-adbbd23e61c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:51.654600 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d180e96f-9a8d-42cc-a699-adbbd23e61c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:51.661796 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d180e96f-9a8d-42cc-a699-adbbd23e61c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:51.662249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d180e96f-9a8d-42cc-a699-adbbd23e61c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:51.663023 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d180e96f-9a8d-42cc-a699-adbbd23e61c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:51.663457 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d180e96f-9a8d-42cc-a699-adbbd23e61c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:51.797712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d180e96f-9a8d-42cc-a699-adbbd23e61c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:51.813579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d180e96f-9a8d-42cc-a699-adbbd23e61c0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155908 Apr 07 13:26:51.813579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1158/2432] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:51 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:52.823935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e2625350-2edd-41a7-bd94-87d83cb00849 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:52.824518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e2625350-2edd-41a7-bd94-87d83cb00849 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:52.831455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e2625350-2edd-41a7-bd94-87d83cb00849 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:52.831900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e2625350-2edd-41a7-bd94-87d83cb00849 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:52.832685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e2625350-2edd-41a7-bd94-87d83cb00849 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:52.833118 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e2625350-2edd-41a7-bd94-87d83cb00849 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:52.961369 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e2625350-2edd-41a7-bd94-87d83cb00849 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:52.969110 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e2625350-2edd-41a7-bd94-87d83cb00849 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149209 Apr 07 13:26:52.969679 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1275/2433] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:52 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:53.986137 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0baff073-59a2-4d62-8cfe-ca4e00363cb1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:53.986835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0baff073-59a2-4d62-8cfe-ca4e00363cb1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:53.993261 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0baff073-59a2-4d62-8cfe-ca4e00363cb1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:53.993710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0baff073-59a2-4d62-8cfe-ca4e00363cb1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:53.994471 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0baff073-59a2-4d62-8cfe-ca4e00363cb1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:53.994909 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0baff073-59a2-4d62-8cfe-ca4e00363cb1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:54.127590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0baff073-59a2-4d62-8cfe-ca4e00363cb1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:54.135388 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0baff073-59a2-4d62-8cfe-ca4e00363cb1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153054 Apr 07 13:26:54.135945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1159/2434] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:53 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:55.152695 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8edf032f-e073-41c3-b53d-e8ac1f4940d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:55.153313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8edf032f-e073-41c3-b53d-e8ac1f4940d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:55.159676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8edf032f-e073-41c3-b53d-e8ac1f4940d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:55.160410 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8edf032f-e073-41c3-b53d-e8ac1f4940d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:55.161174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8edf032f-e073-41c3-b53d-e8ac1f4940d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:55.161612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8edf032f-e073-41c3-b53d-e8ac1f4940d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:55.295120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8edf032f-e073-41c3-b53d-e8ac1f4940d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:55.303857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8edf032f-e073-41c3-b53d-e8ac1f4940d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155023 Apr 07 13:26:55.304455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1276/2435] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:55 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:56.321635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-8c34f68e-ace8-4cc3-97ae-88286842ff66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:56.322267 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-8c34f68e-ace8-4cc3-97ae-88286842ff66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:56.329103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c34f68e-ace8-4cc3-97ae-88286842ff66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:56.329551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c34f68e-ace8-4cc3-97ae-88286842ff66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:56.330311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c34f68e-ace8-4cc3-97ae-88286842ff66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:56.330745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-8c34f68e-ace8-4cc3-97ae-88286842ff66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:56.465699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-8c34f68e-ace8-4cc3-97ae-88286842ff66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:56.473680 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-8c34f68e-ace8-4cc3-97ae-88286842ff66 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155968 Apr 07 13:26:56.474283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1160/2436] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:56 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:57.491360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ddd50cbd-a41e-4893-9628-bf7b38e7f1fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:57.491967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ddd50cbd-a41e-4893-9628-bf7b38e7f1fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:57.498236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ddd50cbd-a41e-4893-9628-bf7b38e7f1fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:57.498679 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ddd50cbd-a41e-4893-9628-bf7b38e7f1fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:57.499427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ddd50cbd-a41e-4893-9628-bf7b38e7f1fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:57.499859 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ddd50cbd-a41e-4893-9628-bf7b38e7f1fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:57.629328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ddd50cbd-a41e-4893-9628-bf7b38e7f1fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:57.637094 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ddd50cbd-a41e-4893-9628-bf7b38e7f1fe tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149545 Apr 07 13:26:57.637658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1277/2437] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:58.654619 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b44450fa-4ca2-4f0d-bcea-cbb3a5902570 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:58.655235 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b44450fa-4ca2-4f0d-bcea-cbb3a5902570 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:58.662359 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b44450fa-4ca2-4f0d-bcea-cbb3a5902570 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:58.662815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b44450fa-4ca2-4f0d-bcea-cbb3a5902570 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:58.663581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b44450fa-4ca2-4f0d-bcea-cbb3a5902570 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:58.664021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b44450fa-4ca2-4f0d-bcea-cbb3a5902570 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:58.793595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b44450fa-4ca2-4f0d-bcea-cbb3a5902570 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:58.802354 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b44450fa-4ca2-4f0d-bcea-cbb3a5902570 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151535 Apr 07 13:26:58.802949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1161/2438] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:26:59.819413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1fa0a7c8-f365-4d4e-8c06-336ebc101c3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:26:59.820030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1fa0a7c8-f365-4d4e-8c06-336ebc101c3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:26:59.826309 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1fa0a7c8-f365-4d4e-8c06-336ebc101c3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:59.826766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1fa0a7c8-f365-4d4e-8c06-336ebc101c3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:59.827526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1fa0a7c8-f365-4d4e-8c06-336ebc101c3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:26:59.828515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1fa0a7c8-f365-4d4e-8c06-336ebc101c3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:26:59.959977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1fa0a7c8-f365-4d4e-8c06-336ebc101c3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:26:59.967878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1fa0a7c8-f365-4d4e-8c06-336ebc101c3c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152287 Apr 07 13:26:59.968552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1278/2439] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:26:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:00.986377 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5f67f476-28be-4ff8-afef-35f5a8dce8d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:00.986987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5f67f476-28be-4ff8-afef-35f5a8dce8d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:00.993496 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f67f476-28be-4ff8-afef-35f5a8dce8d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:00.993980 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f67f476-28be-4ff8-afef-35f5a8dce8d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:00.994746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f67f476-28be-4ff8-afef-35f5a8dce8d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:00.995184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f67f476-28be-4ff8-afef-35f5a8dce8d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:01.129471 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5f67f476-28be-4ff8-afef-35f5a8dce8d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:01.137252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5f67f476-28be-4ff8-afef-35f5a8dce8d2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155416 Apr 07 13:27:01.137814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1162/2440] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:00 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:02.153600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ea8f11ad-6bca-4881-9787-f102e0448317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:02.154189 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ea8f11ad-6bca-4881-9787-f102e0448317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:02.160836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea8f11ad-6bca-4881-9787-f102e0448317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:02.161280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea8f11ad-6bca-4881-9787-f102e0448317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:02.162029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea8f11ad-6bca-4881-9787-f102e0448317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:02.162459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea8f11ad-6bca-4881-9787-f102e0448317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:02.290719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ea8f11ad-6bca-4881-9787-f102e0448317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:02.299365 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ea8f11ad-6bca-4881-9787-f102e0448317 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149598 Apr 07 13:27:02.299926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1279/2441] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:02 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:03.316506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-96404d9c-4109-4504-abdb-6abc55b10d4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:03.317121 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-96404d9c-4109-4504-abdb-6abc55b10d4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:03.323346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-96404d9c-4109-4504-abdb-6abc55b10d4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:03.323795 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-96404d9c-4109-4504-abdb-6abc55b10d4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:03.324575 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-96404d9c-4109-4504-abdb-6abc55b10d4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:03.325010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-96404d9c-4109-4504-abdb-6abc55b10d4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:03.454413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-96404d9c-4109-4504-abdb-6abc55b10d4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:03.462330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-96404d9c-4109-4504-abdb-6abc55b10d4a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150156 Apr 07 13:27:03.462897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1163/2442] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:03 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:04.479770 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ef0587b4-77e0-43fe-9fa9-13089226ff34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:04.480414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ef0587b4-77e0-43fe-9fa9-13089226ff34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:04.486689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef0587b4-77e0-43fe-9fa9-13089226ff34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:04.487166 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef0587b4-77e0-43fe-9fa9-13089226ff34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:04.487924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef0587b4-77e0-43fe-9fa9-13089226ff34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:04.488388 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ef0587b4-77e0-43fe-9fa9-13089226ff34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:04.618736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ef0587b4-77e0-43fe-9fa9-13089226ff34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:04.626670 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ef0587b4-77e0-43fe-9fa9-13089226ff34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150746 Apr 07 13:27:04.627239 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1280/2443] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:04 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:05.644165 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-df82e762-0391-4f2d-909c-d095ac9ccd32 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:05.644792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-df82e762-0391-4f2d-909c-d095ac9ccd32 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:05.650659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df82e762-0391-4f2d-909c-d095ac9ccd32 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:05.651108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df82e762-0391-4f2d-909c-d095ac9ccd32 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:05.651872 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df82e762-0391-4f2d-909c-d095ac9ccd32 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:05.652333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-df82e762-0391-4f2d-909c-d095ac9ccd32 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:05.784225 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-df82e762-0391-4f2d-909c-d095ac9ccd32 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:05.792173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-df82e762-0391-4f2d-909c-d095ac9ccd32 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152551 Apr 07 13:27:05.792746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1164/2444] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:05 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:06.810385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-04b11bd1-90fb-4766-b223-1a89aa2ad479 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:06.810978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-04b11bd1-90fb-4766-b223-1a89aa2ad479 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:06.818313 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04b11bd1-90fb-4766-b223-1a89aa2ad479 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:06.818755 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04b11bd1-90fb-4766-b223-1a89aa2ad479 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:06.819506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04b11bd1-90fb-4766-b223-1a89aa2ad479 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:06.819934 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04b11bd1-90fb-4766-b223-1a89aa2ad479 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:06.953198 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-04b11bd1-90fb-4766-b223-1a89aa2ad479 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:06.960907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-04b11bd1-90fb-4766-b223-1a89aa2ad479 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154301 Apr 07 13:27:06.961471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1281/2445] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:06 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:07.978597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-13a5c9ed-4b54-4fe0-9363-32b48c1c8cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:07.979214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-13a5c9ed-4b54-4fe0-9363-32b48c1c8cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:07.985596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-13a5c9ed-4b54-4fe0-9363-32b48c1c8cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:07.986044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-13a5c9ed-4b54-4fe0-9363-32b48c1c8cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:07.986796 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-13a5c9ed-4b54-4fe0-9363-32b48c1c8cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:07.987230 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-13a5c9ed-4b54-4fe0-9363-32b48c1c8cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:08.119461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-13a5c9ed-4b54-4fe0-9363-32b48c1c8cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:08.127976 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-13a5c9ed-4b54-4fe0-9363-32b48c1c8cc9 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153595 Apr 07 13:27:08.128563 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1165/2446] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:07 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:09.145848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-17b80d79-0721-462c-90f2-643b759f8fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:09.146454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-17b80d79-0721-462c-90f2-643b759f8fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:09.152768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-17b80d79-0721-462c-90f2-643b759f8fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:09.153217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-17b80d79-0721-462c-90f2-643b759f8fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:09.153967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-17b80d79-0721-462c-90f2-643b759f8fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:09.154401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-17b80d79-0721-462c-90f2-643b759f8fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:09.287475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-17b80d79-0721-462c-90f2-643b759f8fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:09.295116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-17b80d79-0721-462c-90f2-643b759f8fdb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153086 Apr 07 13:27:09.295677 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1282/2447] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:09 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:10.312515 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0cf6c22b-422b-4a56-bdbb-97355c0f249a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:10.313330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0cf6c22b-422b-4a56-bdbb-97355c0f249a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:10.319542 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0cf6c22b-422b-4a56-bdbb-97355c0f249a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:10.319994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0cf6c22b-422b-4a56-bdbb-97355c0f249a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:10.320802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0cf6c22b-422b-4a56-bdbb-97355c0f249a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:10.321239 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0cf6c22b-422b-4a56-bdbb-97355c0f249a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:10.451028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0cf6c22b-422b-4a56-bdbb-97355c0f249a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:10.459041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0cf6c22b-422b-4a56-bdbb-97355c0f249a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150943 Apr 07 13:27:10.459603 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1166/2448] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:10 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:11.475919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3b1a699b-bbfd-4087-ab6d-a657df65e0c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:11.476565 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3b1a699b-bbfd-4087-ab6d-a657df65e0c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:11.482830 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b1a699b-bbfd-4087-ab6d-a657df65e0c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:11.483314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b1a699b-bbfd-4087-ab6d-a657df65e0c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:11.484076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b1a699b-bbfd-4087-ab6d-a657df65e0c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:11.484683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3b1a699b-bbfd-4087-ab6d-a657df65e0c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:11.618098 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3b1a699b-bbfd-4087-ab6d-a657df65e0c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:11.626307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3b1a699b-bbfd-4087-ab6d-a657df65e0c5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154282 Apr 07 13:27:11.626864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1283/2449] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:11 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:27:12.643529 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9bc691a4-3345-4ecf-ab8e-08064d0e4977 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:12.644163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9bc691a4-3345-4ecf-ab8e-08064d0e4977 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:12.650395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bc691a4-3345-4ecf-ab8e-08064d0e4977 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:12.650842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bc691a4-3345-4ecf-ab8e-08064d0e4977 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:12.651598 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bc691a4-3345-4ecf-ab8e-08064d0e4977 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:12.652160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bc691a4-3345-4ecf-ab8e-08064d0e4977 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:12.785944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9bc691a4-3345-4ecf-ab8e-08064d0e4977 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:12.793766 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9bc691a4-3345-4ecf-ab8e-08064d0e4977 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154229 Apr 07 13:27:12.794363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1167/2450] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:12 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:13.811662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ac048bad-bac9-46c1-b65c-4e211afb2d4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:13.812306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ac048bad-bac9-46c1-b65c-4e211afb2d4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:13.818803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ac048bad-bac9-46c1-b65c-4e211afb2d4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:13.819259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ac048bad-bac9-46c1-b65c-4e211afb2d4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:13.820021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ac048bad-bac9-46c1-b65c-4e211afb2d4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:13.820491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ac048bad-bac9-46c1-b65c-4e211afb2d4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:13.948329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ac048bad-bac9-46c1-b65c-4e211afb2d4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:13.956079 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ac048bad-bac9-46c1-b65c-4e211afb2d4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.148228 Apr 07 13:27:13.956667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1284/2451] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:13 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:14.973152 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0455f537-a424-4db8-ae8e-bb40d79848fb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:14.973881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0455f537-a424-4db8-ae8e-bb40d79848fb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:14.980881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0455f537-a424-4db8-ae8e-bb40d79848fb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:14.981341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0455f537-a424-4db8-ae8e-bb40d79848fb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:14.982118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0455f537-a424-4db8-ae8e-bb40d79848fb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:14.982562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0455f537-a424-4db8-ae8e-bb40d79848fb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:15.113498 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0455f537-a424-4db8-ae8e-bb40d79848fb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:15.121277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0455f537-a424-4db8-ae8e-bb40d79848fb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152747 Apr 07 13:27:15.121840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1168/2452] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:14 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:16.138723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6faa0add-1d29-424f-8306-a59d61d9c9ea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:16.139329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6faa0add-1d29-424f-8306-a59d61d9c9ea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:16.145712 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6faa0add-1d29-424f-8306-a59d61d9c9ea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:16.146168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6faa0add-1d29-424f-8306-a59d61d9c9ea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:16.146925 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6faa0add-1d29-424f-8306-a59d61d9c9ea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:16.147363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6faa0add-1d29-424f-8306-a59d61d9c9ea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:16.295765 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6faa0add-1d29-424f-8306-a59d61d9c9ea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:16.303961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6faa0add-1d29-424f-8306-a59d61d9c9ea tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.169125 Apr 07 13:27:16.304618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1285/2453] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:16 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:17.321161 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5ab0915d-e4bc-4803-bde8-9b2af8be92b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:17.321700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5ab0915d-e4bc-4803-bde8-9b2af8be92b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:17.328074 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ab0915d-e4bc-4803-bde8-9b2af8be92b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:17.328563 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ab0915d-e4bc-4803-bde8-9b2af8be92b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:17.329505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ab0915d-e4bc-4803-bde8-9b2af8be92b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:17.329950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5ab0915d-e4bc-4803-bde8-9b2af8be92b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:17.459568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5ab0915d-e4bc-4803-bde8-9b2af8be92b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:17.467519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5ab0915d-e4bc-4803-bde8-9b2af8be92b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150277 Apr 07 13:27:17.468119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1169/2454] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:17 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:18.485554 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-11145b08-6fca-4235-9199-4bb2319fec08 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:18.486215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-11145b08-6fca-4235-9199-4bb2319fec08 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:18.492516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11145b08-6fca-4235-9199-4bb2319fec08 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:18.492968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11145b08-6fca-4235-9199-4bb2319fec08 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:18.493728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11145b08-6fca-4235-9199-4bb2319fec08 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:18.494162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11145b08-6fca-4235-9199-4bb2319fec08 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:18.638190 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-11145b08-6fca-4235-9199-4bb2319fec08 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:18.647074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-11145b08-6fca-4235-9199-4bb2319fec08 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.165815 Apr 07 13:27:18.647641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1286/2455] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:19.664827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0a2410ec-6c1e-4eef-81e5-e5f36b0be21e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:19.665465 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0a2410ec-6c1e-4eef-81e5-e5f36b0be21e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:19.672060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a2410ec-6c1e-4eef-81e5-e5f36b0be21e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:19.672674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a2410ec-6c1e-4eef-81e5-e5f36b0be21e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:19.673448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a2410ec-6c1e-4eef-81e5-e5f36b0be21e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:19.673892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0a2410ec-6c1e-4eef-81e5-e5f36b0be21e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:19.810600 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0a2410ec-6c1e-4eef-81e5-e5f36b0be21e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:19.818970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0a2410ec-6c1e-4eef-81e5-e5f36b0be21e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.158086 Apr 07 13:27:19.819538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1170/2456] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:19 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:27:20.836050 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-56ed127a-7c9b-43e8-b973-e1de6806a866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:20.836649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-56ed127a-7c9b-43e8-b973-e1de6806a866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:20.842913 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56ed127a-7c9b-43e8-b973-e1de6806a866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:20.843359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56ed127a-7c9b-43e8-b973-e1de6806a866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:20.844111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56ed127a-7c9b-43e8-b973-e1de6806a866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:20.845541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-56ed127a-7c9b-43e8-b973-e1de6806a866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:20.975327 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-56ed127a-7c9b-43e8-b973-e1de6806a866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:20.983589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-56ed127a-7c9b-43e8-b973-e1de6806a866 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151611 Apr 07 13:27:20.984168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1287/2457] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:20 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:22.000930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9b10207d-1408-4085-8253-2d18b82abffb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:22.001484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9b10207d-1408-4085-8253-2d18b82abffb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:22.007738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b10207d-1408-4085-8253-2d18b82abffb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:22.008440 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b10207d-1408-4085-8253-2d18b82abffb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:22.009227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b10207d-1408-4085-8253-2d18b82abffb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:22.009670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b10207d-1408-4085-8253-2d18b82abffb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:22.193968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9b10207d-1408-4085-8253-2d18b82abffb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:22.201617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9b10207d-1408-4085-8253-2d18b82abffb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.204728 Apr 07 13:27:22.202177 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1171/2458] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:21 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:23.218956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9d8a3757-7526-4e42-a574-5e8b657e8d4c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:23.219643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9d8a3757-7526-4e42-a574-5e8b657e8d4c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:23.225627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9d8a3757-7526-4e42-a574-5e8b657e8d4c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:23.226082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9d8a3757-7526-4e42-a574-5e8b657e8d4c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:23.226847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9d8a3757-7526-4e42-a574-5e8b657e8d4c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:23.227283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9d8a3757-7526-4e42-a574-5e8b657e8d4c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:23.362441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9d8a3757-7526-4e42-a574-5e8b657e8d4c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:23.370224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9d8a3757-7526-4e42-a574-5e8b657e8d4c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155282 Apr 07 13:27:23.370793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1288/2459] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:23 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:24.390067 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-80bdcb1d-e6a6-4467-adc4-c52c12748b01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:24.390683 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-80bdcb1d-e6a6-4467-adc4-c52c12748b01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:24.398128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-80bdcb1d-e6a6-4467-adc4-c52c12748b01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:24.398580 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-80bdcb1d-e6a6-4467-adc4-c52c12748b01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:24.399333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-80bdcb1d-e6a6-4467-adc4-c52c12748b01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:24.399769 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-80bdcb1d-e6a6-4467-adc4-c52c12748b01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:24.533497 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-80bdcb1d-e6a6-4467-adc4-c52c12748b01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:24.541506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-80bdcb1d-e6a6-4467-adc4-c52c12748b01 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155229 Apr 07 13:27:24.542071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1172/2460] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:24 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:27:25.558864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-278ee463-3b0b-45b6-9e10-40bef1e9e668 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:25.559420 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-278ee463-3b0b-45b6-9e10-40bef1e9e668 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:25.566705 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-278ee463-3b0b-45b6-9e10-40bef1e9e668 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:25.567505 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-278ee463-3b0b-45b6-9e10-40bef1e9e668 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:25.568902 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-278ee463-3b0b-45b6-9e10-40bef1e9e668 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:25.569701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-278ee463-3b0b-45b6-9e10-40bef1e9e668 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:25.751309 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-278ee463-3b0b-45b6-9e10-40bef1e9e668 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:25.759027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-278ee463-3b0b-45b6-9e10-40bef1e9e668 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.204076 Apr 07 13:27:25.759593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1289/2461] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:25 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:26.776943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7572371a-edec-4267-a673-e53f61e50504 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:26.777567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7572371a-edec-4267-a673-e53f61e50504 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:26.785038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7572371a-edec-4267-a673-e53f61e50504 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:26.785501 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7572371a-edec-4267-a673-e53f61e50504 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:26.786277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7572371a-edec-4267-a673-e53f61e50504 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:26.786725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7572371a-edec-4267-a673-e53f61e50504 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:26.915655 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7572371a-edec-4267-a673-e53f61e50504 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:26.923418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7572371a-edec-4267-a673-e53f61e50504 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150341 Apr 07 13:27:26.923988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1173/2462] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:26 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:27.940651 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ff55eb08-a5ff-4cb3-84d5-f8b9aeaf7aca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:27.941262 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ff55eb08-a5ff-4cb3-84d5-f8b9aeaf7aca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:27.947543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff55eb08-a5ff-4cb3-84d5-f8b9aeaf7aca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:27.948005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff55eb08-a5ff-4cb3-84d5-f8b9aeaf7aca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:27.948803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff55eb08-a5ff-4cb3-84d5-f8b9aeaf7aca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:27.949238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff55eb08-a5ff-4cb3-84d5-f8b9aeaf7aca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:28.081939 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ff55eb08-a5ff-4cb3-84d5-f8b9aeaf7aca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:28.089623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ff55eb08-a5ff-4cb3-84d5-f8b9aeaf7aca tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152970 Apr 07 13:27:28.090172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1290/2463] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:29.107600 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e31dc148-2ba6-4a60-8cbf-561613bb517d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:29.108245 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e31dc148-2ba6-4a60-8cbf-561613bb517d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:29.115596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e31dc148-2ba6-4a60-8cbf-561613bb517d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:29.116047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e31dc148-2ba6-4a60-8cbf-561613bb517d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:29.116842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e31dc148-2ba6-4a60-8cbf-561613bb517d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:29.117277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e31dc148-2ba6-4a60-8cbf-561613bb517d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:29.249611 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e31dc148-2ba6-4a60-8cbf-561613bb517d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:29.257979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e31dc148-2ba6-4a60-8cbf-561613bb517d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154312 Apr 07 13:27:29.258549 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1174/2464] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:29 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:30.274707 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1566f16d-5b2e-4077-8dc6-71f90be5b85a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:30.275386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1566f16d-5b2e-4077-8dc6-71f90be5b85a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:30.281580 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1566f16d-5b2e-4077-8dc6-71f90be5b85a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:30.282549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1566f16d-5b2e-4077-8dc6-71f90be5b85a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:30.283381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1566f16d-5b2e-4077-8dc6-71f90be5b85a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:30.283808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1566f16d-5b2e-4077-8dc6-71f90be5b85a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:30.411942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1566f16d-5b2e-4077-8dc6-71f90be5b85a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:30.419733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1566f16d-5b2e-4077-8dc6-71f90be5b85a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.148812 Apr 07 13:27:30.420323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1291/2465] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:30 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:31.438304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4512b984-a9d4-4d66-872d-bc0261e6070f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:31.438864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4512b984-a9d4-4d66-872d-bc0261e6070f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:31.445340 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4512b984-a9d4-4d66-872d-bc0261e6070f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:31.445797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4512b984-a9d4-4d66-872d-bc0261e6070f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:31.446569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4512b984-a9d4-4d66-872d-bc0261e6070f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:31.447009 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4512b984-a9d4-4d66-872d-bc0261e6070f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:31.577993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4512b984-a9d4-4d66-872d-bc0261e6070f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:31.586371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4512b984-a9d4-4d66-872d-bc0261e6070f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151986 Apr 07 13:27:31.586944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1175/2466] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:31 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:32.603984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e62ff9e5-cad5-484a-b268-ef5e86295a30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:32.604624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e62ff9e5-cad5-484a-b268-ef5e86295a30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:32.610876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e62ff9e5-cad5-484a-b268-ef5e86295a30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:32.611905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e62ff9e5-cad5-484a-b268-ef5e86295a30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:32.612874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e62ff9e5-cad5-484a-b268-ef5e86295a30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:32.613312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e62ff9e5-cad5-484a-b268-ef5e86295a30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:32.745441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e62ff9e5-cad5-484a-b268-ef5e86295a30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:32.753186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e62ff9e5-cad5-484a-b268-ef5e86295a30 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152988 Apr 07 13:27:32.753746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1292/2467] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:33.770599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a0b3969e-76b3-4ced-a6f1-ab28a8d0fa2c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:33.771245 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a0b3969e-76b3-4ced-a6f1-ab28a8d0fa2c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:33.777978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0b3969e-76b3-4ced-a6f1-ab28a8d0fa2c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:33.778446 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0b3969e-76b3-4ced-a6f1-ab28a8d0fa2c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:33.779216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0b3969e-76b3-4ced-a6f1-ab28a8d0fa2c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:33.779656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0b3969e-76b3-4ced-a6f1-ab28a8d0fa2c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:33.910404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a0b3969e-76b3-4ced-a6f1-ab28a8d0fa2c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:33.918395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a0b3969e-76b3-4ced-a6f1-ab28a8d0fa2c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151943 Apr 07 13:27:33.918963 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1176/2468] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:33 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:34.935821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3e2d27d0-2265-4546-bae4-333d1ffa3cff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:34.936461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3e2d27d0-2265-4546-bae4-333d1ffa3cff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:34.943267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3e2d27d0-2265-4546-bae4-333d1ffa3cff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:34.943718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3e2d27d0-2265-4546-bae4-333d1ffa3cff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:34.944504 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3e2d27d0-2265-4546-bae4-333d1ffa3cff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:34.944942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3e2d27d0-2265-4546-bae4-333d1ffa3cff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:35.076593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3e2d27d0-2265-4546-bae4-333d1ffa3cff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:35.084543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3e2d27d0-2265-4546-bae4-333d1ffa3cff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152499 Apr 07 13:27:35.085109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1293/2469] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:34 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:36.101879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7b2d9b52-5dba-452b-828e-63c8002e917a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:36.102474 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7b2d9b52-5dba-452b-828e-63c8002e917a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:36.108740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b2d9b52-5dba-452b-828e-63c8002e917a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:36.109187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b2d9b52-5dba-452b-828e-63c8002e917a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:36.109945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b2d9b52-5dba-452b-828e-63c8002e917a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:36.110379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b2d9b52-5dba-452b-828e-63c8002e917a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:36.245746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7b2d9b52-5dba-452b-828e-63c8002e917a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:36.254226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7b2d9b52-5dba-452b-828e-63c8002e917a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156178 Apr 07 13:27:36.254792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1177/2470] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:36 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:37.270694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fe5fdd9b-d478-4559-b12b-006c6388dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:37.271307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fe5fdd9b-d478-4559-b12b-006c6388dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:37.277621 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe5fdd9b-d478-4559-b12b-006c6388dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:37.278073 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe5fdd9b-d478-4559-b12b-006c6388dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:37.278839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe5fdd9b-d478-4559-b12b-006c6388dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:37.279280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe5fdd9b-d478-4559-b12b-006c6388dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:37.411522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fe5fdd9b-d478-4559-b12b-006c6388dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:37.419318 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fe5fdd9b-d478-4559-b12b-006c6388dc7a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152520 Apr 07 13:27:37.419875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1294/2471] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:38.436945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-aa10f7c7-e251-4670-961f-2e54a7f0b1d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:38.437544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-aa10f7c7-e251-4670-961f-2e54a7f0b1d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:38.444450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aa10f7c7-e251-4670-961f-2e54a7f0b1d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:38.444904 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aa10f7c7-e251-4670-961f-2e54a7f0b1d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:38.445666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aa10f7c7-e251-4670-961f-2e54a7f0b1d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:38.446104 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aa10f7c7-e251-4670-961f-2e54a7f0b1d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:38.574073 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-aa10f7c7-e251-4670-961f-2e54a7f0b1d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:38.582667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-aa10f7c7-e251-4670-961f-2e54a7f0b1d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149546 Apr 07 13:27:38.583238 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1178/2472] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:39.599360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b225c035-3c5d-40e8-91d9-bf7c0fa16b37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:39.599973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b225c035-3c5d-40e8-91d9-bf7c0fa16b37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:39.606267 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b225c035-3c5d-40e8-91d9-bf7c0fa16b37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:39.606717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b225c035-3c5d-40e8-91d9-bf7c0fa16b37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:39.607475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b225c035-3c5d-40e8-91d9-bf7c0fa16b37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:39.607913 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b225c035-3c5d-40e8-91d9-bf7c0fa16b37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:39.741564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b225c035-3c5d-40e8-91d9-bf7c0fa16b37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:39.749281 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b225c035-3c5d-40e8-91d9-bf7c0fa16b37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154365 Apr 07 13:27:39.749857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1295/2473] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:39 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:40.766619 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7a1046d6-4a54-450b-beef-9cda23efec50 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:40.767313 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7a1046d6-4a54-450b-beef-9cda23efec50 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:40.773730 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7a1046d6-4a54-450b-beef-9cda23efec50 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:40.774183 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7a1046d6-4a54-450b-beef-9cda23efec50 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:40.774946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7a1046d6-4a54-450b-beef-9cda23efec50 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:40.775385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7a1046d6-4a54-450b-beef-9cda23efec50 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:40.908760 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7a1046d6-4a54-450b-beef-9cda23efec50 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:40.916760 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7a1046d6-4a54-450b-beef-9cda23efec50 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154099 Apr 07 13:27:40.917326 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1179/2474] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:40 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:41.934345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1a578b76-bb6a-44e6-a5bc-54b1a57edb8c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:41.935066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1a578b76-bb6a-44e6-a5bc-54b1a57edb8c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:41.941296 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a578b76-bb6a-44e6-a5bc-54b1a57edb8c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:41.941761 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a578b76-bb6a-44e6-a5bc-54b1a57edb8c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:41.942799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a578b76-bb6a-44e6-a5bc-54b1a57edb8c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:41.942958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1a578b76-bb6a-44e6-a5bc-54b1a57edb8c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:42.073434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1a578b76-bb6a-44e6-a5bc-54b1a57edb8c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:42.081953 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1a578b76-bb6a-44e6-a5bc-54b1a57edb8c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151457 Apr 07 13:27:42.082516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1296/2475] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:41 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:27:43.099130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5c66ba06-7d5c-419f-8de4-13edda993384 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:43.099740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5c66ba06-7d5c-419f-8de4-13edda993384 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:43.106030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5c66ba06-7d5c-419f-8de4-13edda993384 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:43.106487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5c66ba06-7d5c-419f-8de4-13edda993384 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:43.107248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5c66ba06-7d5c-419f-8de4-13edda993384 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:43.107692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5c66ba06-7d5c-419f-8de4-13edda993384 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:43.237169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5c66ba06-7d5c-419f-8de4-13edda993384 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:43.244839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5c66ba06-7d5c-419f-8de4-13edda993384 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149803 Apr 07 13:27:43.245398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1180/2476] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:43 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:44.262703 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3f75f483-eec6-4da3-bca2-1efcd13aca9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:44.263344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3f75f483-eec6-4da3-bca2-1efcd13aca9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:44.271271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f75f483-eec6-4da3-bca2-1efcd13aca9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:44.271700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f75f483-eec6-4da3-bca2-1efcd13aca9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:44.272493 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f75f483-eec6-4da3-bca2-1efcd13aca9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:44.272926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3f75f483-eec6-4da3-bca2-1efcd13aca9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:44.405819 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3f75f483-eec6-4da3-bca2-1efcd13aca9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:44.413913 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3f75f483-eec6-4da3-bca2-1efcd13aca9b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155085 Apr 07 13:27:44.414465 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1297/2477] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:44 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:45.431418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-41fcd8ec-517f-42f1-82a7-ede02faecd49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:45.431996 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-41fcd8ec-517f-42f1-82a7-ede02faecd49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:45.438207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-41fcd8ec-517f-42f1-82a7-ede02faecd49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:45.438659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-41fcd8ec-517f-42f1-82a7-ede02faecd49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:45.440242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-41fcd8ec-517f-42f1-82a7-ede02faecd49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:45.440687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-41fcd8ec-517f-42f1-82a7-ede02faecd49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:45.570944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-41fcd8ec-517f-42f1-82a7-ede02faecd49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:45.578678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-41fcd8ec-517f-42f1-82a7-ede02faecd49 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151132 Apr 07 13:27:45.579467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1181/2478] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:45 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:27:46.597146 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e9a2b16d-a870-44c2-b9a9-ef9e28b4c30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:46.597755 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e9a2b16d-a870-44c2-b9a9-ef9e28b4c30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:46.604059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e9a2b16d-a870-44c2-b9a9-ef9e28b4c30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:46.604537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e9a2b16d-a870-44c2-b9a9-ef9e28b4c30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:46.605285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e9a2b16d-a870-44c2-b9a9-ef9e28b4c30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:46.605716 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e9a2b16d-a870-44c2-b9a9-ef9e28b4c30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:46.735302 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e9a2b16d-a870-44c2-b9a9-ef9e28b4c30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:46.743292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e9a2b16d-a870-44c2-b9a9-ef9e28b4c30f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151181 Apr 07 13:27:46.743860 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1298/2479] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:46 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:47.760963 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2dcb34e4-1921-4c9b-85b0-4eb85f455ff5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:47.761587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2dcb34e4-1921-4c9b-85b0-4eb85f455ff5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:47.768473 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2dcb34e4-1921-4c9b-85b0-4eb85f455ff5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:47.768926 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2dcb34e4-1921-4c9b-85b0-4eb85f455ff5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:47.769699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2dcb34e4-1921-4c9b-85b0-4eb85f455ff5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:47.770135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2dcb34e4-1921-4c9b-85b0-4eb85f455ff5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:47.902516 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2dcb34e4-1921-4c9b-85b0-4eb85f455ff5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:47.910999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2dcb34e4-1921-4c9b-85b0-4eb85f455ff5 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153859 Apr 07 13:27:47.911568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1182/2480] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:47 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:48.928163 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-41372038-4bdc-49e4-a0ad-c88dcd42bb68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:48.928795 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-41372038-4bdc-49e4-a0ad-c88dcd42bb68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:48.935070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-41372038-4bdc-49e4-a0ad-c88dcd42bb68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:48.935524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-41372038-4bdc-49e4-a0ad-c88dcd42bb68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:48.936311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-41372038-4bdc-49e4-a0ad-c88dcd42bb68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:48.936747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-41372038-4bdc-49e4-a0ad-c88dcd42bb68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:49.071185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-41372038-4bdc-49e4-a0ad-c88dcd42bb68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:49.078958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-41372038-4bdc-49e4-a0ad-c88dcd42bb68 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154636 Apr 07 13:27:49.080154 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1299/2481] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:48 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:50.097631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3b7c40a9-fbd8-431e-b17e-2a79bc2263cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:50.098228 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3b7c40a9-fbd8-431e-b17e-2a79bc2263cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:50.104502 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3b7c40a9-fbd8-431e-b17e-2a79bc2263cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:50.104954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3b7c40a9-fbd8-431e-b17e-2a79bc2263cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:50.105713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3b7c40a9-fbd8-431e-b17e-2a79bc2263cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:50.106157 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3b7c40a9-fbd8-431e-b17e-2a79bc2263cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:50.236486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3b7c40a9-fbd8-431e-b17e-2a79bc2263cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:50.244203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3b7c40a9-fbd8-431e-b17e-2a79bc2263cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151073 Apr 07 13:27:50.244779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1183/2482] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:51.260923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6cb4d0d3-d161-4bc7-8217-2e1977ede09b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:51.261536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6cb4d0d3-d161-4bc7-8217-2e1977ede09b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:51.268121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6cb4d0d3-d161-4bc7-8217-2e1977ede09b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:51.268602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6cb4d0d3-d161-4bc7-8217-2e1977ede09b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:51.269359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6cb4d0d3-d161-4bc7-8217-2e1977ede09b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:51.269793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6cb4d0d3-d161-4bc7-8217-2e1977ede09b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:51.404898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6cb4d0d3-d161-4bc7-8217-2e1977ede09b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:51.413583 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6cb4d0d3-d161-4bc7-8217-2e1977ede09b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156489 Apr 07 13:27:51.414135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1300/2483] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:51 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:52.431132 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-58b47ade-1958-4f23-b55f-0adb7e7dd6f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:52.432257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-58b47ade-1958-4f23-b55f-0adb7e7dd6f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:52.440631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-58b47ade-1958-4f23-b55f-0adb7e7dd6f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:52.440810 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-58b47ade-1958-4f23-b55f-0adb7e7dd6f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:52.441538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-58b47ade-1958-4f23-b55f-0adb7e7dd6f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:52.441979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-58b47ade-1958-4f23-b55f-0adb7e7dd6f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:52.579163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-58b47ade-1958-4f23-b55f-0adb7e7dd6f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:52.587827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-58b47ade-1958-4f23-b55f-0adb7e7dd6f4 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.161055 Apr 07 13:27:52.588444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1184/2484] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:52 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:53.605073 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-67b2b20b-e081-467b-9531-0ea420f7c6d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:53.605710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-67b2b20b-e081-467b-9531-0ea420f7c6d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:53.612202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-67b2b20b-e081-467b-9531-0ea420f7c6d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:53.612657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-67b2b20b-e081-467b-9531-0ea420f7c6d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:53.613413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-67b2b20b-e081-467b-9531-0ea420f7c6d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:53.613851 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-67b2b20b-e081-467b-9531-0ea420f7c6d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:53.742497 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-67b2b20b-e081-467b-9531-0ea420f7c6d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:53.750310 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-67b2b20b-e081-467b-9531-0ea420f7c6d7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149186 Apr 07 13:27:53.750868 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1301/2485] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:53 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:54.768437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e4331a8d-6c37-46a4-bfbd-698a0a48d6aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:54.769070 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e4331a8d-6c37-46a4-bfbd-698a0a48d6aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:54.779265 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4331a8d-6c37-46a4-bfbd-698a0a48d6aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:54.779718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4331a8d-6c37-46a4-bfbd-698a0a48d6aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:54.780520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4331a8d-6c37-46a4-bfbd-698a0a48d6aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:54.780965 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e4331a8d-6c37-46a4-bfbd-698a0a48d6aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:54.911750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e4331a8d-6c37-46a4-bfbd-698a0a48d6aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:54.919525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e4331a8d-6c37-46a4-bfbd-698a0a48d6aa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154979 Apr 07 13:27:54.920081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1185/2486] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:54 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:55.937016 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a9794d6a-ac7e-4a44-89e3-c68909d6e6ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:55.937625 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a9794d6a-ac7e-4a44-89e3-c68909d6e6ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:55.944875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9794d6a-ac7e-4a44-89e3-c68909d6e6ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:55.945319 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9794d6a-ac7e-4a44-89e3-c68909d6e6ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:55.946066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9794d6a-ac7e-4a44-89e3-c68909d6e6ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:55.946496 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9794d6a-ac7e-4a44-89e3-c68909d6e6ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:56.080963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a9794d6a-ac7e-4a44-89e3-c68909d6e6ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:56.088709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a9794d6a-ac7e-4a44-89e3-c68909d6e6ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155481 Apr 07 13:27:56.089274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1302/2487] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:55 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:57.106065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-556f2089-7e65-42cc-a542-77aa2901888b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:57.106721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-556f2089-7e65-42cc-a542-77aa2901888b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:57.113260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-556f2089-7e65-42cc-a542-77aa2901888b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:57.113713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-556f2089-7e65-42cc-a542-77aa2901888b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:57.114503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-556f2089-7e65-42cc-a542-77aa2901888b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:57.114948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-556f2089-7e65-42cc-a542-77aa2901888b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:57.247765 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-556f2089-7e65-42cc-a542-77aa2901888b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:57.256579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-556f2089-7e65-42cc-a542-77aa2901888b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154321 Apr 07 13:27:57.257158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1186/2488] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:58.273469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b11bcb3a-679a-4b94-acd9-72dbce501d65 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:58.274100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b11bcb3a-679a-4b94-acd9-72dbce501d65 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:58.280326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b11bcb3a-679a-4b94-acd9-72dbce501d65 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:58.280772 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b11bcb3a-679a-4b94-acd9-72dbce501d65 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:58.281517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b11bcb3a-679a-4b94-acd9-72dbce501d65 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:58.281946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b11bcb3a-679a-4b94-acd9-72dbce501d65 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:58.411000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b11bcb3a-679a-4b94-acd9-72dbce501d65 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:58.418746 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b11bcb3a-679a-4b94-acd9-72dbce501d65 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149092 Apr 07 13:27:58.419295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1303/2489] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:27:59.436946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1dae8217-7cd9-48e9-b3c7-132aa4431c1d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:27:59.437485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1dae8217-7cd9-48e9-b3c7-132aa4431c1d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:27:59.444520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1dae8217-7cd9-48e9-b3c7-132aa4431c1d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:59.444979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1dae8217-7cd9-48e9-b3c7-132aa4431c1d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:59.445743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1dae8217-7cd9-48e9-b3c7-132aa4431c1d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:27:59.446268 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1dae8217-7cd9-48e9-b3c7-132aa4431c1d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:27:59.577308 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1dae8217-7cd9-48e9-b3c7-132aa4431c1d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:27:59.585692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1dae8217-7cd9-48e9-b3c7-132aa4431c1d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152661 Apr 07 13:27:59.586267 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1187/2490] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:27:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:00.602757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d933acae-7b92-48d1-9403-1572e7eadf31 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:00.603375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d933acae-7b92-48d1-9403-1572e7eadf31 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:00.609655 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d933acae-7b92-48d1-9403-1572e7eadf31 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:00.610109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d933acae-7b92-48d1-9403-1572e7eadf31 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:00.610877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d933acae-7b92-48d1-9403-1572e7eadf31 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:00.611316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d933acae-7b92-48d1-9403-1572e7eadf31 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:00.742024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d933acae-7b92-48d1-9403-1572e7eadf31 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:00.749837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d933acae-7b92-48d1-9403-1572e7eadf31 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150920 Apr 07 13:28:00.750398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1304/2491] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:00 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:01.766731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-06cda852-eff0-4ba2-af9f-bcd8b94c52e8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:01.767355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-06cda852-eff0-4ba2-af9f-bcd8b94c52e8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:01.774445 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06cda852-eff0-4ba2-af9f-bcd8b94c52e8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:01.774906 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06cda852-eff0-4ba2-af9f-bcd8b94c52e8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:01.775711 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06cda852-eff0-4ba2-af9f-bcd8b94c52e8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:01.776184 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06cda852-eff0-4ba2-af9f-bcd8b94c52e8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:01.905342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-06cda852-eff0-4ba2-af9f-bcd8b94c52e8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:01.913517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-06cda852-eff0-4ba2-af9f-bcd8b94c52e8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150593 Apr 07 13:28:01.914075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1188/2492] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:01 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:02.930945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ffee564b-26a2-4929-b8fd-66ecb787522e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:02.931620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ffee564b-26a2-4929-b8fd-66ecb787522e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:02.938001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffee564b-26a2-4929-b8fd-66ecb787522e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:02.938451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffee564b-26a2-4929-b8fd-66ecb787522e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:02.939210 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffee564b-26a2-4929-b8fd-66ecb787522e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:02.939648 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ffee564b-26a2-4929-b8fd-66ecb787522e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:03.070090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ffee564b-26a2-4929-b8fd-66ecb787522e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:03.077920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ffee564b-26a2-4929-b8fd-66ecb787522e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150867 Apr 07 13:28:03.078472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1305/2493] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:02 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:03.434049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:28:03.434639 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:28:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:28:04.094957 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7b7caa54-a26c-48fc-b73c-963d43c7617c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:04.095584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7b7caa54-a26c-48fc-b73c-963d43c7617c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:04.102281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b7caa54-a26c-48fc-b73c-963d43c7617c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:04.102737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b7caa54-a26c-48fc-b73c-963d43c7617c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:04.103506 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b7caa54-a26c-48fc-b73c-963d43c7617c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:04.103949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7b7caa54-a26c-48fc-b73c-963d43c7617c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:04.238968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7b7caa54-a26c-48fc-b73c-963d43c7617c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:04.246706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7b7caa54-a26c-48fc-b73c-963d43c7617c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155747 Apr 07 13:28:04.247264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1189/2494] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:04 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:05.263512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f1293e69-ed74-4c67-89ff-743f50fec90d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:05.264134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f1293e69-ed74-4c67-89ff-743f50fec90d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:05.271121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1293e69-ed74-4c67-89ff-743f50fec90d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:05.271564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1293e69-ed74-4c67-89ff-743f50fec90d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:05.272353 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1293e69-ed74-4c67-89ff-743f50fec90d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:05.272783 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1293e69-ed74-4c67-89ff-743f50fec90d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:05.410236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f1293e69-ed74-4c67-89ff-743f50fec90d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:05.417958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f1293e69-ed74-4c67-89ff-743f50fec90d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.158276 Apr 07 13:28:05.418525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1306/2495] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:05 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:06.436462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-43be0fc7-4730-4a88-9519-550911d0792f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:06.437066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-43be0fc7-4730-4a88-9519-550911d0792f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:06.443503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43be0fc7-4730-4a88-9519-550911d0792f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:06.443955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43be0fc7-4730-4a88-9519-550911d0792f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:06.444751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43be0fc7-4730-4a88-9519-550911d0792f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:06.445192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43be0fc7-4730-4a88-9519-550911d0792f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:06.576288 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-43be0fc7-4730-4a88-9519-550911d0792f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:06.584706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-43be0fc7-4730-4a88-9519-550911d0792f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152021 Apr 07 13:28:06.585276 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1190/2496] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:06 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:07.603096 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-904f6d8e-5bb8-4ff9-a99d-06168fc77b89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:07.603715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-904f6d8e-5bb8-4ff9-a99d-06168fc77b89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:07.610090 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-904f6d8e-5bb8-4ff9-a99d-06168fc77b89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:07.610570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-904f6d8e-5bb8-4ff9-a99d-06168fc77b89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:07.611337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-904f6d8e-5bb8-4ff9-a99d-06168fc77b89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:07.612184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-904f6d8e-5bb8-4ff9-a99d-06168fc77b89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:07.749647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-904f6d8e-5bb8-4ff9-a99d-06168fc77b89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:07.758355 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-904f6d8e-5bb8-4ff9-a99d-06168fc77b89 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.160262 Apr 07 13:28:07.758920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1307/2497] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:07 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:08.774664 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eddc12fa-37dd-4d59-b4a0-290b75861653 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:08.775309 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-eddc12fa-37dd-4d59-b4a0-290b75861653 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:08.781580 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eddc12fa-37dd-4d59-b4a0-290b75861653 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:08.782033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eddc12fa-37dd-4d59-b4a0-290b75861653 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:08.782789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eddc12fa-37dd-4d59-b4a0-290b75861653 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:08.783224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eddc12fa-37dd-4d59-b4a0-290b75861653 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:08.916179 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eddc12fa-37dd-4d59-b4a0-290b75861653 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:08.924413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eddc12fa-37dd-4d59-b4a0-290b75861653 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153021 Apr 07 13:28:08.925052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1191/2498] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:08 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:09.942447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2a873561-4a0e-4fdf-8b85-741e4c74a2fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:09.943083 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2a873561-4a0e-4fdf-8b85-741e4c74a2fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:09.949447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2a873561-4a0e-4fdf-8b85-741e4c74a2fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:09.949901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2a873561-4a0e-4fdf-8b85-741e4c74a2fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:09.950661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2a873561-4a0e-4fdf-8b85-741e4c74a2fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:09.951104 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2a873561-4a0e-4fdf-8b85-741e4c74a2fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:10.081517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2a873561-4a0e-4fdf-8b85-741e4c74a2fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:10.089189 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2a873561-4a0e-4fdf-8b85-741e4c74a2fa tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151128 Apr 07 13:28:10.089749 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1308/2499] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:09 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:11.106037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6abb41eb-066a-4fbf-a223-c67446d21fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:11.107802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6abb41eb-066a-4fbf-a223-c67446d21fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:11.113541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6abb41eb-066a-4fbf-a223-c67446d21fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:11.114000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6abb41eb-066a-4fbf-a223-c67446d21fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:11.114771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6abb41eb-066a-4fbf-a223-c67446d21fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:11.115211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6abb41eb-066a-4fbf-a223-c67446d21fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:11.244727 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6abb41eb-066a-4fbf-a223-c67446d21fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:11.252689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6abb41eb-066a-4fbf-a223-c67446d21fb0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150280 Apr 07 13:28:11.253254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1192/2500] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:11 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:12.269751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2fb29baa-f69a-4532-9659-f000272a5ccd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:12.270362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2fb29baa-f69a-4532-9659-f000272a5ccd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:12.276764 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2fb29baa-f69a-4532-9659-f000272a5ccd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:12.277216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2fb29baa-f69a-4532-9659-f000272a5ccd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:12.277978 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2fb29baa-f69a-4532-9659-f000272a5ccd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:12.278417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2fb29baa-f69a-4532-9659-f000272a5ccd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:12.410057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2fb29baa-f69a-4532-9659-f000272a5ccd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:12.417865 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2fb29baa-f69a-4532-9659-f000272a5ccd tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152644 Apr 07 13:28:12.418421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1309/2501] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:12 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:13.435172 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e724634e-d285-4574-8713-aa2195b8a11f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:13.435699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e724634e-d285-4574-8713-aa2195b8a11f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:13.442722 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e724634e-d285-4574-8713-aa2195b8a11f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:13.443178 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e724634e-d285-4574-8713-aa2195b8a11f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:13.443946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e724634e-d285-4574-8713-aa2195b8a11f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:13.444413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e724634e-d285-4574-8713-aa2195b8a11f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:13.574404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e724634e-d285-4574-8713-aa2195b8a11f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:13.582372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e724634e-d285-4574-8713-aa2195b8a11f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151062 Apr 07 13:28:13.582892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1193/2502] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:13 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:14.598559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2bf7e7be-9d1f-4656-ad6b-8132bc1b73ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:14.599170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2bf7e7be-9d1f-4656-ad6b-8132bc1b73ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:14.605429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2bf7e7be-9d1f-4656-ad6b-8132bc1b73ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:14.605872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2bf7e7be-9d1f-4656-ad6b-8132bc1b73ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:14.606648 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2bf7e7be-9d1f-4656-ad6b-8132bc1b73ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:14.607078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2bf7e7be-9d1f-4656-ad6b-8132bc1b73ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:14.735893 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2bf7e7be-9d1f-4656-ad6b-8132bc1b73ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:14.744513 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2bf7e7be-9d1f-4656-ad6b-8132bc1b73ec tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149780 Apr 07 13:28:14.745075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1310/2503] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:14 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:15.761133 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-501ff3df-7920-4dfe-b787-8c308f11ee3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:15.761685 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-501ff3df-7920-4dfe-b787-8c308f11ee3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:15.768906 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-501ff3df-7920-4dfe-b787-8c308f11ee3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:15.769355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-501ff3df-7920-4dfe-b787-8c308f11ee3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:15.770115 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-501ff3df-7920-4dfe-b787-8c308f11ee3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:15.770548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-501ff3df-7920-4dfe-b787-8c308f11ee3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:15.902029 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-501ff3df-7920-4dfe-b787-8c308f11ee3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:15.910674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-501ff3df-7920-4dfe-b787-8c308f11ee3e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153401 Apr 07 13:28:15.911228 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1194/2504] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:15 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:16.926896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d62bdc44-b5e1-45e0-a8f1-b39703fb706d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:16.927508 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d62bdc44-b5e1-45e0-a8f1-b39703fb706d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:16.933830 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d62bdc44-b5e1-45e0-a8f1-b39703fb706d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:16.934289 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d62bdc44-b5e1-45e0-a8f1-b39703fb706d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:16.935051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d62bdc44-b5e1-45e0-a8f1-b39703fb706d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:16.935488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d62bdc44-b5e1-45e0-a8f1-b39703fb706d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:17.064261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d62bdc44-b5e1-45e0-a8f1-b39703fb706d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:17.072626 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d62bdc44-b5e1-45e0-a8f1-b39703fb706d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149594 Apr 07 13:28:17.073181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1311/2505] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:16 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:18.088892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3d2457c5-e546-4111-80d2-9d4c6f6dc2b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:18.089509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3d2457c5-e546-4111-80d2-9d4c6f6dc2b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:18.095784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d2457c5-e546-4111-80d2-9d4c6f6dc2b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:18.096272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d2457c5-e546-4111-80d2-9d4c6f6dc2b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:18.097042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d2457c5-e546-4111-80d2-9d4c6f6dc2b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:18.097485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3d2457c5-e546-4111-80d2-9d4c6f6dc2b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:18.225418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3d2457c5-e546-4111-80d2-9d4c6f6dc2b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:18.233079 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3d2457c5-e546-4111-80d2-9d4c6f6dc2b2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.148059 Apr 07 13:28:18.233646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1195/2506] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:19.250618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7fd78601-bdaf-4766-8e14-860394ed8e90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:19.251147 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7fd78601-bdaf-4766-8e14-860394ed8e90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:19.257566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fd78601-bdaf-4766-8e14-860394ed8e90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:19.258022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fd78601-bdaf-4766-8e14-860394ed8e90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:19.258770 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fd78601-bdaf-4766-8e14-860394ed8e90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:19.259203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fd78601-bdaf-4766-8e14-860394ed8e90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:19.656800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7fd78601-bdaf-4766-8e14-860394ed8e90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:19.665010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7fd78601-bdaf-4766-8e14-860394ed8e90 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.418356 Apr 07 13:28:19.665582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1312/2507] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:19 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:20.682324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cc9973d0-85ca-4582-82eb-5009a80ae062 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:20.682938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cc9973d0-85ca-4582-82eb-5009a80ae062 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:20.689777 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc9973d0-85ca-4582-82eb-5009a80ae062 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:20.690241 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc9973d0-85ca-4582-82eb-5009a80ae062 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:20.691000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc9973d0-85ca-4582-82eb-5009a80ae062 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:20.691437 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cc9973d0-85ca-4582-82eb-5009a80ae062 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:20.825558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cc9973d0-85ca-4582-82eb-5009a80ae062 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:20.833934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cc9973d0-85ca-4582-82eb-5009a80ae062 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155461 Apr 07 13:28:20.834495 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1196/2508] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:20 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:21.852479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e0d123ca-64b1-452f-91aa-e21481aff605 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:21.853100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e0d123ca-64b1-452f-91aa-e21481aff605 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:21.859836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0d123ca-64b1-452f-91aa-e21481aff605 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:21.860334 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0d123ca-64b1-452f-91aa-e21481aff605 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:21.861100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0d123ca-64b1-452f-91aa-e21481aff605 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:21.861535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e0d123ca-64b1-452f-91aa-e21481aff605 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:22.008270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e0d123ca-64b1-452f-91aa-e21481aff605 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:22.017179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e0d123ca-64b1-452f-91aa-e21481aff605 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.168459 Apr 07 13:28:22.019149 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1313/2509] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:21 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:23.037418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ade1b865-7dbf-4df8-9325-c0f14a1fe145 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:23.038035 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ade1b865-7dbf-4df8-9325-c0f14a1fe145 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:23.044346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ade1b865-7dbf-4df8-9325-c0f14a1fe145 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:23.044804 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ade1b865-7dbf-4df8-9325-c0f14a1fe145 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:23.045576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ade1b865-7dbf-4df8-9325-c0f14a1fe145 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:23.046016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ade1b865-7dbf-4df8-9325-c0f14a1fe145 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:23.176190 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ade1b865-7dbf-4df8-9325-c0f14a1fe145 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:23.183845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ade1b865-7dbf-4df8-9325-c0f14a1fe145 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151150 Apr 07 13:28:23.184436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1197/2510] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:23 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:24.201699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fceec1af-9a25-4ae5-94a8-a3f2c6a9ec27 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:24.202346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fceec1af-9a25-4ae5-94a8-a3f2c6a9ec27 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:24.208742 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fceec1af-9a25-4ae5-94a8-a3f2c6a9ec27 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:24.209196 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fceec1af-9a25-4ae5-94a8-a3f2c6a9ec27 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:24.209960 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fceec1af-9a25-4ae5-94a8-a3f2c6a9ec27 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:24.210397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fceec1af-9a25-4ae5-94a8-a3f2c6a9ec27 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:24.339931 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fceec1af-9a25-4ae5-94a8-a3f2c6a9ec27 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:24.348297 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fceec1af-9a25-4ae5-94a8-a3f2c6a9ec27 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150477 Apr 07 13:28:24.348851 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1314/2511] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:24 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:25.365524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4dcc2b74-e167-4854-991c-94197f7e7785 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:25.366170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4dcc2b74-e167-4854-991c-94197f7e7785 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:25.372538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4dcc2b74-e167-4854-991c-94197f7e7785 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:25.372996 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4dcc2b74-e167-4854-991c-94197f7e7785 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:25.373759 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4dcc2b74-e167-4854-991c-94197f7e7785 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:25.374199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4dcc2b74-e167-4854-991c-94197f7e7785 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:25.507830 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4dcc2b74-e167-4854-991c-94197f7e7785 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:25.515554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4dcc2b74-e167-4854-991c-94197f7e7785 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153845 Apr 07 13:28:25.516111 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1198/2512] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:25 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:26.532883 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8f3a0e31-2eca-4a92-82f6-d5e877391927 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:26.533653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8f3a0e31-2eca-4a92-82f6-d5e877391927 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:26.539945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8f3a0e31-2eca-4a92-82f6-d5e877391927 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:26.540439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8f3a0e31-2eca-4a92-82f6-d5e877391927 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:26.541199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8f3a0e31-2eca-4a92-82f6-d5e877391927 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:26.541634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8f3a0e31-2eca-4a92-82f6-d5e877391927 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:26.672556 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8f3a0e31-2eca-4a92-82f6-d5e877391927 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:26.680950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8f3a0e31-2eca-4a92-82f6-d5e877391927 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151946 Apr 07 13:28:26.681512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1315/2513] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:26 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:28:27.698738 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-45f26402-dbd4-418a-b756-4bc76c91d282 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:27.699355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-45f26402-dbd4-418a-b756-4bc76c91d282 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:27.705712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-45f26402-dbd4-418a-b756-4bc76c91d282 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:27.706166 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-45f26402-dbd4-418a-b756-4bc76c91d282 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:27.706930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-45f26402-dbd4-418a-b756-4bc76c91d282 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:27.707367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-45f26402-dbd4-418a-b756-4bc76c91d282 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:27.838999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-45f26402-dbd4-418a-b756-4bc76c91d282 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:27.847450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-45f26402-dbd4-418a-b756-4bc76c91d282 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152529 Apr 07 13:28:27.848173 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1199/2514] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:28.865058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3dd1df04-e0e6-40bb-939a-952c75e38544 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:28.865674 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3dd1df04-e0e6-40bb-939a-952c75e38544 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:28.871972 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3dd1df04-e0e6-40bb-939a-952c75e38544 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:28.872454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3dd1df04-e0e6-40bb-939a-952c75e38544 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:28.873215 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3dd1df04-e0e6-40bb-939a-952c75e38544 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:28.873653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3dd1df04-e0e6-40bb-939a-952c75e38544 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:29.010967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3dd1df04-e0e6-40bb-939a-952c75e38544 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:29.019466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3dd1df04-e0e6-40bb-939a-952c75e38544 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.158942 Apr 07 13:28:29.020092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1316/2515] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:28 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:30.037398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-253a908e-8a27-4612-b28e-7adb141c4934 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:30.038088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-253a908e-8a27-4612-b28e-7adb141c4934 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:30.044318 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-253a908e-8a27-4612-b28e-7adb141c4934 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:30.044767 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-253a908e-8a27-4612-b28e-7adb141c4934 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:30.045532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-253a908e-8a27-4612-b28e-7adb141c4934 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:30.045967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-253a908e-8a27-4612-b28e-7adb141c4934 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:30.178428 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-253a908e-8a27-4612-b28e-7adb141c4934 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:30.186004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-253a908e-8a27-4612-b28e-7adb141c4934 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153500 Apr 07 13:28:30.186561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1200/2516] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:30 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:31.202942 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-14f3232e-6d6a-4b2f-b256-6696c39611cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:31.203558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-14f3232e-6d6a-4b2f-b256-6696c39611cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:31.210847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14f3232e-6d6a-4b2f-b256-6696c39611cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:31.211379 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14f3232e-6d6a-4b2f-b256-6696c39611cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:31.212167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14f3232e-6d6a-4b2f-b256-6696c39611cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:31.212845 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-14f3232e-6d6a-4b2f-b256-6696c39611cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:31.343675 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-14f3232e-6d6a-4b2f-b256-6696c39611cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:31.351537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-14f3232e-6d6a-4b2f-b256-6696c39611cb tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152409 Apr 07 13:28:31.352106 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1317/2517] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:31 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:32.369242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ffc18b14-4956-4a85-95fd-16b53adc8817 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:32.369860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ffc18b14-4956-4a85-95fd-16b53adc8817 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:32.376890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ffc18b14-4956-4a85-95fd-16b53adc8817 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:32.377358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ffc18b14-4956-4a85-95fd-16b53adc8817 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:32.378124 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ffc18b14-4956-4a85-95fd-16b53adc8817 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:32.378566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ffc18b14-4956-4a85-95fd-16b53adc8817 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:32.513864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ffc18b14-4956-4a85-95fd-16b53adc8817 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:32.522745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ffc18b14-4956-4a85-95fd-16b53adc8817 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157264 Apr 07 13:28:32.523247 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1201/2518] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:32 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:33.539056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7528289f-870d-4b98-8045-0228fffedff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:33.539631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7528289f-870d-4b98-8045-0228fffedff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:33.545843 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7528289f-870d-4b98-8045-0228fffedff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:33.546293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7528289f-870d-4b98-8045-0228fffedff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:33.547039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7528289f-870d-4b98-8045-0228fffedff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:33.547467 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7528289f-870d-4b98-8045-0228fffedff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:33.686671 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7528289f-870d-4b98-8045-0228fffedff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:33.695572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7528289f-870d-4b98-8045-0228fffedff3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.160708 Apr 07 13:28:33.696128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1318/2519] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:33 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:34.712662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a326cf98-b6f7-4e57-b2d4-7b45af55d0ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:34.713285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a326cf98-b6f7-4e57-b2d4-7b45af55d0ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:34.719212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a326cf98-b6f7-4e57-b2d4-7b45af55d0ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:34.719662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a326cf98-b6f7-4e57-b2d4-7b45af55d0ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:34.720548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a326cf98-b6f7-4e57-b2d4-7b45af55d0ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:34.720981 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a326cf98-b6f7-4e57-b2d4-7b45af55d0ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:34.850517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a326cf98-b6f7-4e57-b2d4-7b45af55d0ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:34.858242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a326cf98-b6f7-4e57-b2d4-7b45af55d0ff tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149564 Apr 07 13:28:34.858807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1202/2520] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:34 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:35.876787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d2705830-217a-4598-b184-04a4a55e3075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:35.877401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d2705830-217a-4598-b184-04a4a55e3075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:35.883661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2705830-217a-4598-b184-04a4a55e3075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:35.884159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2705830-217a-4598-b184-04a4a55e3075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:35.884917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2705830-217a-4598-b184-04a4a55e3075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:35.885351 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d2705830-217a-4598-b184-04a4a55e3075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:36.019108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d2705830-217a-4598-b184-04a4a55e3075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:36.026968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d2705830-217a-4598-b184-04a4a55e3075 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154642 Apr 07 13:28:36.027528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1319/2521] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:35 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:37.045314 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-38c9b778-8772-4b2d-9aa6-e71fd285a9c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:37.045934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-38c9b778-8772-4b2d-9aa6-e71fd285a9c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:37.053001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38c9b778-8772-4b2d-9aa6-e71fd285a9c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:37.053460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38c9b778-8772-4b2d-9aa6-e71fd285a9c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:37.054229 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38c9b778-8772-4b2d-9aa6-e71fd285a9c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:37.054671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-38c9b778-8772-4b2d-9aa6-e71fd285a9c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:37.187591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-38c9b778-8772-4b2d-9aa6-e71fd285a9c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:37.195645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-38c9b778-8772-4b2d-9aa6-e71fd285a9c7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154203 Apr 07 13:28:37.196229 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1203/2522] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:37 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:38.338462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-89472680-ba9f-4adc-94ac-1a66c2e0c268 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:38.339099 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-89472680-ba9f-4adc-94ac-1a66c2e0c268 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:38.345387 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89472680-ba9f-4adc-94ac-1a66c2e0c268 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:38.345924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89472680-ba9f-4adc-94ac-1a66c2e0c268 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:38.346683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89472680-ba9f-4adc-94ac-1a66c2e0c268 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:38.347114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-89472680-ba9f-4adc-94ac-1a66c2e0c268 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:38.476665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-89472680-ba9f-4adc-94ac-1a66c2e0c268 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:38.484503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-89472680-ba9f-4adc-94ac-1a66c2e0c268 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.275510 Apr 07 13:28:38.485063 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1320/2523] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:38 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:39.503278 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-74430057-ed9f-4c4a-a03e-e6b30a9f09b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:39.503841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-74430057-ed9f-4c4a-a03e-e6b30a9f09b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:39.510228 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74430057-ed9f-4c4a-a03e-e6b30a9f09b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:39.510678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74430057-ed9f-4c4a-a03e-e6b30a9f09b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:39.511435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74430057-ed9f-4c4a-a03e-e6b30a9f09b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:39.511878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-74430057-ed9f-4c4a-a03e-e6b30a9f09b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:39.648955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-74430057-ed9f-4c4a-a03e-e6b30a9f09b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:39.656978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-74430057-ed9f-4c4a-a03e-e6b30a9f09b8 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.158235 Apr 07 13:28:39.657692 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1204/2524] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:39 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:40.673399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e48d7255-3bae-44d8-b947-07a7891de693 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:40.674039 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e48d7255-3bae-44d8-b947-07a7891de693 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:40.680384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e48d7255-3bae-44d8-b947-07a7891de693 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:40.680835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e48d7255-3bae-44d8-b947-07a7891de693 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:40.681596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e48d7255-3bae-44d8-b947-07a7891de693 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:40.682032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e48d7255-3bae-44d8-b947-07a7891de693 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:40.815595 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e48d7255-3bae-44d8-b947-07a7891de693 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:40.823880 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e48d7255-3bae-44d8-b947-07a7891de693 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153845 Apr 07 13:28:40.824133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1321/2525] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:40 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:41.841848 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6f3c3f7f-336b-4be2-8619-8d6a54bf7ab7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:41.842398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6f3c3f7f-336b-4be2-8619-8d6a54bf7ab7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:41.849441 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6f3c3f7f-336b-4be2-8619-8d6a54bf7ab7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:41.849897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6f3c3f7f-336b-4be2-8619-8d6a54bf7ab7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:41.850664 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6f3c3f7f-336b-4be2-8619-8d6a54bf7ab7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:41.851176 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6f3c3f7f-336b-4be2-8619-8d6a54bf7ab7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:41.992749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6f3c3f7f-336b-4be2-8619-8d6a54bf7ab7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:42.001092 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6f3c3f7f-336b-4be2-8619-8d6a54bf7ab7 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.163089 Apr 07 13:28:42.001941 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1205/2526] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:41 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:43.018277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e02a9519-9181-485f-b47e-19129df4df87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:43.018889 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e02a9519-9181-485f-b47e-19129df4df87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:43.025206 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e02a9519-9181-485f-b47e-19129df4df87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:43.025651 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e02a9519-9181-485f-b47e-19129df4df87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:43.026398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e02a9519-9181-485f-b47e-19129df4df87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:43.026829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e02a9519-9181-485f-b47e-19129df4df87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:43.162202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e02a9519-9181-485f-b47e-19129df4df87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:43.170207 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e02a9519-9181-485f-b47e-19129df4df87 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155719 Apr 07 13:28:43.171898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1322/2527] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:43 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:44.187742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3e54be5f-a30c-4730-a1a8-716193eb7d29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:44.189449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3e54be5f-a30c-4730-a1a8-716193eb7d29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:44.196096 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3e54be5f-a30c-4730-a1a8-716193eb7d29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:44.196588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3e54be5f-a30c-4730-a1a8-716193eb7d29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:44.197362 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3e54be5f-a30c-4730-a1a8-716193eb7d29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:44.197800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3e54be5f-a30c-4730-a1a8-716193eb7d29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:44.544203 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3e54be5f-a30c-4730-a1a8-716193eb7d29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:44.552449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3e54be5f-a30c-4730-a1a8-716193eb7d29 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.368467 Apr 07 13:28:44.553012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1206/2528] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:44 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:45.569851 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c6ec6f80-5c38-4ba8-9fde-1bba08952419 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:45.570399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c6ec6f80-5c38-4ba8-9fde-1bba08952419 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:45.576627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c6ec6f80-5c38-4ba8-9fde-1bba08952419 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:45.577072 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c6ec6f80-5c38-4ba8-9fde-1bba08952419 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:45.577823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c6ec6f80-5c38-4ba8-9fde-1bba08952419 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:45.578256 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c6ec6f80-5c38-4ba8-9fde-1bba08952419 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:45.713263 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c6ec6f80-5c38-4ba8-9fde-1bba08952419 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:45.720973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c6ec6f80-5c38-4ba8-9fde-1bba08952419 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154995 Apr 07 13:28:45.721532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1323/2529] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:45 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:46.737666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-019844e9-5dc5-403d-b27e-4c359fe6114e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:46.738280 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-019844e9-5dc5-403d-b27e-4c359fe6114e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:46.744645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-019844e9-5dc5-403d-b27e-4c359fe6114e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:46.745102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-019844e9-5dc5-403d-b27e-4c359fe6114e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:46.745866 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-019844e9-5dc5-403d-b27e-4c359fe6114e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:46.746301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-019844e9-5dc5-403d-b27e-4c359fe6114e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:46.878675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-019844e9-5dc5-403d-b27e-4c359fe6114e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:46.886410 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-019844e9-5dc5-403d-b27e-4c359fe6114e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152697 Apr 07 13:28:46.886974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1207/2530] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:46 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:47.903747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-50dbe088-7b64-4a4a-8a51-e0800ecc7cc3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:47.904394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-50dbe088-7b64-4a4a-8a51-e0800ecc7cc3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:47.911837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50dbe088-7b64-4a4a-8a51-e0800ecc7cc3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:47.912331 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50dbe088-7b64-4a4a-8a51-e0800ecc7cc3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:47.913092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50dbe088-7b64-4a4a-8a51-e0800ecc7cc3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:47.913532 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50dbe088-7b64-4a4a-8a51-e0800ecc7cc3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:48.047620 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-50dbe088-7b64-4a4a-8a51-e0800ecc7cc3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:48.055404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-50dbe088-7b64-4a4a-8a51-e0800ecc7cc3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155499 Apr 07 13:28:48.055974 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1324/2531] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:47 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:49.072717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-04fe1441-33a3-430f-9c8c-6106136906e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:49.073319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-04fe1441-33a3-430f-9c8c-6106136906e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:49.080342 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-04fe1441-33a3-430f-9c8c-6106136906e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:49.080800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-04fe1441-33a3-430f-9c8c-6106136906e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:49.081572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-04fe1441-33a3-430f-9c8c-6106136906e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:49.082016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-04fe1441-33a3-430f-9c8c-6106136906e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:49.216583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-04fe1441-33a3-430f-9c8c-6106136906e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:49.224760 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-04fe1441-33a3-430f-9c8c-6106136906e6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155946 Apr 07 13:28:49.225324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1208/2532] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:49 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:50.241633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b3631119-f793-46d9-9c8d-e71d24c049c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:50.242226 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b3631119-f793-46d9-9c8d-e71d24c049c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:50.248586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3631119-f793-46d9-9c8d-e71d24c049c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:50.249036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3631119-f793-46d9-9c8d-e71d24c049c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:50.249793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3631119-f793-46d9-9c8d-e71d24c049c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:50.250228 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b3631119-f793-46d9-9c8d-e71d24c049c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:50.385343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b3631119-f793-46d9-9c8d-e71d24c049c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:50.393767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b3631119-f793-46d9-9c8d-e71d24c049c2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155973 Apr 07 13:28:50.394326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1325/2533] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:50 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:51.411575 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-14034324-2859-425d-a41c-401c4892ec81 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:51.412171 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-14034324-2859-425d-a41c-401c4892ec81 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:51.418478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14034324-2859-425d-a41c-401c4892ec81 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:51.418933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14034324-2859-425d-a41c-401c4892ec81 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:51.419708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14034324-2859-425d-a41c-401c4892ec81 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:51.420169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-14034324-2859-425d-a41c-401c4892ec81 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:51.555852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-14034324-2859-425d-a41c-401c4892ec81 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:51.564281 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-14034324-2859-425d-a41c-401c4892ec81 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157495 Apr 07 13:28:51.564844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1209/2534] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:51 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:52.582378 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9923f4c0-6dbc-49a2-9266-469cdda0c56e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:52.583703 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9923f4c0-6dbc-49a2-9266-469cdda0c56e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:52.589231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9923f4c0-6dbc-49a2-9266-469cdda0c56e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:52.589686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9923f4c0-6dbc-49a2-9266-469cdda0c56e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:52.590459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9923f4c0-6dbc-49a2-9266-469cdda0c56e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:52.590895 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9923f4c0-6dbc-49a2-9266-469cdda0c56e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:52.722062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9923f4c0-6dbc-49a2-9266-469cdda0c56e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:52.729866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9923f4c0-6dbc-49a2-9266-469cdda0c56e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152073 Apr 07 13:28:52.730433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1326/2535] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:52 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:53.746868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5257957f-da6d-4bbd-a4e4-18e66ca5a873 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:53.747484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5257957f-da6d-4bbd-a4e4-18e66ca5a873 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:53.753946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5257957f-da6d-4bbd-a4e4-18e66ca5a873 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:53.754406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5257957f-da6d-4bbd-a4e4-18e66ca5a873 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:53.755167 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5257957f-da6d-4bbd-a4e4-18e66ca5a873 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:53.755606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5257957f-da6d-4bbd-a4e4-18e66ca5a873 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:53.892296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5257957f-da6d-4bbd-a4e4-18e66ca5a873 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:53.900597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5257957f-da6d-4bbd-a4e4-18e66ca5a873 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157592 Apr 07 13:28:53.901162 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1210/2536] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:53 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:54.918383 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d53c3a5e-8a0a-4c1e-9bbc-460f23934113 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:54.918997 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d53c3a5e-8a0a-4c1e-9bbc-460f23934113 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:54.926193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d53c3a5e-8a0a-4c1e-9bbc-460f23934113 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:54.926650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d53c3a5e-8a0a-4c1e-9bbc-460f23934113 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:54.927409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d53c3a5e-8a0a-4c1e-9bbc-460f23934113 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:54.927844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d53c3a5e-8a0a-4c1e-9bbc-460f23934113 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:55.059187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d53c3a5e-8a0a-4c1e-9bbc-460f23934113 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:55.067191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d53c3a5e-8a0a-4c1e-9bbc-460f23934113 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152654 Apr 07 13:28:55.067749 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1327/2537] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:54 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:56.084361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-994d4b44-9d13-464f-b3f9-f8e6fdefc153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:56.084988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-994d4b44-9d13-464f-b3f9-f8e6fdefc153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:56.091175 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-994d4b44-9d13-464f-b3f9-f8e6fdefc153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:56.091634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-994d4b44-9d13-464f-b3f9-f8e6fdefc153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:56.092433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-994d4b44-9d13-464f-b3f9-f8e6fdefc153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:56.092879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-994d4b44-9d13-464f-b3f9-f8e6fdefc153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:56.240317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-994d4b44-9d13-464f-b3f9-f8e6fdefc153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:56.248245 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-994d4b44-9d13-464f-b3f9-f8e6fdefc153 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.167854 Apr 07 13:28:56.248803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1211/2538] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:56 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:57.266378 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2424072c-38d7-46e8-a9dc-e07374f35d0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:57.267010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2424072c-38d7-46e8-a9dc-e07374f35d0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:57.274009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2424072c-38d7-46e8-a9dc-e07374f35d0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:57.274462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2424072c-38d7-46e8-a9dc-e07374f35d0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:57.275245 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2424072c-38d7-46e8-a9dc-e07374f35d0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:57.275691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2424072c-38d7-46e8-a9dc-e07374f35d0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:57.409894 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2424072c-38d7-46e8-a9dc-e07374f35d0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:57.417720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2424072c-38d7-46e8-a9dc-e07374f35d0a tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155343 Apr 07 13:28:57.418282 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1328/2539] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:57 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:58.435068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a049ddd8-e1e8-4add-80cb-969446a4f94e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:58.435682 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a049ddd8-e1e8-4add-80cb-969446a4f94e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:58.441999 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a049ddd8-e1e8-4add-80cb-969446a4f94e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:58.442456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a049ddd8-e1e8-4add-80cb-969446a4f94e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:58.443215 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a049ddd8-e1e8-4add-80cb-969446a4f94e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:58.443661 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a049ddd8-e1e8-4add-80cb-969446a4f94e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:58.577323 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a049ddd8-e1e8-4add-80cb-969446a4f94e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:58.585721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a049ddd8-e1e8-4add-80cb-969446a4f94e tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154521 Apr 07 13:28:58.586285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1212/2540] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:58 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:28:59.602904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-23d17257-23c3-411f-892f-1248076a4449 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:28:59.603517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-23d17257-23c3-411f-892f-1248076a4449 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:28:59.609836 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-23d17257-23c3-411f-892f-1248076a4449 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:59.610283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-23d17257-23c3-411f-892f-1248076a4449 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:59.611045 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-23d17257-23c3-411f-892f-1248076a4449 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:28:59.612078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-23d17257-23c3-411f-892f-1248076a4449 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:28:59.742700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-23d17257-23c3-411f-892f-1248076a4449 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:28:59.750430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-23d17257-23c3-411f-892f-1248076a4449 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151381 Apr 07 13:28:59.750991 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1329/2541] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:28:59 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:00.767082 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-57e31b36-4e2b-427b-802b-3701f2ea3751 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:00.767686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-57e31b36-4e2b-427b-802b-3701f2ea3751 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:00.777560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57e31b36-4e2b-427b-802b-3701f2ea3751 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:00.778007 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57e31b36-4e2b-427b-802b-3701f2ea3751 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:00.778768 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57e31b36-4e2b-427b-802b-3701f2ea3751 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:00.779206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-57e31b36-4e2b-427b-802b-3701f2ea3751 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:00.910571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-57e31b36-4e2b-427b-802b-3701f2ea3751 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:00.918371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-57e31b36-4e2b-427b-802b-3701f2ea3751 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155105 Apr 07 13:29:00.919000 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1213/2542] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:00 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:01.935287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-186dab2f-60fd-4ea5-85b2-bc95ccc67c45 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:01.935911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-186dab2f-60fd-4ea5-85b2-bc95ccc67c45 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:01.942406 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-186dab2f-60fd-4ea5-85b2-bc95ccc67c45 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:01.942846 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-186dab2f-60fd-4ea5-85b2-bc95ccc67c45 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:01.943617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-186dab2f-60fd-4ea5-85b2-bc95ccc67c45 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:01.944057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-186dab2f-60fd-4ea5-85b2-bc95ccc67c45 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:02.082248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-186dab2f-60fd-4ea5-85b2-bc95ccc67c45 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:02.090048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-186dab2f-60fd-4ea5-85b2-bc95ccc67c45 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.158630 Apr 07 13:29:02.090608 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1330/2543] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:01 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:03.107259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f5130092-a802-4062-b2c1-ae9abf0cd370 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:03.107879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f5130092-a802-4062-b2c1-ae9abf0cd370 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:03.114756 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5130092-a802-4062-b2c1-ae9abf0cd370 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:03.115209 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5130092-a802-4062-b2c1-ae9abf0cd370 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:03.115971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5130092-a802-4062-b2c1-ae9abf0cd370 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:03.116441 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f5130092-a802-4062-b2c1-ae9abf0cd370 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:03.245040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f5130092-a802-4062-b2c1-ae9abf0cd370 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:03.252756 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f5130092-a802-4062-b2c1-ae9abf0cd370 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149315 Apr 07 13:29:03.253562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1214/2544] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:03 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:04.271826 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6383a785-fa3b-48e7-8fc6-9db77e471d0d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:04.272538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6383a785-fa3b-48e7-8fc6-9db77e471d0d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:04.278943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6383a785-fa3b-48e7-8fc6-9db77e471d0d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:04.279394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6383a785-fa3b-48e7-8fc6-9db77e471d0d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:04.280169 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6383a785-fa3b-48e7-8fc6-9db77e471d0d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:04.280609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6383a785-fa3b-48e7-8fc6-9db77e471d0d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:04.411033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6383a785-fa3b-48e7-8fc6-9db77e471d0d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:04.418681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6383a785-fa3b-48e7-8fc6-9db77e471d0d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151332 Apr 07 13:29:04.419235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1331/2545] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:04 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:05.435261 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fb0c27f2-7736-4872-8c08-655245684e4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:05.435908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fb0c27f2-7736-4872-8c08-655245684e4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:05.442064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb0c27f2-7736-4872-8c08-655245684e4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:05.442517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb0c27f2-7736-4872-8c08-655245684e4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:05.443279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb0c27f2-7736-4872-8c08-655245684e4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:05.443716 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fb0c27f2-7736-4872-8c08-655245684e4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:05.584134 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fb0c27f2-7736-4872-8c08-655245684e4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:05.592001 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fb0c27f2-7736-4872-8c08-655245684e4d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.160541 Apr 07 13:29:05.592594 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1215/2546] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:05 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:29:06.609477 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7bcb1827-bdc0-4c87-8a80-f55fbb868979 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:06.610085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7bcb1827-bdc0-4c87-8a80-f55fbb868979 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:06.616827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7bcb1827-bdc0-4c87-8a80-f55fbb868979 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:06.617271 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7bcb1827-bdc0-4c87-8a80-f55fbb868979 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:06.618029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7bcb1827-bdc0-4c87-8a80-f55fbb868979 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:06.618462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7bcb1827-bdc0-4c87-8a80-f55fbb868979 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:06.746681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7bcb1827-bdc0-4c87-8a80-f55fbb868979 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:06.755124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7bcb1827-bdc0-4c87-8a80-f55fbb868979 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.149514 Apr 07 13:29:06.755690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1332/2547] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:06 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:07.772594 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-eadf8162-1244-4ed8-9f19-1a2ac00d99ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:07.773212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-eadf8162-1244-4ed8-9f19-1a2ac00d99ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:07.779618 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eadf8162-1244-4ed8-9f19-1a2ac00d99ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:07.780071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eadf8162-1244-4ed8-9f19-1a2ac00d99ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:07.780864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eadf8162-1244-4ed8-9f19-1a2ac00d99ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:07.781330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-eadf8162-1244-4ed8-9f19-1a2ac00d99ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:07.913042 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-eadf8162-1244-4ed8-9f19-1a2ac00d99ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:07.920784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-eadf8162-1244-4ed8-9f19-1a2ac00d99ac tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152711 Apr 07 13:29:07.921345 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1216/2548] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:07 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:08.938092 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ea7cd4eb-d866-49a0-8c9f-18e2e957f6e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:08.938732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ea7cd4eb-d866-49a0-8c9f-18e2e957f6e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:08.945969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea7cd4eb-d866-49a0-8c9f-18e2e957f6e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:08.946447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea7cd4eb-d866-49a0-8c9f-18e2e957f6e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:08.947219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea7cd4eb-d866-49a0-8c9f-18e2e957f6e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:08.947712 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ea7cd4eb-d866-49a0-8c9f-18e2e957f6e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:09.087449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ea7cd4eb-d866-49a0-8c9f-18e2e957f6e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:09.095072 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ea7cd4eb-d866-49a0-8c9f-18e2e957f6e2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.160951 Apr 07 13:29:09.095629 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1333/2549] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:08 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:10.112705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0ed1fac0-9752-4756-bae8-a45f3f15b217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:10.113332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0ed1fac0-9752-4756-bae8-a45f3f15b217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:10.119590 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ed1fac0-9752-4756-bae8-a45f3f15b217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:10.120044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ed1fac0-9752-4756-bae8-a45f3f15b217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:10.120846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ed1fac0-9752-4756-bae8-a45f3f15b217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:10.121284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ed1fac0-9752-4756-bae8-a45f3f15b217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:10.254831 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0ed1fac0-9752-4756-bae8-a45f3f15b217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:10.262716 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0ed1fac0-9752-4756-bae8-a45f3f15b217 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.154015 Apr 07 13:29:10.263279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1217/2550] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:10 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:11.280167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-29982b86-0b47-4a12-95b9-5341828d2b05 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:11.280782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-29982b86-0b47-4a12-95b9-5341828d2b05 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:11.287598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-29982b86-0b47-4a12-95b9-5341828d2b05 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:11.288048 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-29982b86-0b47-4a12-95b9-5341828d2b05 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:11.288825 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-29982b86-0b47-4a12-95b9-5341828d2b05 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:11.289260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-29982b86-0b47-4a12-95b9-5341828d2b05 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:11.424017 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-29982b86-0b47-4a12-95b9-5341828d2b05 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:11.432075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-29982b86-0b47-4a12-95b9-5341828d2b05 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155722 Apr 07 13:29:11.432658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1334/2551] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:11 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:12.456353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7def8db2-b89f-4f86-a83f-bb3675c500ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:12.457792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7def8db2-b89f-4f86-a83f-bb3675c500ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:12.464135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7def8db2-b89f-4f86-a83f-bb3675c500ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:12.464628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7def8db2-b89f-4f86-a83f-bb3675c500ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:12.465400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7def8db2-b89f-4f86-a83f-bb3675c500ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:12.465843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7def8db2-b89f-4f86-a83f-bb3675c500ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:12.597479 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7def8db2-b89f-4f86-a83f-bb3675c500ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:12.605805 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7def8db2-b89f-4f86-a83f-bb3675c500ba tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153471 Apr 07 13:29:12.606361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1218/2552] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:12 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:13.622523 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d32deebe-84ab-4dd5-b6a5-a8ebc8565321 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:13.623140 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d32deebe-84ab-4dd5-b6a5-a8ebc8565321 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:13.629923 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d32deebe-84ab-4dd5-b6a5-a8ebc8565321 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:13.630377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d32deebe-84ab-4dd5-b6a5-a8ebc8565321 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:13.631134 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d32deebe-84ab-4dd5-b6a5-a8ebc8565321 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:13.631567 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d32deebe-84ab-4dd5-b6a5-a8ebc8565321 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:13.767206 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d32deebe-84ab-4dd5-b6a5-a8ebc8565321 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:13.775844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d32deebe-84ab-4dd5-b6a5-a8ebc8565321 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157030 Apr 07 13:29:13.776436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1335/2553] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:13 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:14.353570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:29:14.353826 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:29:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:29:14.792570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4b63ff2b-900c-4f50-b3d5-7634dc659a34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:14.793124 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4b63ff2b-900c-4f50-b3d5-7634dc659a34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:14.799349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b63ff2b-900c-4f50-b3d5-7634dc659a34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:14.799801 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b63ff2b-900c-4f50-b3d5-7634dc659a34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:14.801074 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b63ff2b-900c-4f50-b3d5-7634dc659a34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:14.801550 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4b63ff2b-900c-4f50-b3d5-7634dc659a34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:14.931875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4b63ff2b-900c-4f50-b3d5-7634dc659a34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:14.939735 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4b63ff2b-900c-4f50-b3d5-7634dc659a34 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151078 Apr 07 13:29:14.940330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1219/2554] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:14 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:15.956847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-dbdb7566-1f61-4637-9025-c90e9ec987e1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:15.957569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-dbdb7566-1f61-4637-9025-c90e9ec987e1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:15.963896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dbdb7566-1f61-4637-9025-c90e9ec987e1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:15.964393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dbdb7566-1f61-4637-9025-c90e9ec987e1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:15.965151 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dbdb7566-1f61-4637-9025-c90e9ec987e1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:15.965591 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dbdb7566-1f61-4637-9025-c90e9ec987e1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:16.099064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-dbdb7566-1f61-4637-9025-c90e9ec987e1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:16.106721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-dbdb7566-1f61-4637-9025-c90e9ec987e1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.153783 Apr 07 13:29:16.107276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1336/2555] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:15 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:17.124517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-94888094-8bb2-4d25-8fe7-b35f5bf11ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:17.125131 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-94888094-8bb2-4d25-8fe7-b35f5bf11ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:17.131975 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94888094-8bb2-4d25-8fe7-b35f5bf11ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:17.132467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94888094-8bb2-4d25-8fe7-b35f5bf11ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:17.133223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94888094-8bb2-4d25-8fe7-b35f5bf11ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:17.133659 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-94888094-8bb2-4d25-8fe7-b35f5bf11ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:17.267989 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-94888094-8bb2-4d25-8fe7-b35f5bf11ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:17.276308 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-94888094-8bb2-4d25-8fe7-b35f5bf11ed3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.155696 Apr 07 13:29:17.276868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1220/2556] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:17 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:18.293612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-80a97729-5249-47ec-8602-89b008a4b08c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:18.294159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-80a97729-5249-47ec-8602-89b008a4b08c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:18.300472 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80a97729-5249-47ec-8602-89b008a4b08c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:18.300994 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80a97729-5249-47ec-8602-89b008a4b08c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:18.301752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80a97729-5249-47ec-8602-89b008a4b08c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:18.302190 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-80a97729-5249-47ec-8602-89b008a4b08c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:18.434917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-80a97729-5249-47ec-8602-89b008a4b08c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:18.442616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-80a97729-5249-47ec-8602-89b008a4b08c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.152941 Apr 07 13:29:18.443171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1337/2557] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:18 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:19.459317 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0dd4aca4-2b66-4b4f-8055-c8a0425a1f12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:19.459861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0dd4aca4-2b66-4b4f-8055-c8a0425a1f12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:19.466133 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0dd4aca4-2b66-4b4f-8055-c8a0425a1f12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:19.466579 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0dd4aca4-2b66-4b4f-8055-c8a0425a1f12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:19.467454 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0dd4aca4-2b66-4b4f-8055-c8a0425a1f12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:19.467891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0dd4aca4-2b66-4b4f-8055-c8a0425a1f12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:19.616103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-0dd4aca4-2b66-4b4f-8055-c8a0425a1f12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:19.623912 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0dd4aca4-2b66-4b4f-8055-c8a0425a1f12 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.168820 Apr 07 13:29:19.624513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1221/2558] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:19 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:20.640958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9fe92927-18b8-4e3d-8add-52be9bb6fdf3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:20.641606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9fe92927-18b8-4e3d-8add-52be9bb6fdf3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:20.648312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9fe92927-18b8-4e3d-8add-52be9bb6fdf3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:20.648803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9fe92927-18b8-4e3d-8add-52be9bb6fdf3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:20.649569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9fe92927-18b8-4e3d-8add-52be9bb6fdf3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:20.650007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9fe92927-18b8-4e3d-8add-52be9bb6fdf3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:20.844244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9fe92927-18b8-4e3d-8add-52be9bb6fdf3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:20.852354 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9fe92927-18b8-4e3d-8add-52be9bb6fdf3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.215114 Apr 07 13:29:20.856274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1338/2559] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:20 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:21.869187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9a3c6297-29db-4029-b1d1-0fb2b471c262 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:21.869807 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9a3c6297-29db-4029-b1d1-0fb2b471c262 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:21.876201 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a3c6297-29db-4029-b1d1-0fb2b471c262 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:21.876663 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a3c6297-29db-4029-b1d1-0fb2b471c262 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:21.877432 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a3c6297-29db-4029-b1d1-0fb2b471c262 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:21.877873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9a3c6297-29db-4029-b1d1-0fb2b471c262 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:22.018886 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9a3c6297-29db-4029-b1d1-0fb2b471c262 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:22.027518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9a3c6297-29db-4029-b1d1-0fb2b471c262 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.162209 Apr 07 13:29:22.028088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1222/2560] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:21 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:23.044108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-444298c4-4ebb-4893-928e-74bc0e161f37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:23.044745 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-444298c4-4ebb-4893-928e-74bc0e161f37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:23.050834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-444298c4-4ebb-4893-928e-74bc0e161f37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:23.051332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-444298c4-4ebb-4893-928e-74bc0e161f37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:23.052077 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-444298c4-4ebb-4893-928e-74bc0e161f37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:23.052536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-444298c4-4ebb-4893-928e-74bc0e161f37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:23.188348 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-444298c4-4ebb-4893-928e-74bc0e161f37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:23.197055 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-444298c4-4ebb-4893-928e-74bc0e161f37 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156659 Apr 07 13:29:23.197621 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1339/2561] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:23 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:24.214635 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ef09d447-08c4-42e9-bf45-48a087a161b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:24.215232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ef09d447-08c4-42e9-bf45-48a087a161b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:24.223865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef09d447-08c4-42e9-bf45-48a087a161b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:24.224343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef09d447-08c4-42e9-bf45-48a087a161b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:24.225121 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef09d447-08c4-42e9-bf45-48a087a161b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:24.225560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ef09d447-08c4-42e9-bf45-48a087a161b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:24.364491 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ef09d447-08c4-42e9-bf45-48a087a161b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:24.372821 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ef09d447-08c4-42e9-bf45-48a087a161b1 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.162089 Apr 07 13:29:24.374350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1223/2562] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:24 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:25.392640 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-950f4bf7-4e7d-453e-8c44-2dde6f6c976f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:25.393258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-950f4bf7-4e7d-453e-8c44-2dde6f6c976f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:25.400194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-950f4bf7-4e7d-453e-8c44-2dde6f6c976f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:25.400651 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-950f4bf7-4e7d-453e-8c44-2dde6f6c976f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:25.401416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-950f4bf7-4e7d-453e-8c44-2dde6f6c976f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:25.401850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-950f4bf7-4e7d-453e-8c44-2dde6f6c976f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:25.531242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-950f4bf7-4e7d-453e-8c44-2dde6f6c976f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:25.539781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-950f4bf7-4e7d-453e-8c44-2dde6f6c976f tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.151051 Apr 07 13:29:25.540377 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1340/2563] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:25 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:26.556395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e468a140-907d-477a-9162-5204f58f33d0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:26.556995 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e468a140-907d-477a-9162-5204f58f33d0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:26.563311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e468a140-907d-477a-9162-5204f58f33d0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:26.563763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e468a140-907d-477a-9162-5204f58f33d0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:26.564555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e468a140-907d-477a-9162-5204f58f33d0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:26.564997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e468a140-907d-477a-9162-5204f58f33d0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:26.701674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e468a140-907d-477a-9162-5204f58f33d0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:26.709618 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e468a140-907d-477a-9162-5204f58f33d0 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.157089 Apr 07 13:29:26.710186 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1224/2564] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:26 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:27.727273 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-7fad1f70-b791-45ab-9fbd-b4500b5b4e9c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:27.727909 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-7fad1f70-b791-45ab-9fbd-b4500b5b4e9c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:27.734156 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fad1f70-b791-45ab-9fbd-b4500b5b4e9c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:27.734602 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fad1f70-b791-45ab-9fbd-b4500b5b4e9c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:27.735350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fad1f70-b791-45ab-9fbd-b4500b5b4e9c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:27.735780 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-7fad1f70-b791-45ab-9fbd-b4500b5b4e9c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:27.871139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-7fad1f70-b791-45ab-9fbd-b4500b5b4e9c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:27.879231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-7fad1f70-b791-45ab-9fbd-b4500b5b4e9c tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.156516 Apr 07 13:29:27.879957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1341/2565] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:27 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:28.897486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b49ddb01-d0b8-4cc1-a77e-4761b132473b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:28.898125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b49ddb01-d0b8-4cc1-a77e-4761b132473b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 1c2c5542-86c5-4fe4-9287-ed9dc322b189] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:29:28.904362 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b49ddb01-d0b8-4cc1-a77e-4761b132473b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:28.904812 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b49ddb01-d0b8-4cc1-a77e-4761b132473b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:28.905563 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b49ddb01-d0b8-4cc1-a77e-4761b132473b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:28.905997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b49ddb01-d0b8-4cc1-a77e-4761b132473b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:29.035073 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b49ddb01-d0b8-4cc1-a77e-4761b132473b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:29:29.043431 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b49ddb01-d0b8-4cc1-a77e-4761b132473b tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189" status: 200 len: 1736 microversion: 2.1 time: 0.150918 Apr 07 13:29:29.043993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1225/2566] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:29:28 2022] GET /compute/v2.1/servers/1c2c5542-86c5-4fe4-9287-ed9dc322b189 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:29:29.059141 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f07e60d7-268c-4b6f-b525-2df5b48e505d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '.version_select at 0x7fde584ffd30>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:29:29.062731 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f07e60d7-268c-4b6f-b525-2df5b48e505d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [f7793111-5e24-4c61-81a5-3ac1da0c3d2c] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 07 13:29:30.071719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [None req-f07e60d7-268c-4b6f-b525-2df5b48e505d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [f7793111-5e24-4c61-81a5-3ac1da0c3d2c] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 50308. Apr 07 13:29:30.089665 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f07e60d7-268c-4b6f-b525-2df5b48e505d tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819205429" status: 202 len: 0 microversion: 2.1 time: 1.034335 Apr 07 13:29:30.090275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1342/2567] 10.222.0.15 () {58 vars in 1220 bytes} [Thu Apr 7 13:29:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819205429 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:29:31.038673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-d947e474-0c2b-457c-bf68-013d6a1181e5 req-458e9985-946b-4068-b392-56d9a3884fec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2c5542-86c5-4fe4-9287-ed9dc322b189", "tag": "01b94e44-6b83-4805-bf7a-8c07a6310174"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:29:31.046346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-d947e474-0c2b-457c-bf68-013d6a1181e5 req-458e9985-946b-4068-b392-56d9a3884fec service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:29:31.046788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-d947e474-0c2b-457c-bf68-013d6a1181e5 req-458e9985-946b-4068-b392-56d9a3884fec service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:29:31.058226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-d947e474-0c2b-457c-bf68-013d6a1181e5 req-458e9985-946b-4068-b392-56d9a3884fec service nova] Creating event network-changed:01b94e44-6b83-4805-bf7a-8c07a6310174 for instance 1c2c5542-86c5-4fe4-9287-ed9dc322b189 on hv-cinder-83694 Apr 07 13:29:31.065724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-d947e474-0c2b-457c-bf68-013d6a1181e5 req-458e9985-946b-4068-b392-56d9a3884fec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091578 Apr 07 13:29:31.066421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1226/2568] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:29:36.523737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:29:36.524251 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:29:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:30:40.699511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1606906273", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "networks": [{"uuid": "5c5ed470-5570-4944-b545-0cac9fe8b6ec"}]}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:30:40.753891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.network.neutron [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] validate_networks() for [('5c5ed470-5570-4944-b545-0cac9fe8b6ec', None, None, None, None, None)] {{(pid=116893) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 13:30:41.170170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Flavor limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 13:30:41.170596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Image limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 13:30:41.171076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Flavor pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 13:30:41.171491 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Image pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 13:30:41.171908 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 13:30:41.181035 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:41.181487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:41.182288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:41.182728 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:41.200673 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Getting quotas for project 68b9990f9e7d4c6aa7f472952d89f94d. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:30:41.204582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Getting quotas for user 1ce952f5fbb249a08c3c103b542c94f6 and project 68b9990f9e7d4c6aa7f472952d89f94d. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:30:41.218200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Going to run 1 instances... {{(pid=116893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 13:30:41.219185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9d2b49a6-26a3-491c-8a48-6e6af459d512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:30:41.219962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9d2b49a6-26a3-491c-8a48-6e6af459d512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:41.223015 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 13:30:41.226415 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d2b49a6-26a3-491c-8a48-6e6af459d512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:41.226820 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d2b49a6-26a3-491c-8a48-6e6af459d512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:41.227614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d2b49a6-26a3-491c-8a48-6e6af459d512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:41.228075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9d2b49a6-26a3-491c-8a48-6e6af459d512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:41.252113 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-9d2b49a6-26a3-491c-8a48-6e6af459d512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lazy-loading 'flavor' on Instance uuid ac028ff8-ee5a-47e9-80b2-6633beac4e3f {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:30:41.278999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6f79b0a0-f79c-4946-93ea-38fda9b80f68 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585801 Apr 07 13:30:41.280032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1343/2569] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 13:30:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 13:30:41.289445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a1f222df-d0d1-441e-89ee-7e05fa563c7b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:41.290165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a1f222df-d0d1-441e-89ee-7e05fa563c7b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:41.350627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a1f222df-d0d1-441e-89ee-7e05fa563c7b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:41.357788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a1f222df-d0d1-441e-89ee-7e05fa563c7b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1219 microversion: 2.1 time: 0.071945 Apr 07 13:30:41.358347 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1344/2570] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:41 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:30:41.563142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9d2b49a6-26a3-491c-8a48-6e6af459d512 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "POST /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/action" status: 202 len: 0 microversion: 2.20 time: 0.350825 Apr 07 13:30:41.564273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1227/2571] 10.222.0.15 () {62 vars in 1318 bytes} [Thu Apr 7 13:30:41 2022] POST /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:30:41.573265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c65dd010-9219-43d6-b814-d1754b754689 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:41.573905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c65dd010-9219-43d6-b814-d1754b754689 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:41.581490 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c65dd010-9219-43d6-b814-d1754b754689 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:41.581959 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c65dd010-9219-43d6-b814-d1754b754689 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:41.582740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c65dd010-9219-43d6-b814-d1754b754689 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:41.583576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c65dd010-9219-43d6-b814-d1754b754689 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:41.651752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ed75a0e5-b47f-44b4-b7c7-7cc80963d7e4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "994242a7-2b62-4bc4-888d-21e86c933d37"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:30:41.653121 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ed75a0e5-b47f-44b4-b7c7-7cc80963d7e4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:41.661961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ed75a0e5-b47f-44b4-b7c7-7cc80963d7e4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:41.662674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ed75a0e5-b47f-44b4-b7c7-7cc80963d7e4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:41.663884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ed75a0e5-b47f-44b4-b7c7-7cc80963d7e4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:41.664538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ed75a0e5-b47f-44b4-b7c7-7cc80963d7e4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:41.760018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c65dd010-9219-43d6-b814-d1754b754689 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:41.769007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c65dd010-9219-43d6-b814-d1754b754689 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:41.770596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c65dd010-9219-43d6-b814-d1754b754689 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:41.771887 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c65dd010-9219-43d6-b814-d1754b754689 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1721 microversion: 2.20 time: 0.202763 Apr 07 13:30:41.772652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1345/2572] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:41 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:30:42.272802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ed75a0e5-b47f-44b4-b7c7-7cc80963d7e4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.624392 Apr 07 13:30:42.277976 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1228/2573] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Apr 7 13:30:41 2022] POST /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:30:42.375482 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6860b2ff-36c5-4059-b9c8-860faac401d9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:42.376816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6860b2ff-36c5-4059-b9c8-860faac401d9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:42.390605 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6860b2ff-36c5-4059-b9c8-860faac401d9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:42.391390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6860b2ff-36c5-4059-b9c8-860faac401d9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:42.392207 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6860b2ff-36c5-4059-b9c8-860faac401d9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:42.392660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6860b2ff-36c5-4059-b9c8-860faac401d9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:42.460716 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6860b2ff-36c5-4059-b9c8-860faac401d9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:42.467891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6860b2ff-36c5-4059-b9c8-860faac401d9 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1271 microversion: 2.1 time: 0.096431 Apr 07 13:30:42.468499 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1346/2574] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:42 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:42.736048 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-c44ed037-bcc4-4c02-9a36-32f30a3270c8 req-8a18d8a5-1098-4b92-a108-598cd1425cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2c5542-86c5-4fe4-9287-ed9dc322b189", "name": "network-vif-deleted", "tag": "01b94e44-6b83-4805-bf7a-8c07a6310174"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:30:42.747364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-c44ed037-bcc4-4c02-9a36-32f30a3270c8 req-8a18d8a5-1098-4b92-a108-598cd1425cc2 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:42.748714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-c44ed037-bcc4-4c02-9a36-32f30a3270c8 req-8a18d8a5-1098-4b92-a108-598cd1425cc2 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:42.761974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-c44ed037-bcc4-4c02-9a36-32f30a3270c8 req-8a18d8a5-1098-4b92-a108-598cd1425cc2 service nova] Creating event network-vif-deleted:01b94e44-6b83-4805-bf7a-8c07a6310174 for instance 1c2c5542-86c5-4fe4-9287-ed9dc322b189 on hv-cinder-83694 Apr 07 13:30:42.766640 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-c44ed037-bcc4-4c02-9a36-32f30a3270c8 req-8a18d8a5-1098-4b92-a108-598cd1425cc2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091763 Apr 07 13:30:42.767468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1229/2575] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:30:42.799279 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b798ba03-65c5-486d-bcdf-7ae52dee2095 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:42.802638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b798ba03-65c5-486d-bcdf-7ae52dee2095 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:42.817004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b798ba03-65c5-486d-bcdf-7ae52dee2095 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:42.817842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b798ba03-65c5-486d-bcdf-7ae52dee2095 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:42.819047 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b798ba03-65c5-486d-bcdf-7ae52dee2095 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:42.820777 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b798ba03-65c5-486d-bcdf-7ae52dee2095 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:43.055033 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b798ba03-65c5-486d-bcdf-7ae52dee2095 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:43.063636 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b798ba03-65c5-486d-bcdf-7ae52dee2095 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:43.065833 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b798ba03-65c5-486d-bcdf-7ae52dee2095 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:43.067827 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b798ba03-65c5-486d-bcdf-7ae52dee2095 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1721 microversion: 2.20 time: 0.278085 Apr 07 13:30:43.068432 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1347/2576] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:42 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:30:43.485886 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-373f9aa0-beb0-4f2d-ab8e-d0485abcbaf1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:43.486585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-373f9aa0-beb0-4f2d-ab8e-d0485abcbaf1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:43.492854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-373f9aa0-beb0-4f2d-ab8e-d0485abcbaf1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:43.493363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-373f9aa0-beb0-4f2d-ab8e-d0485abcbaf1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:43.494133 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-373f9aa0-beb0-4f2d-ab8e-d0485abcbaf1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:43.494567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-373f9aa0-beb0-4f2d-ab8e-d0485abcbaf1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:43.586348 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-373f9aa0-beb0-4f2d-ab8e-d0485abcbaf1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:43.600943 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-373f9aa0-beb0-4f2d-ab8e-d0485abcbaf1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1277 microversion: 2.1 time: 0.119197 Apr 07 13:30:43.602008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1230/2577] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:43 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:30:44.086362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-971c15e0-a221-4e56-8f10-bfe9655a0ae2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:44.086901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-971c15e0-a221-4e56-8f10-bfe9655a0ae2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:44.093518 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-971c15e0-a221-4e56-8f10-bfe9655a0ae2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:44.093976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-971c15e0-a221-4e56-8f10-bfe9655a0ae2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:44.094749 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-971c15e0-a221-4e56-8f10-bfe9655a0ae2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:44.095186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-971c15e0-a221-4e56-8f10-bfe9655a0ae2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:44.237949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-971c15e0-a221-4e56-8f10-bfe9655a0ae2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:44.245877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-971c15e0-a221-4e56-8f10-bfe9655a0ae2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:44.247430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-971c15e0-a221-4e56-8f10-bfe9655a0ae2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:44.248630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-971c15e0-a221-4e56-8f10-bfe9655a0ae2 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1721 microversion: 2.20 time: 0.166224 Apr 07 13:30:44.249186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1348/2578] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:44 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:30:44.488390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-79108554-af9b-4619-9b91-ee3c73bd74fc req-16abef7e-c91b-428e-9744-095167b42fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64be8d37-e3f7-4529-874e-a153d5bd8891", "tag": "77f2ffb5-e169-4ed1-b5d8-e50cd97060c2"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:30:44.500421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-79108554-af9b-4619-9b91-ee3c73bd74fc req-16abef7e-c91b-428e-9744-095167b42fb0 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:44.501080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-79108554-af9b-4619-9b91-ee3c73bd74fc req-16abef7e-c91b-428e-9744-095167b42fb0 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:44.517531 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-79108554-af9b-4619-9b91-ee3c73bd74fc req-16abef7e-c91b-428e-9744-095167b42fb0 service nova] Creating event network-changed:77f2ffb5-e169-4ed1-b5d8-e50cd97060c2 for instance 64be8d37-e3f7-4529-874e-a153d5bd8891 on hv-cinder-83694 Apr 07 13:30:44.522326 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-79108554-af9b-4619-9b91-ee3c73bd74fc req-16abef7e-c91b-428e-9744-095167b42fb0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039740 Apr 07 13:30:44.522914 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1231/2579] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:30:44.618753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a51b796a-98cd-4001-a1ac-443eb80eea50 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:44.619361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a51b796a-98cd-4001-a1ac-443eb80eea50 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:44.625165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a51b796a-98cd-4001-a1ac-443eb80eea50 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:44.625610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a51b796a-98cd-4001-a1ac-443eb80eea50 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:44.626360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a51b796a-98cd-4001-a1ac-443eb80eea50 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:44.626789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a51b796a-98cd-4001-a1ac-443eb80eea50 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:44.764030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a51b796a-98cd-4001-a1ac-443eb80eea50 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:44.772058 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a51b796a-98cd-4001-a1ac-443eb80eea50 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1319 microversion: 2.1 time: 0.157088 Apr 07 13:30:44.772668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1349/2580] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:44 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:44.789525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-09ecddff-0f65-4b5e-8cee-ecc605a89397 req-487b1536-5f5b-4759-9b37-9c4c66ef9197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fbdca4-9e5a-484d-a17d-bfe7f41b4860", "name": "network-vif-deleted", "tag": "20e5487f-b0e6-40bc-a8f6-4f47e6af7f78"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:30:44.797527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-09ecddff-0f65-4b5e-8cee-ecc605a89397 req-487b1536-5f5b-4759-9b37-9c4c66ef9197 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:44.797973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-09ecddff-0f65-4b5e-8cee-ecc605a89397 req-487b1536-5f5b-4759-9b37-9c4c66ef9197 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:44.808480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-09ecddff-0f65-4b5e-8cee-ecc605a89397 req-487b1536-5f5b-4759-9b37-9c4c66ef9197 service nova] Creating event network-vif-deleted:20e5487f-b0e6-40bc-a8f6-4f47e6af7f78 for instance 59fbdca4-9e5a-484d-a17d-bfe7f41b4860 on hv-cinder-83694 Apr 07 13:30:44.813243 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-09ecddff-0f65-4b5e-8cee-ecc605a89397 req-487b1536-5f5b-4759-9b37-9c4c66ef9197 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028097 Apr 07 13:30:44.813835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1232/2581] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:30:45.267091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-634a32a8-b67f-4923-bbd7-ed2a603262eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:45.267727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-634a32a8-b67f-4923-bbd7-ed2a603262eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:45.273991 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-634a32a8-b67f-4923-bbd7-ed2a603262eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:45.274433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-634a32a8-b67f-4923-bbd7-ed2a603262eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:45.275184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-634a32a8-b67f-4923-bbd7-ed2a603262eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:45.275622 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-634a32a8-b67f-4923-bbd7-ed2a603262eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:45.406520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-634a32a8-b67f-4923-bbd7-ed2a603262eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:45.415085 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-634a32a8-b67f-4923-bbd7-ed2a603262eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:45.416595 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-634a32a8-b67f-4923-bbd7-ed2a603262eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:45.417732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-634a32a8-b67f-4923-bbd7-ed2a603262eb tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1721 microversion: 2.20 time: 0.154513 Apr 07 13:30:45.418278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1350/2582] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:45 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:30:45.790487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2a478dac-7e36-4c30-9525-54aa269eabc3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:45.791240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2a478dac-7e36-4c30-9525-54aa269eabc3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:45.797273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a478dac-7e36-4c30-9525-54aa269eabc3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:45.797729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a478dac-7e36-4c30-9525-54aa269eabc3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:45.798499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a478dac-7e36-4c30-9525-54aa269eabc3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:45.798942 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a478dac-7e36-4c30-9525-54aa269eabc3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:46.017120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2a478dac-7e36-4c30-9525-54aa269eabc3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:46.025477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2a478dac-7e36-4c30-9525-54aa269eabc3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1319 microversion: 2.1 time: 0.239597 Apr 07 13:30:46.034955 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1233/2583] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:45 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:46.436431 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d6a1ceb7-8283-4402-992b-8038ce6902e9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:46.437071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d6a1ceb7-8283-4402-992b-8038ce6902e9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:46.444020 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6a1ceb7-8283-4402-992b-8038ce6902e9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:46.444498 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6a1ceb7-8283-4402-992b-8038ce6902e9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:46.445258 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6a1ceb7-8283-4402-992b-8038ce6902e9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:46.445692 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d6a1ceb7-8283-4402-992b-8038ce6902e9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:46.584698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d6a1ceb7-8283-4402-992b-8038ce6902e9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:46.592468 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d6a1ceb7-8283-4402-992b-8038ce6902e9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:46.593971 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d6a1ceb7-8283-4402-992b-8038ce6902e9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:46.595135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d6a1ceb7-8283-4402-992b-8038ce6902e9 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1721 microversion: 2.20 time: 0.162713 Apr 07 13:30:46.595683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1351/2584] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:46 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:30:47.042652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f19d46ae-dbd9-424b-ad5a-ba527a0753e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:47.043169 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f19d46ae-dbd9-424b-ad5a-ba527a0753e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:47.050765 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f19d46ae-dbd9-424b-ad5a-ba527a0753e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:47.051259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f19d46ae-dbd9-424b-ad5a-ba527a0753e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:47.052057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f19d46ae-dbd9-424b-ad5a-ba527a0753e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:47.052525 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f19d46ae-dbd9-424b-ad5a-ba527a0753e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:47.181870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f19d46ae-dbd9-424b-ad5a-ba527a0753e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:47.189406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f19d46ae-dbd9-424b-ad5a-ba527a0753e0 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1319 microversion: 2.1 time: 0.150630 Apr 07 13:30:47.190574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1234/2585] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:47 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:47.619401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-216e96de-8cf9-4278-93f1-fe5253e19556 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:47.619401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-216e96de-8cf9-4278-93f1-fe5253e19556 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:47.620896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-216e96de-8cf9-4278-93f1-fe5253e19556 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:47.621341 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-216e96de-8cf9-4278-93f1-fe5253e19556 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:47.622097 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-216e96de-8cf9-4278-93f1-fe5253e19556 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:47.622535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-216e96de-8cf9-4278-93f1-fe5253e19556 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:47.755660 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-216e96de-8cf9-4278-93f1-fe5253e19556 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:47.763576 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-216e96de-8cf9-4278-93f1-fe5253e19556 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:47.765095 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-216e96de-8cf9-4278-93f1-fe5253e19556 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:47.766250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-216e96de-8cf9-4278-93f1-fe5253e19556 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1721 microversion: 2.20 time: 0.156881 Apr 07 13:30:47.766803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1352/2586] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:47 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:30:48.206974 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-32232d99-8f53-46ae-aa42-6b4758206dac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:48.207622 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-32232d99-8f53-46ae-aa42-6b4758206dac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:48.213973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32232d99-8f53-46ae-aa42-6b4758206dac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:48.214429 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32232d99-8f53-46ae-aa42-6b4758206dac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:48.215192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32232d99-8f53-46ae-aa42-6b4758206dac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:48.215630 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-32232d99-8f53-46ae-aa42-6b4758206dac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:48.350707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-32232d99-8f53-46ae-aa42-6b4758206dac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:48.357954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-32232d99-8f53-46ae-aa42-6b4758206dac tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1319 microversion: 2.1 time: 0.154919 Apr 07 13:30:48.358510 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1235/2587] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:48 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:48.785806 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d0d46d92-f723-438c-a010-c2f13a6423da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:48.786460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d0d46d92-f723-438c-a010-c2f13a6423da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:48.792800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0d46d92-f723-438c-a010-c2f13a6423da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:48.793255 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0d46d92-f723-438c-a010-c2f13a6423da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:48.794018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0d46d92-f723-438c-a010-c2f13a6423da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:48.794457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d0d46d92-f723-438c-a010-c2f13a6423da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:48.929185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d0d46d92-f723-438c-a010-c2f13a6423da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:48.937535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d0d46d92-f723-438c-a010-c2f13a6423da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:48.939066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d0d46d92-f723-438c-a010-c2f13a6423da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:48.940705 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d0d46d92-f723-438c-a010-c2f13a6423da tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1721 microversion: 2.20 time: 0.159309 Apr 07 13:30:48.941254 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1353/2588] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:48 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:30:49.374752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d1c925d7-873f-4aee-9792-c86681d24b19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:49.375369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d1c925d7-873f-4aee-9792-c86681d24b19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:49.383065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d1c925d7-873f-4aee-9792-c86681d24b19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:49.383512 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d1c925d7-873f-4aee-9792-c86681d24b19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:49.384307 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d1c925d7-873f-4aee-9792-c86681d24b19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:49.384742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d1c925d7-873f-4aee-9792-c86681d24b19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:49.522046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d1c925d7-873f-4aee-9792-c86681d24b19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:49.529672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d1c925d7-873f-4aee-9792-c86681d24b19 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1319 microversion: 2.1 time: 0.158756 Apr 07 13:30:49.530237 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1236/2589] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:49 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:49.641801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-1a8afe95-9251-477c-9fa8-3ad3c91480eb req-d2b3880e-c46c-4624-959a-69443ac0b778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64be8d37-e3f7-4529-874e-a153d5bd8891", "name": "network-vif-plugged", "status": "completed", "tag": "77f2ffb5-e169-4ed1-b5d8-e50cd97060c2"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:30:49.651149 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-1a8afe95-9251-477c-9fa8-3ad3c91480eb req-d2b3880e-c46c-4624-959a-69443ac0b778 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:49.651650 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-1a8afe95-9251-477c-9fa8-3ad3c91480eb req-d2b3880e-c46c-4624-959a-69443ac0b778 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:49.663936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-1a8afe95-9251-477c-9fa8-3ad3c91480eb req-d2b3880e-c46c-4624-959a-69443ac0b778 service nova] Creating event network-vif-plugged:77f2ffb5-e169-4ed1-b5d8-e50cd97060c2 for instance 64be8d37-e3f7-4529-874e-a153d5bd8891 on hv-cinder-83694 Apr 07 13:30:49.670174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-1a8afe95-9251-477c-9fa8-3ad3c91480eb req-d2b3880e-c46c-4624-959a-69443ac0b778 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088973 Apr 07 13:30:49.671171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1354/2590] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:30:49.786709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c5a3dd61-c716-4737-86e3-54a6ccf6b50e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: .version_select at 0x7fde585a53a0>, body: {"keypair": {"name": "tempest-keypair-1790346795"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:30:49.800808 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-c5a3dd61-c716-4737-86e3-54a6ccf6b50e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:30:49.804701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-c5a3dd61-c716-4737-86e3-54a6ccf6b50e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for user 16a8cd81c8064dc087a8f735cb0b78eb and project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:30:49.816858 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c5a3dd61-c716-4737-86e3-54a6ccf6b50e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [6a6d2dd9-b36f-4437-af10-bb313cc83bbc] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 07 13:30:49.959784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-906071f4-13c8-40fa-89d5-894c1adceb6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:49.960544 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-906071f4-13c8-40fa-89d5-894c1adceb6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:49.966535 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-906071f4-13c8-40fa-89d5-894c1adceb6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:49.967052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-906071f4-13c8-40fa-89d5-894c1adceb6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:49.967744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-906071f4-13c8-40fa-89d5-894c1adceb6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:49.968203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-906071f4-13c8-40fa-89d5-894c1adceb6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:50.101737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-906071f4-13c8-40fa-89d5-894c1adceb6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:50.109401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-906071f4-13c8-40fa-89d5-894c1adceb6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:50.110886 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-906071f4-13c8-40fa-89d5-894c1adceb6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:50.112031 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-906071f4-13c8-40fa-89d5-894c1adceb6f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1721 microversion: 2.20 time: 0.157055 Apr 07 13:30:50.113400 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1355/2591] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:49 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:30:50.547307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d788acfd-b720-47c5-b0a8-f7d2c0c0a520 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:50.547930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d788acfd-b720-47c5-b0a8-f7d2c0c0a520 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:50.553885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d788acfd-b720-47c5-b0a8-f7d2c0c0a520 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:50.554342 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d788acfd-b720-47c5-b0a8-f7d2c0c0a520 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:50.555136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d788acfd-b720-47c5-b0a8-f7d2c0c0a520 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:50.555573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d788acfd-b720-47c5-b0a8-f7d2c0c0a520 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:50.686816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d788acfd-b720-47c5-b0a8-f7d2c0c0a520 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:50.694681 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d788acfd-b720-47c5-b0a8-f7d2c0c0a520 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1319 microversion: 2.1 time: 0.151363 Apr 07 13:30:50.695238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1356/2592] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:50 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:30:50.825140 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [None req-c5a3dd61-c716-4737-86e3-54a6ccf6b50e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [6a6d2dd9-b36f-4437-af10-bb313cc83bbc] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 51030. Apr 07 13:30:50.954395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-c5a3dd61-c716-4737-86e3-54a6ccf6b50e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:30:50.958763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-c5a3dd61-c716-4737-86e3-54a6ccf6b50e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for user 16a8cd81c8064dc087a8f735cb0b78eb and project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:30:50.972617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c5a3dd61-c716-4737-86e3-54a6ccf6b50e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.190290 Apr 07 13:30:50.973227 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1237/2593] 10.222.0.15 () {60 vars in 1157 bytes} [Thu Apr 7 13:30:49 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:51.133630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c8710763-e2f3-41df-9640-07800863a2c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:51.134360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c8710763-e2f3-41df-9640-07800863a2c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:51.143394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8710763-e2f3-41df-9640-07800863a2c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:51.143912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8710763-e2f3-41df-9640-07800863a2c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:51.144945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8710763-e2f3-41df-9640-07800863a2c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:51.145433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c8710763-e2f3-41df-9640-07800863a2c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:51.355726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c8710763-e2f3-41df-9640-07800863a2c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:51.365133 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c8710763-e2f3-41df-9640-07800863a2c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:51.366898 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c8710763-e2f3-41df-9640-07800863a2c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:51.368068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c8710763-e2f3-41df-9640-07800863a2c5 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1721 microversion: 2.20 time: 0.238301 Apr 07 13:30:51.368653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1357/2594] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:51 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:30:51.711248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3e21951c-5da5-4131-8e8f-f80660bff0fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:51.711863 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3e21951c-5da5-4131-8e8f-f80660bff0fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:51.718917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3e21951c-5da5-4131-8e8f-f80660bff0fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:51.719371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3e21951c-5da5-4131-8e8f-f80660bff0fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:51.720128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3e21951c-5da5-4131-8e8f-f80660bff0fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:51.720583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3e21951c-5da5-4131-8e8f-f80660bff0fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:51.856219 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3e21951c-5da5-4131-8e8f-f80660bff0fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:51.864049 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3e21951c-5da5-4131-8e8f-f80660bff0fc tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1508 microversion: 2.1 time: 0.156656 Apr 07 13:30:51.864664 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1238/2595] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:51 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:51.880819 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b164d7e7-6989-4a8d-a4b8-2832670ad300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f638f3fc-e141-4df4-92e0-062068aceaeb", "device": "/dev/sdb"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:30:51.881957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b164d7e7-6989-4a8d-a4b8-2832670ad300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:51.889847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b164d7e7-6989-4a8d-a4b8-2832670ad300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:51.890299 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b164d7e7-6989-4a8d-a4b8-2832670ad300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:51.891105 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b164d7e7-6989-4a8d-a4b8-2832670ad300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:51.891542 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b164d7e7-6989-4a8d-a4b8-2832670ad300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:52.179200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b164d7e7-6989-4a8d-a4b8-2832670ad300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "POST /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302236 Apr 07 13:30:52.180453 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1358/2596] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Apr 7 13:30:51 2022] POST /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:30:52.386850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a679d78f-9654-4f94-94df-1b1fe7e214b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:52.387466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a679d78f-9654-4f94-94df-1b1fe7e214b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:52.393599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a679d78f-9654-4f94-94df-1b1fe7e214b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:52.394057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a679d78f-9654-4f94-94df-1b1fe7e214b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:52.394825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a679d78f-9654-4f94-94df-1b1fe7e214b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:52.395453 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a679d78f-9654-4f94-94df-1b1fe7e214b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:52.547558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a679d78f-9654-4f94-94df-1b1fe7e214b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:52.556329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a679d78f-9654-4f94-94df-1b1fe7e214b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:52.557902 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a679d78f-9654-4f94-94df-1b1fe7e214b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:52.559162 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a679d78f-9654-4f94-94df-1b1fe7e214b6 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1742 microversion: 2.20 time: 0.176281 Apr 07 13:30:52.560183 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1239/2597] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:52 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:30:52.572906 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1298619411", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e3eed74-adac-4076-a10b-beef7f6c6aa3"}], "security_groups": [{"name": "tempest-securitygroup--1839562877"}], "key_name": "tempest-keypair-1790346795", "user_data": "}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:30:52.676331 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.network.neutron [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] validate_networks() for [('3e3eed74-adac-4076-a10b-beef7f6c6aa3', None, None, None, None, None)] {{(pid=116893) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 13:30:53.050645 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Flavor limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 13:30:53.051075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Image limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 13:30:53.051552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Flavor pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 13:30:53.051967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Image pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 13:30:53.052428 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 13:30:53.061756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:53.062600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:53.063437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:53.063868 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:53.080191 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:30:53.084004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for user 16a8cd81c8064dc087a8f735cb0b78eb and project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:30:53.094717 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Going to run 1 instances... {{(pid=116893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 13:30:53.097592 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 13:30:53.141323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-00b53384-993b-4639-8033-18f8da639ea4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.573049 Apr 07 13:30:53.141956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1359/2598] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 13:30:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 13:30:53.152277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2ccdd870-e091-4f65-9778-cb01e4bfdaff tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:53.152890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2ccdd870-e091-4f65-9778-cb01e4bfdaff tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:53.208575 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2ccdd870-e091-4f65-9778-cb01e4bfdaff tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:53.215185 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2ccdd870-e091-4f65-9778-cb01e4bfdaff tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1242 microversion: 2.1 time: 0.066654 Apr 07 13:30:53.215754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1240/2599] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:53 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:53.581996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-892602e9-9aba-42e1-9223-42467240962d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:53.581996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-892602e9-9aba-42e1-9223-42467240962d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:53.592632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-892602e9-9aba-42e1-9223-42467240962d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:53.593081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-892602e9-9aba-42e1-9223-42467240962d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:53.595364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-892602e9-9aba-42e1-9223-42467240962d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:53.596784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-892602e9-9aba-42e1-9223-42467240962d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:53.747962 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-892602e9-9aba-42e1-9223-42467240962d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:53.756969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-892602e9-9aba-42e1-9223-42467240962d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:53.758451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-892602e9-9aba-42e1-9223-42467240962d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:53.759587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-892602e9-9aba-42e1-9223-42467240962d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1742 microversion: 2.20 time: 0.184124 Apr 07 13:30:53.760277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1360/2600] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:53 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1742 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:30:54.233300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2c023dbb-8e17-4a08-b665-924a92732d8a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:54.233921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2c023dbb-8e17-4a08-b665-924a92732d8a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:54.289641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2c023dbb-8e17-4a08-b665-924a92732d8a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:54.296866 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2c023dbb-8e17-4a08-b665-924a92732d8a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1242 microversion: 2.1 time: 0.067451 Apr 07 13:30:54.297444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1241/2601] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:54 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:54.778879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-405f2282-72e5-4c56-b1f8-911b90b2993f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:54.779548 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-405f2282-72e5-4c56-b1f8-911b90b2993f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:54.789047 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-405f2282-72e5-4c56-b1f8-911b90b2993f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:54.789808 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-405f2282-72e5-4c56-b1f8-911b90b2993f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:54.790599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-405f2282-72e5-4c56-b1f8-911b90b2993f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:54.791044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-405f2282-72e5-4c56-b1f8-911b90b2993f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:54.947222 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-405f2282-72e5-4c56-b1f8-911b90b2993f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:54.959694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-405f2282-72e5-4c56-b1f8-911b90b2993f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:54.963314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-405f2282-72e5-4c56-b1f8-911b90b2993f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:54.966718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-405f2282-72e5-4c56-b1f8-911b90b2993f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1737 microversion: 2.20 time: 0.189889 Apr 07 13:30:54.966718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1361/2602] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:54 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:30:55.314720 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9cfa35bf-1298-49ed-b054-15e709cb8a60 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:55.316566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9cfa35bf-1298-49ed-b054-15e709cb8a60 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:55.412675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9cfa35bf-1298-49ed-b054-15e709cb8a60 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:55.422027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9cfa35bf-1298-49ed-b054-15e709cb8a60 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1242 microversion: 2.1 time: 0.111363 Apr 07 13:30:55.433037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1242/2603] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:55 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1242 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:55.681359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-6992719b-e5ed-4dff-ac1c-940bb1c454fc req-4aee553e-e29c-4631-a6a3-559fc2cdd6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac028ff8-ee5a-47e9-80b2-6633beac4e3f", "name": "network-vif-plugged", "status": "completed", "tag": "10915de2-db85-43a4-a04e-e11c60542301"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:30:55.729400 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-6992719b-e5ed-4dff-ac1c-940bb1c454fc req-4aee553e-e29c-4631-a6a3-559fc2cdd6ea service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:55.730993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-6992719b-e5ed-4dff-ac1c-940bb1c454fc req-4aee553e-e29c-4631-a6a3-559fc2cdd6ea service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:55.751071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-6992719b-e5ed-4dff-ac1c-940bb1c454fc req-4aee553e-e29c-4631-a6a3-559fc2cdd6ea service nova] Creating event network-vif-plugged:10915de2-db85-43a4-a04e-e11c60542301 for instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f on hv-cinder-83694 Apr 07 13:30:55.760333 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-6992719b-e5ed-4dff-ac1c-940bb1c454fc req-4aee553e-e29c-4631-a6a3-559fc2cdd6ea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087435 Apr 07 13:30:55.764254 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1362/2604] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:30:55.986998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-cab1c552-2d07-4461-b628-1e4bb05458f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:55.988324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-cab1c552-2d07-4461-b628-1e4bb05458f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:56.004038 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cab1c552-2d07-4461-b628-1e4bb05458f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:56.006751 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cab1c552-2d07-4461-b628-1e4bb05458f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:56.012970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cab1c552-2d07-4461-b628-1e4bb05458f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:56.013815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-cab1c552-2d07-4461-b628-1e4bb05458f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:56.199708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cab1c552-2d07-4461-b628-1e4bb05458f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:56.213844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cab1c552-2d07-4461-b628-1e4bb05458f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:56.215717 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-cab1c552-2d07-4461-b628-1e4bb05458f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:56.217213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-cab1c552-2d07-4461-b628-1e4bb05458f8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1737 microversion: 2.20 time: 0.237113 Apr 07 13:30:56.218315 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1243/2605] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:55 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1737 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:30:56.444250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f67e10d0-7f4c-4ac4-91e7-aba4b1be46f7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:56.445585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f67e10d0-7f4c-4ac4-91e7-aba4b1be46f7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:56.514522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f67e10d0-7f4c-4ac4-91e7-aba4b1be46f7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:56.523404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f67e10d0-7f4c-4ac4-91e7-aba4b1be46f7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1242 microversion: 2.1 time: 0.085671 Apr 07 13:30:56.525644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1363/2606] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:56 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:57.236977 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-59a14264-3353-4ee5-b2ca-2f6f303d8121 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:57.239075 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-59a14264-3353-4ee5-b2ca-2f6f303d8121 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:57.246509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59a14264-3353-4ee5-b2ca-2f6f303d8121 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:57.247059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59a14264-3353-4ee5-b2ca-2f6f303d8121 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:57.248117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59a14264-3353-4ee5-b2ca-2f6f303d8121 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:57.248825 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-59a14264-3353-4ee5-b2ca-2f6f303d8121 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:57.448477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-59a14264-3353-4ee5-b2ca-2f6f303d8121 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:57.461380 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-59a14264-3353-4ee5-b2ca-2f6f303d8121 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:57.462764 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-59a14264-3353-4ee5-b2ca-2f6f303d8121 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:57.464192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-59a14264-3353-4ee5-b2ca-2f6f303d8121 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1737 microversion: 2.20 time: 0.230821 Apr 07 13:30:57.464740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1244/2607] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:57 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:30:57.542534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-8a5412f3-7c44-4b97-a53b-cae18e2d4f11 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:57.543818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-8a5412f3-7c44-4b97-a53b-cae18e2d4f11 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:57.555627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a5412f3-7c44-4b97-a53b-cae18e2d4f11 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:57.556400 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a5412f3-7c44-4b97-a53b-cae18e2d4f11 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:57.557334 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a5412f3-7c44-4b97-a53b-cae18e2d4f11 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:57.558101 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-8a5412f3-7c44-4b97-a53b-cae18e2d4f11 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:57.641612 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-8a5412f3-7c44-4b97-a53b-cae18e2d4f11 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:57.657005 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-8a5412f3-7c44-4b97-a53b-cae18e2d4f11 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1246 microversion: 2.1 time: 0.118165 Apr 07 13:30:57.657830 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1364/2608] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:57 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1246 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:30:58.496059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f47bfddd-81ee-40ea-be4a-5500f084f4b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:58.496757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f47bfddd-81ee-40ea-be4a-5500f084f4b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:58.510936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f47bfddd-81ee-40ea-be4a-5500f084f4b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:58.511664 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f47bfddd-81ee-40ea-be4a-5500f084f4b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:58.512772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f47bfddd-81ee-40ea-be4a-5500f084f4b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:58.513418 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f47bfddd-81ee-40ea-be4a-5500f084f4b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:58.680352 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e51c8f60-8f11-4918-8d69-726b046962b2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:58.681741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e51c8f60-8f11-4918-8d69-726b046962b2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:58.704569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e51c8f60-8f11-4918-8d69-726b046962b2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:58.705157 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e51c8f60-8f11-4918-8d69-726b046962b2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:58.707408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e51c8f60-8f11-4918-8d69-726b046962b2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:58.708913 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e51c8f60-8f11-4918-8d69-726b046962b2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:58.807259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f47bfddd-81ee-40ea-be4a-5500f084f4b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:58.817275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f47bfddd-81ee-40ea-be4a-5500f084f4b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:58.819841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f47bfddd-81ee-40ea-be4a-5500f084f4b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:58.821413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f47bfddd-81ee-40ea-be4a-5500f084f4b1 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1737 microversion: 2.20 time: 0.339545 Apr 07 13:30:58.822319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1245/2609] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:58 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1737 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:30:58.839727 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e51c8f60-8f11-4918-8d69-726b046962b2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:30:58.847580 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e51c8f60-8f11-4918-8d69-726b046962b2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1294 microversion: 2.1 time: 0.177252 Apr 07 13:30:58.848189 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1365/2610] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:58 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1294 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:30:59.845870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3804a130-a7fb-4e99-b456-962bae9c7383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:59.848327 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-3804a130-a7fb-4e99-b456-962bae9c7383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:59.858330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3804a130-a7fb-4e99-b456-962bae9c7383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:59.859218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3804a130-a7fb-4e99-b456-962bae9c7383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:59.860310 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3804a130-a7fb-4e99-b456-962bae9c7383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:59.860912 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-3804a130-a7fb-4e99-b456-962bae9c7383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:59.864880 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-83d01d47-764f-4e03-8e7b-0832c3ab339d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:30:59.865509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-83d01d47-764f-4e03-8e7b-0832c3ab339d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:30:59.874537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-83d01d47-764f-4e03-8e7b-0832c3ab339d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:59.875283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-83d01d47-764f-4e03-8e7b-0832c3ab339d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:30:59.876373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-83d01d47-764f-4e03-8e7b-0832c3ab339d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:30:59.876984 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-83d01d47-764f-4e03-8e7b-0832c3ab339d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:00.002280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-83d01d47-764f-4e03-8e7b-0832c3ab339d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:00.010780 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-83d01d47-764f-4e03-8e7b-0832c3ab339d tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1300 microversion: 2.1 time: 0.149897 Apr 07 13:31:00.023395 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1366/2611] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:30:59 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1300 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:00.331758 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3804a130-a7fb-4e99-b456-962bae9c7383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:00.355279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3804a130-a7fb-4e99-b456-962bae9c7383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:00.363118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-3804a130-a7fb-4e99-b456-962bae9c7383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:00.365715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3804a130-a7fb-4e99-b456-962bae9c7383 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1737 microversion: 2.20 time: 0.526422 Apr 07 13:31:00.381988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1246/2612] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:30:59 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1737 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:01.029317 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0c50d112-784d-4140-bbea-10c64f60fbd1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:01.030618 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0c50d112-784d-4140-bbea-10c64f60fbd1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:01.038635 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c50d112-784d-4140-bbea-10c64f60fbd1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:01.039099 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c50d112-784d-4140-bbea-10c64f60fbd1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:01.039897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c50d112-784d-4140-bbea-10c64f60fbd1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:01.040506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c50d112-784d-4140-bbea-10c64f60fbd1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:01.225782 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0c50d112-784d-4140-bbea-10c64f60fbd1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:01.234597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0c50d112-784d-4140-bbea-10c64f60fbd1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1368 microversion: 2.1 time: 0.209198 Apr 07 13:31:01.235272 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1367/2613] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:01 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:01.387527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c9cd388a-db6b-48e6-9927-cc4e5ef2a4fc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:01.388214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c9cd388a-db6b-48e6-9927-cc4e5ef2a4fc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:01.399854 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c9cd388a-db6b-48e6-9927-cc4e5ef2a4fc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:01.400650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c9cd388a-db6b-48e6-9927-cc4e5ef2a4fc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:01.401616 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c9cd388a-db6b-48e6-9927-cc4e5ef2a4fc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:01.402257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c9cd388a-db6b-48e6-9927-cc4e5ef2a4fc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:01.600499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c9cd388a-db6b-48e6-9927-cc4e5ef2a4fc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:01.614710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c9cd388a-db6b-48e6-9927-cc4e5ef2a4fc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:01.616839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c9cd388a-db6b-48e6-9927-cc4e5ef2a4fc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:01.618911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c9cd388a-db6b-48e6-9927-cc4e5ef2a4fc tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1737 microversion: 2.20 time: 0.234620 Apr 07 13:31:01.625416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1247/2614] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:01 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:02.252068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6a75ca51-7950-4a65-8fb4-1a902fa94651 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:02.253775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6a75ca51-7950-4a65-8fb4-1a902fa94651 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:02.263252 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a75ca51-7950-4a65-8fb4-1a902fa94651 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:02.264084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a75ca51-7950-4a65-8fb4-1a902fa94651 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:02.265284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a75ca51-7950-4a65-8fb4-1a902fa94651 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:02.266118 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6a75ca51-7950-4a65-8fb4-1a902fa94651 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:02.461949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6a75ca51-7950-4a65-8fb4-1a902fa94651 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:02.470349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6a75ca51-7950-4a65-8fb4-1a902fa94651 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1368 microversion: 2.1 time: 0.222079 Apr 07 13:31:02.472280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1368/2615] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:02 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:02.647765 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-167be34a-5ba6-4719-99d2-46abe51658a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:02.657270 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-167be34a-5ba6-4719-99d2-46abe51658a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:02.701146 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-167be34a-5ba6-4719-99d2-46abe51658a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:02.702352 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-167be34a-5ba6-4719-99d2-46abe51658a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:02.704891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-167be34a-5ba6-4719-99d2-46abe51658a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:02.706325 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-167be34a-5ba6-4719-99d2-46abe51658a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:03.068971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-167be34a-5ba6-4719-99d2-46abe51658a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:03.084496 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-167be34a-5ba6-4719-99d2-46abe51658a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:03.089033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-167be34a-5ba6-4719-99d2-46abe51658a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:03.091232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-167be34a-5ba6-4719-99d2-46abe51658a3 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1737 microversion: 2.20 time: 0.456999 Apr 07 13:31:03.094126 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1248/2616] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:02 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1737 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:03.359843 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-aad3d703-0284-4771-961f-9f897c3e35da req-5d4422e9-2c02-4098-b491-8b0928b7c0af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69bcaba-e90d-43a6-8f4d-5e3edd32358e", "tag": "8b7f5c35-54de-4636-ba86-2047ee8ec086"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:31:03.389652 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-aad3d703-0284-4771-961f-9f897c3e35da req-5d4422e9-2c02-4098-b491-8b0928b7c0af service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:03.390596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-aad3d703-0284-4771-961f-9f897c3e35da req-5d4422e9-2c02-4098-b491-8b0928b7c0af service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:03.404880 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-aad3d703-0284-4771-961f-9f897c3e35da req-5d4422e9-2c02-4098-b491-8b0928b7c0af service nova] Creating event network-changed:8b7f5c35-54de-4636-ba86-2047ee8ec086 for instance e69bcaba-e90d-43a6-8f4d-5e3edd32358e on hv-cinder-83694 Apr 07 13:31:03.411560 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-aad3d703-0284-4771-961f-9f897c3e35da req-5d4422e9-2c02-4098-b491-8b0928b7c0af service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056525 Apr 07 13:31:03.412835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1369/2617] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:31:03.493408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-056cdddc-ae3f-4388-921a-c9b79a5d784a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:03.498455 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-056cdddc-ae3f-4388-921a-c9b79a5d784a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:03.529088 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-056cdddc-ae3f-4388-921a-c9b79a5d784a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:03.529995 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-056cdddc-ae3f-4388-921a-c9b79a5d784a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:03.530875 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-056cdddc-ae3f-4388-921a-c9b79a5d784a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:03.531326 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-056cdddc-ae3f-4388-921a-c9b79a5d784a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:03.872252 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-056cdddc-ae3f-4388-921a-c9b79a5d784a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:03.890583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-056cdddc-ae3f-4388-921a-c9b79a5d784a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1368 microversion: 2.1 time: 0.401186 Apr 07 13:31:03.894674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1249/2618] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:03 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1368 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:04.110736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a0aafdb0-b5b1-456d-95bd-ffa65ac0463e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:04.111949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a0aafdb0-b5b1-456d-95bd-ffa65ac0463e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:04.122383 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0aafdb0-b5b1-456d-95bd-ffa65ac0463e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:04.127708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0aafdb0-b5b1-456d-95bd-ffa65ac0463e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:04.128724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0aafdb0-b5b1-456d-95bd-ffa65ac0463e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:04.129511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0aafdb0-b5b1-456d-95bd-ffa65ac0463e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:04.320771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a0aafdb0-b5b1-456d-95bd-ffa65ac0463e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:04.337342 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a0aafdb0-b5b1-456d-95bd-ffa65ac0463e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:04.339440 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a0aafdb0-b5b1-456d-95bd-ffa65ac0463e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:04.340947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a0aafdb0-b5b1-456d-95bd-ffa65ac0463e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1737 microversion: 2.20 time: 0.234607 Apr 07 13:31:04.344726 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1370/2619] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:04 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1737 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:04.911271 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-77a60483-7726-4c14-bd8d-1d02e078ed4f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:04.912026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-77a60483-7726-4c14-bd8d-1d02e078ed4f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:04.918911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77a60483-7726-4c14-bd8d-1d02e078ed4f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:04.919467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77a60483-7726-4c14-bd8d-1d02e078ed4f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:04.920387 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77a60483-7726-4c14-bd8d-1d02e078ed4f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:04.921102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77a60483-7726-4c14-bd8d-1d02e078ed4f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:05.078053 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-77a60483-7726-4c14-bd8d-1d02e078ed4f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:05.086847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-77a60483-7726-4c14-bd8d-1d02e078ed4f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1368 microversion: 2.1 time: 0.180495 Apr 07 13:31:05.087898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1250/2620] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:04 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:05.363060 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b41a43cc-2778-4096-9c63-c78d1bc15331 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:05.364574 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b41a43cc-2778-4096-9c63-c78d1bc15331 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:05.371512 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b41a43cc-2778-4096-9c63-c78d1bc15331 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:05.372262 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b41a43cc-2778-4096-9c63-c78d1bc15331 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:05.373266 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b41a43cc-2778-4096-9c63-c78d1bc15331 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:05.373704 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b41a43cc-2778-4096-9c63-c78d1bc15331 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:05.522756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b41a43cc-2778-4096-9c63-c78d1bc15331 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:05.531811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b41a43cc-2778-4096-9c63-c78d1bc15331 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:05.533720 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b41a43cc-2778-4096-9c63-c78d1bc15331 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:05.535348 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b41a43cc-2778-4096-9c63-c78d1bc15331 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1737 microversion: 2.20 time: 0.176308 Apr 07 13:31:05.535963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1371/2621] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:05 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:06.103929 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a608c5f5-0417-42ac-9256-72138be3e9bc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:06.104581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a608c5f5-0417-42ac-9256-72138be3e9bc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:06.111044 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a608c5f5-0417-42ac-9256-72138be3e9bc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:06.111481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a608c5f5-0417-42ac-9256-72138be3e9bc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:06.112839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a608c5f5-0417-42ac-9256-72138be3e9bc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:06.113277 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a608c5f5-0417-42ac-9256-72138be3e9bc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:06.244213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a608c5f5-0417-42ac-9256-72138be3e9bc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:06.251350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a608c5f5-0417-42ac-9256-72138be3e9bc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1368 microversion: 2.1 time: 0.151221 Apr 07 13:31:06.251905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1251/2622] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:06 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:06.553903 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f79e57d8-e3ed-4da3-9ad5-b13567f1840f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:06.554522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f79e57d8-e3ed-4da3-9ad5-b13567f1840f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:06.560818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f79e57d8-e3ed-4da3-9ad5-b13567f1840f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:06.561288 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f79e57d8-e3ed-4da3-9ad5-b13567f1840f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:06.562023 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f79e57d8-e3ed-4da3-9ad5-b13567f1840f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:06.562461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f79e57d8-e3ed-4da3-9ad5-b13567f1840f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:06.697381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f79e57d8-e3ed-4da3-9ad5-b13567f1840f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:06.705021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f79e57d8-e3ed-4da3-9ad5-b13567f1840f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:06.706667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f79e57d8-e3ed-4da3-9ad5-b13567f1840f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:06.707818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f79e57d8-e3ed-4da3-9ad5-b13567f1840f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1737 microversion: 2.20 time: 0.157954 Apr 07 13:31:06.708404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1372/2623] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:06 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:07.269066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fdc604a4-3267-4d52-802b-6bedf968ef2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:07.269687 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fdc604a4-3267-4d52-802b-6bedf968ef2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:07.276046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdc604a4-3267-4d52-802b-6bedf968ef2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:07.276532 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdc604a4-3267-4d52-802b-6bedf968ef2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:07.277295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdc604a4-3267-4d52-802b-6bedf968ef2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:07.277733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fdc604a4-3267-4d52-802b-6bedf968ef2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:07.412631 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fdc604a4-3267-4d52-802b-6bedf968ef2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:07.421519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fdc604a4-3267-4d52-802b-6bedf968ef2f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1368 microversion: 2.1 time: 0.156278 Apr 07 13:31:07.422541 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1252/2624] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:07 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:07.726915 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0954e418-3a23-4eb9-950c-4e1820de9170 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:07.727513 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0954e418-3a23-4eb9-950c-4e1820de9170 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:07.733722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0954e418-3a23-4eb9-950c-4e1820de9170 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:07.734169 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0954e418-3a23-4eb9-950c-4e1820de9170 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:07.734916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0954e418-3a23-4eb9-950c-4e1820de9170 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:07.735344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0954e418-3a23-4eb9-950c-4e1820de9170 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:07.866628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0954e418-3a23-4eb9-950c-4e1820de9170 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:07.874289 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0954e418-3a23-4eb9-950c-4e1820de9170 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:07.876068 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0954e418-3a23-4eb9-950c-4e1820de9170 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:07.877139 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0954e418-3a23-4eb9-950c-4e1820de9170 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1737 microversion: 2.20 time: 0.154051 Apr 07 13:31:07.878391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1373/2625] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:07 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:08.438753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a89465db-9e6e-4c6b-98d2-6e04c9e845b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:08.439403 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a89465db-9e6e-4c6b-98d2-6e04c9e845b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:08.446338 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a89465db-9e6e-4c6b-98d2-6e04c9e845b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:08.446785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a89465db-9e6e-4c6b-98d2-6e04c9e845b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:08.447786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a89465db-9e6e-4c6b-98d2-6e04c9e845b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:08.448259 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a89465db-9e6e-4c6b-98d2-6e04c9e845b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:08.672135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a89465db-9e6e-4c6b-98d2-6e04c9e845b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:08.681742 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a89465db-9e6e-4c6b-98d2-6e04c9e845b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1368 microversion: 2.1 time: 0.246787 Apr 07 13:31:08.682321 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1253/2626] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:08 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:08.899006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-16b9dbfb-1ce0-4128-8267-3f5f30fb3f3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:08.899689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-16b9dbfb-1ce0-4128-8267-3f5f30fb3f3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:08.906559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16b9dbfb-1ce0-4128-8267-3f5f30fb3f3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:08.907120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16b9dbfb-1ce0-4128-8267-3f5f30fb3f3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:08.908011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16b9dbfb-1ce0-4128-8267-3f5f30fb3f3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:08.909051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-16b9dbfb-1ce0-4128-8267-3f5f30fb3f3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:09.048195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-16b9dbfb-1ce0-4128-8267-3f5f30fb3f3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:09.056601 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-16b9dbfb-1ce0-4128-8267-3f5f30fb3f3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:09.058152 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-16b9dbfb-1ce0-4128-8267-3f5f30fb3f3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:09.059311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-16b9dbfb-1ce0-4128-8267-3f5f30fb3f3d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1719 microversion: 2.20 time: 0.164706 Apr 07 13:31:09.059873 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1374/2627] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:08 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:31:09.698572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c5acaaea-60fa-48e0-b61e-793cdcb8db8c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:09.699200 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c5acaaea-60fa-48e0-b61e-793cdcb8db8c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:09.706370 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c5acaaea-60fa-48e0-b61e-793cdcb8db8c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:09.706786 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c5acaaea-60fa-48e0-b61e-793cdcb8db8c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:09.707558 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c5acaaea-60fa-48e0-b61e-793cdcb8db8c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:09.708003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c5acaaea-60fa-48e0-b61e-793cdcb8db8c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:09.847498 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c5acaaea-60fa-48e0-b61e-793cdcb8db8c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:09.856626 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c5acaaea-60fa-48e0-b61e-793cdcb8db8c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1368 microversion: 2.1 time: 0.161728 Apr 07 13:31:09.860515 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1254/2628] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:09 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:10.078802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-015aea16-0ada-471b-98f7-cc82268531fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:10.079371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-015aea16-0ada-471b-98f7-cc82268531fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:10.085610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-015aea16-0ada-471b-98f7-cc82268531fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:10.086057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-015aea16-0ada-471b-98f7-cc82268531fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:10.086817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-015aea16-0ada-471b-98f7-cc82268531fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:10.087257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-015aea16-0ada-471b-98f7-cc82268531fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:10.222138 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-015aea16-0ada-471b-98f7-cc82268531fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:10.229784 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-015aea16-0ada-471b-98f7-cc82268531fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:10.231275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-015aea16-0ada-471b-98f7-cc82268531fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:10.232461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-015aea16-0ada-471b-98f7-cc82268531fd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1662 microversion: 2.20 time: 0.157613 Apr 07 13:31:10.233017 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1375/2629] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:10 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:10.250776 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1252c33e-8ee2-4608-b1e1-77ca60074caf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66b7edb2-186c-4fc0-9113-3d17e9a4b3cc"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:31:10.251890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1252c33e-8ee2-4608-b1e1-77ca60074caf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:10.258333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1252c33e-8ee2-4608-b1e1-77ca60074caf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:10.258783 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1252c33e-8ee2-4608-b1e1-77ca60074caf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:10.259548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1252c33e-8ee2-4608-b1e1-77ca60074caf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:10.259980 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1252c33e-8ee2-4608-b1e1-77ca60074caf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:10.528248 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1252c33e-8ee2-4608-b1e1-77ca60074caf tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "POST /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.281336 Apr 07 13:31:10.528850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1255/2630] 10.222.0.15 () {62 vars in 1363 bytes} [Thu Apr 7 13:31:10 2022] POST /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/os-volume_attachments => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 13:31:10.637578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-20b7b6b7-4eda-435e-854b-2c0d636fbe62 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:10.638077 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-20b7b6b7-4eda-435e-854b-2c0d636fbe62 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:10.644698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20b7b6b7-4eda-435e-854b-2c0d636fbe62 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:10.645151 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20b7b6b7-4eda-435e-854b-2c0d636fbe62 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:10.645907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20b7b6b7-4eda-435e-854b-2c0d636fbe62 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:10.646342 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-20b7b6b7-4eda-435e-854b-2c0d636fbe62 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:10.856538 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-20b7b6b7-4eda-435e-854b-2c0d636fbe62 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/os-volume_attachments/66b7edb2-186c-4fc0-9113-3d17e9a4b3cc" status: 202 len: 0 microversion: 2.20 time: 0.222717 Apr 07 13:31:10.857115 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1376/2631] 10.222.0.15 () {60 vars in 1456 bytes} [Thu Apr 7 13:31:10 2022] DELETE /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/os-volume_attachments/66b7edb2-186c-4fc0-9113-3d17e9a4b3cc => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:31:10.875018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9925ac56-b5be-4a62-9063-233e11d090d3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:10.875837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9925ac56-b5be-4a62-9063-233e11d090d3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:10.883189 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9925ac56-b5be-4a62-9063-233e11d090d3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:10.883730 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9925ac56-b5be-4a62-9063-233e11d090d3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:10.884538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9925ac56-b5be-4a62-9063-233e11d090d3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:10.885003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9925ac56-b5be-4a62-9063-233e11d090d3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:10.915754 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c93c4480-fd50-40c8-b014-16b09d5a6287 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:31:10.916486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c93c4480-fd50-40c8-b014-16b09d5a6287 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:10.922423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c93c4480-fd50-40c8-b014-16b09d5a6287 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:10.922874 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c93c4480-fd50-40c8-b014-16b09d5a6287 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:10.923632 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c93c4480-fd50-40c8-b014-16b09d5a6287 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:10.924698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c93c4480-fd50-40c8-b014-16b09d5a6287 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:11.027715 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c93c4480-fd50-40c8-b014-16b09d5a6287 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "POST /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/action" status: 202 len: 0 microversion: 2.20 time: 0.115609 Apr 07 13:31:11.028484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1377/2632] 10.222.0.15 () {62 vars in 1318 bytes} [Thu Apr 7 13:31:10 2022] POST /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 07 13:31:11.041802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9925ac56-b5be-4a62-9063-233e11d090d3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:11.043155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3fce9291-1a5c-42b4-8673-aea13c308f2a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:11.044384 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3fce9291-1a5c-42b4-8673-aea13c308f2a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:11.050667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9925ac56-b5be-4a62-9063-233e11d090d3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1368 microversion: 2.1 time: 0.180198 Apr 07 13:31:11.058829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1256/2633] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:10 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:11.059040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3fce9291-1a5c-42b4-8673-aea13c308f2a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:11.059040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3fce9291-1a5c-42b4-8673-aea13c308f2a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:11.059040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3fce9291-1a5c-42b4-8673-aea13c308f2a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:11.059040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3fce9291-1a5c-42b4-8673-aea13c308f2a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:11.191050 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3fce9291-1a5c-42b4-8673-aea13c308f2a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:11.199314 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3fce9291-1a5c-42b4-8673-aea13c308f2a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:11.200855 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-3fce9291-1a5c-42b4-8673-aea13c308f2a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:11.202168 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3fce9291-1a5c-42b4-8673-aea13c308f2a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1670 microversion: 2.20 time: 0.167571 Apr 07 13:31:11.202760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1378/2634] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:11 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:11.686172 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-170a505a-81f0-4d46-a525-69a3a00ae3d4 req-448d403a-764c-48cc-a0d7-44614e56c6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69bcaba-e90d-43a6-8f4d-5e3edd32358e", "name": "network-vif-plugged", "status": "completed", "tag": "8b7f5c35-54de-4636-ba86-2047ee8ec086"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:31:11.695702 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-170a505a-81f0-4d46-a525-69a3a00ae3d4 req-448d403a-764c-48cc-a0d7-44614e56c6e0 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:11.696676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-170a505a-81f0-4d46-a525-69a3a00ae3d4 req-448d403a-764c-48cc-a0d7-44614e56c6e0 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:11.710244 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-170a505a-81f0-4d46-a525-69a3a00ae3d4 req-448d403a-764c-48cc-a0d7-44614e56c6e0 service nova] Creating event network-vif-plugged:8b7f5c35-54de-4636-ba86-2047ee8ec086 for instance e69bcaba-e90d-43a6-8f4d-5e3edd32358e on hv-cinder-83694 Apr 07 13:31:11.715691 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-170a505a-81f0-4d46-a525-69a3a00ae3d4 req-448d403a-764c-48cc-a0d7-44614e56c6e0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033752 Apr 07 13:31:11.716396 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1257/2635] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:31:12.005361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6986f08f-b012-473a-b0f3-6ea13e0a38f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:12.005869 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6986f08f-b012-473a-b0f3-6ea13e0a38f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:12.011799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6986f08f-b012-473a-b0f3-6ea13e0a38f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:12.012295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6986f08f-b012-473a-b0f3-6ea13e0a38f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:12.013059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6986f08f-b012-473a-b0f3-6ea13e0a38f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:12.013499 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6986f08f-b012-473a-b0f3-6ea13e0a38f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:12.070107 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4fde81f6-916d-47a1-9e71-d1f146ab7f4c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:12.070843 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4fde81f6-916d-47a1-9e71-d1f146ab7f4c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:12.076827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fde81f6-916d-47a1-9e71-d1f146ab7f4c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:12.077285 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fde81f6-916d-47a1-9e71-d1f146ab7f4c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:12.078050 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fde81f6-916d-47a1-9e71-d1f146ab7f4c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:12.078488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4fde81f6-916d-47a1-9e71-d1f146ab7f4c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:12.091195 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-6986f08f-b012-473a-b0f3-6ea13e0a38f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lazy-loading 'services' on Instance uuid 64be8d37-e3f7-4529-874e-a153d5bd8891 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:31:12.164863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6986f08f-b012-473a-b0f3-6ea13e0a38f3 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "DELETE /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891/os-volume_attachments/f638f3fc-e141-4df4-92e0-062068aceaeb" status: 202 len: 0 microversion: 2.1 time: 0.162678 Apr 07 13:31:12.168350 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1379/2636] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:31:11 2022] DELETE /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891/os-volume_attachments/f638f3fc-e141-4df4-92e0-062068aceaeb => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:31:12.223514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1b5a7bdf-3b72-4958-89a7-c064c62c16ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:12.223514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1b5a7bdf-3b72-4958-89a7-c064c62c16ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:12.229408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b5a7bdf-3b72-4958-89a7-c064c62c16ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:12.229858 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b5a7bdf-3b72-4958-89a7-c064c62c16ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:12.230631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b5a7bdf-3b72-4958-89a7-c064c62c16ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:12.231116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1b5a7bdf-3b72-4958-89a7-c064c62c16ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:12.233513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4fde81f6-916d-47a1-9e71-d1f146ab7f4c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:12.246348 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4fde81f6-916d-47a1-9e71-d1f146ab7f4c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1368 microversion: 2.1 time: 0.180770 Apr 07 13:31:12.246927 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1258/2637] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:12 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:31:12.372102 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1b5a7bdf-3b72-4958-89a7-c064c62c16ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:12.380120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1b5a7bdf-3b72-4958-89a7-c064c62c16ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:12.381644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1b5a7bdf-3b72-4958-89a7-c064c62c16ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:12.382789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1b5a7bdf-3b72-4958-89a7-c064c62c16ec tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.165250 Apr 07 13:31:12.383344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1380/2638] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:12 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:31:12.632300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:31:12.632530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:31:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:31:13.263554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d72aff1d-bccf-4a63-9fdf-83e0072a0108 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:13.264196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d72aff1d-bccf-4a63-9fdf-83e0072a0108 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:13.271615 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d72aff1d-bccf-4a63-9fdf-83e0072a0108 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:13.272065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d72aff1d-bccf-4a63-9fdf-83e0072a0108 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:13.272846 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d72aff1d-bccf-4a63-9fdf-83e0072a0108 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:13.273282 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d72aff1d-bccf-4a63-9fdf-83e0072a0108 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:13.401306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9deb4afd-a0b7-41f1-b474-12944100f523 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:13.401918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9deb4afd-a0b7-41f1-b474-12944100f523 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:13.404880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d72aff1d-bccf-4a63-9fdf-83e0072a0108 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:13.408445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9deb4afd-a0b7-41f1-b474-12944100f523 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:13.409568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9deb4afd-a0b7-41f1-b474-12944100f523 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:13.410339 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9deb4afd-a0b7-41f1-b474-12944100f523 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:13.410774 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9deb4afd-a0b7-41f1-b474-12944100f523 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:13.413492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d72aff1d-bccf-4a63-9fdf-83e0072a0108 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1558 microversion: 2.1 time: 0.153240 Apr 07 13:31:13.427691 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1259/2639] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:13 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:13.428743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1b7a96e1-b8ac-4afd-a109-f9c69d69e217 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:13.429243 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1b7a96e1-b8ac-4afd-a109-f9c69d69e217 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:13.435014 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b7a96e1-b8ac-4afd-a109-f9c69d69e217 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:13.435453 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b7a96e1-b8ac-4afd-a109-f9c69d69e217 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:13.436246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b7a96e1-b8ac-4afd-a109-f9c69d69e217 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:13.436686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b7a96e1-b8ac-4afd-a109-f9c69d69e217 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:13.523414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1b7a96e1-b8ac-4afd-a109-f9c69d69e217 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098325 Apr 07 13:31:13.524162 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1260/2640] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Apr 7 13:31:13 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:31:13.545070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9deb4afd-a0b7-41f1-b474-12944100f523 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:13.553373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9deb4afd-a0b7-41f1-b474-12944100f523 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:13.554859 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9deb4afd-a0b7-41f1-b474-12944100f523 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:13.556006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9deb4afd-a0b7-41f1-b474-12944100f523 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.158728 Apr 07 13:31:13.556639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1381/2641] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:13 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:31:13.745828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-aa4ecef4-83fc-474e-b11b-a19634a4fa30 req-89df3f4f-8ac7-4092-8772-cbe0279852c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac028ff8-ee5a-47e9-80b2-6633beac4e3f", "name": "network-vif-unplugged", "status": "completed", "tag": "10915de2-db85-43a4-a04e-e11c60542301"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:31:13.760018 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-aa4ecef4-83fc-474e-b11b-a19634a4fa30 req-89df3f4f-8ac7-4092-8772-cbe0279852c0 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:13.760569 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-aa4ecef4-83fc-474e-b11b-a19634a4fa30 req-89df3f4f-8ac7-4092-8772-cbe0279852c0 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:13.782405 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-aa4ecef4-83fc-474e-b11b-a19634a4fa30 req-89df3f4f-8ac7-4092-8772-cbe0279852c0 service nova] Creating event network-vif-unplugged:10915de2-db85-43a4-a04e-e11c60542301 for instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f on hv-cinder-83694 Apr 07 13:31:13.789139 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-aa4ecef4-83fc-474e-b11b-a19634a4fa30 req-89df3f4f-8ac7-4092-8772-cbe0279852c0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049758 Apr 07 13:31:13.789748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1261/2642] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:31:14.342954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c9cd82dd-2070-48b9-b380-2d5c7396395b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:14.343757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c9cd82dd-2070-48b9-b380-2d5c7396395b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:14.350900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9cd82dd-2070-48b9-b380-2d5c7396395b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:14.351359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9cd82dd-2070-48b9-b380-2d5c7396395b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:14.352338 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9cd82dd-2070-48b9-b380-2d5c7396395b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:14.352790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c9cd82dd-2070-48b9-b380-2d5c7396395b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:14.379801 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c9cd82dd-2070-48b9-b380-2d5c7396395b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:31:14.476606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c9cd82dd-2070-48b9-b380-2d5c7396395b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "DELETE /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 204 len: 0 microversion: 2.1 time: 0.137003 Apr 07 13:31:14.478175 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1382/2643] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:31:14 2022] DELETE /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:31:14.487228 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-08806a26-36a9-434b-baea-b7a298d59a1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:14.488781 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-08806a26-36a9-434b-baea-b7a298d59a1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:14.498147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-08806a26-36a9-434b-baea-b7a298d59a1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:14.498704 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-08806a26-36a9-434b-baea-b7a298d59a1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:14.500302 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-08806a26-36a9-434b-baea-b7a298d59a1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:14.501003 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-08806a26-36a9-434b-baea-b7a298d59a1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:14.575479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1d6b46c4-ebe2-401c-b25e-b10b2d0557ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:14.576593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1d6b46c4-ebe2-401c-b25e-b10b2d0557ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:14.586295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1d6b46c4-ebe2-401c-b25e-b10b2d0557ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:14.586988 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1d6b46c4-ebe2-401c-b25e-b10b2d0557ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:14.587952 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1d6b46c4-ebe2-401c-b25e-b10b2d0557ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:14.588771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1d6b46c4-ebe2-401c-b25e-b10b2d0557ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:14.760788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-08806a26-36a9-434b-baea-b7a298d59a1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:14.764648 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1d6b46c4-ebe2-401c-b25e-b10b2d0557ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:14.768128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-08806a26-36a9-434b-baea-b7a298d59a1c tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1514 microversion: 2.1 time: 0.285068 Apr 07 13:31:14.768936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1262/2644] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:14 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:14.773509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1d6b46c4-ebe2-401c-b25e-b10b2d0557ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:14.775142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1d6b46c4-ebe2-401c-b25e-b10b2d0557ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:14.776480 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1d6b46c4-ebe2-401c-b25e-b10b2d0557ce tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.205225 Apr 07 13:31:14.777335 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1383/2645] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:14 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:31:15.040617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-a29c1ca8-86fd-469d-8eda-fd41d3080ec7 req-5e8f6dea-fae7-418e-8334-aec48a310f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69bcaba-e90d-43a6-8f4d-5e3edd32358e", "tag": "8b7f5c35-54de-4636-ba86-2047ee8ec086"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:31:15.048656 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-a29c1ca8-86fd-469d-8eda-fd41d3080ec7 req-5e8f6dea-fae7-418e-8334-aec48a310f4d service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:15.049197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-a29c1ca8-86fd-469d-8eda-fd41d3080ec7 req-5e8f6dea-fae7-418e-8334-aec48a310f4d service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:15.060646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-a29c1ca8-86fd-469d-8eda-fd41d3080ec7 req-5e8f6dea-fae7-418e-8334-aec48a310f4d service nova] Creating event network-changed:8b7f5c35-54de-4636-ba86-2047ee8ec086 for instance e69bcaba-e90d-43a6-8f4d-5e3edd32358e on hv-cinder-83694 Apr 07 13:31:15.066474 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-a29c1ca8-86fd-469d-8eda-fd41d3080ec7 req-5e8f6dea-fae7-418e-8334-aec48a310f4d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031218 Apr 07 13:31:15.066666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1263/2646] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:31:15.786305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-266823e1-169c-456a-8d3c-f73aa7a45144 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:15.787132 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-266823e1-169c-456a-8d3c-f73aa7a45144 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:15.795662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-266823e1-169c-456a-8d3c-f73aa7a45144 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:15.796008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-88e77489-8414-4da2-b828-f290e3cf070e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:15.796924 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-88e77489-8414-4da2-b828-f290e3cf070e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:15.797633 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-266823e1-169c-456a-8d3c-f73aa7a45144 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:15.798730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-266823e1-169c-456a-8d3c-f73aa7a45144 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:15.799925 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-266823e1-169c-456a-8d3c-f73aa7a45144 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:15.808004 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-88e77489-8414-4da2-b828-f290e3cf070e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:15.808487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-88e77489-8414-4da2-b828-f290e3cf070e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:15.809273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-88e77489-8414-4da2-b828-f290e3cf070e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:15.809713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-88e77489-8414-4da2-b828-f290e3cf070e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:16.030128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-266823e1-169c-456a-8d3c-f73aa7a45144 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:16.039294 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-266823e1-169c-456a-8d3c-f73aa7a45144 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1514 microversion: 2.1 time: 0.258103 Apr 07 13:31:16.044578 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1384/2647] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:15 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:16.078689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-88e77489-8414-4da2-b828-f290e3cf070e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:16.088426 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-88e77489-8414-4da2-b828-f290e3cf070e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:16.089947 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-88e77489-8414-4da2-b828-f290e3cf070e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:16.091130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-88e77489-8414-4da2-b828-f290e3cf070e tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.299937 Apr 07 13:31:16.091693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1264/2648] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:15 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:17.055960 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bbf4b6c1-c04a-4778-a87f-036009f44ba5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:17.057097 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bbf4b6c1-c04a-4778-a87f-036009f44ba5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:17.062705 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbf4b6c1-c04a-4778-a87f-036009f44ba5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:17.063162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbf4b6c1-c04a-4778-a87f-036009f44ba5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:17.063938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbf4b6c1-c04a-4778-a87f-036009f44ba5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:17.064398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bbf4b6c1-c04a-4778-a87f-036009f44ba5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:17.110672 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9bfd7a94-473d-41f7-ac22-db41c834a26f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:17.112602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9bfd7a94-473d-41f7-ac22-db41c834a26f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:17.120404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bfd7a94-473d-41f7-ac22-db41c834a26f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:17.121218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bfd7a94-473d-41f7-ac22-db41c834a26f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:17.122275 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bfd7a94-473d-41f7-ac22-db41c834a26f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:17.122952 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9bfd7a94-473d-41f7-ac22-db41c834a26f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:17.222423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-bbf4b6c1-c04a-4778-a87f-036009f44ba5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:17.239866 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bbf4b6c1-c04a-4778-a87f-036009f44ba5 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1514 microversion: 2.1 time: 0.180179 Apr 07 13:31:17.241066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1385/2649] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:17 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:17.283689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9bfd7a94-473d-41f7-ac22-db41c834a26f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:17.294989 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9bfd7a94-473d-41f7-ac22-db41c834a26f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:17.296518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9bfd7a94-473d-41f7-ac22-db41c834a26f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:17.310183 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9bfd7a94-473d-41f7-ac22-db41c834a26f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.204183 Apr 07 13:31:17.312348 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1265/2650] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:17 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:18.258599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-50145bc1-be3f-4249-854c-2c86b301da06 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:18.260082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-50145bc1-be3f-4249-854c-2c86b301da06 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:18.268872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50145bc1-be3f-4249-854c-2c86b301da06 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:18.269847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50145bc1-be3f-4249-854c-2c86b301da06 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:18.270971 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50145bc1-be3f-4249-854c-2c86b301da06 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:18.271722 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-50145bc1-be3f-4249-854c-2c86b301da06 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:18.328882 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fc9ec551-cc35-4ef5-acdf-7ce8de3071f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:18.329498 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fc9ec551-cc35-4ef5-acdf-7ce8de3071f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:18.336739 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc9ec551-cc35-4ef5-acdf-7ce8de3071f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:18.337188 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc9ec551-cc35-4ef5-acdf-7ce8de3071f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:18.337965 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc9ec551-cc35-4ef5-acdf-7ce8de3071f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:18.338400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fc9ec551-cc35-4ef5-acdf-7ce8de3071f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:18.422200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-50145bc1-be3f-4249-854c-2c86b301da06 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:18.430907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-50145bc1-be3f-4249-854c-2c86b301da06 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1514 microversion: 2.1 time: 0.177185 Apr 07 13:31:18.431489 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1386/2651] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:18 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:31:18.506663 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fc9ec551-cc35-4ef5-acdf-7ce8de3071f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:18.515488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fc9ec551-cc35-4ef5-acdf-7ce8de3071f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:18.517468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fc9ec551-cc35-4ef5-acdf-7ce8de3071f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:18.519545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fc9ec551-cc35-4ef5-acdf-7ce8de3071f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.194575 Apr 07 13:31:18.526987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1266/2652] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:18 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:31:19.448919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c380e352-5429-422d-858e-965dc415894b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:19.449461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c380e352-5429-422d-858e-965dc415894b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:19.455996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c380e352-5429-422d-858e-965dc415894b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:19.456485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c380e352-5429-422d-858e-965dc415894b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:19.457237 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c380e352-5429-422d-858e-965dc415894b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:19.457668 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c380e352-5429-422d-858e-965dc415894b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:19.539701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-263767a5-f230-4e62-adef-f4161d87981a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:19.542153 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-263767a5-f230-4e62-adef-f4161d87981a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:19.549767 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-263767a5-f230-4e62-adef-f4161d87981a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:19.550456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-263767a5-f230-4e62-adef-f4161d87981a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:19.551242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-263767a5-f230-4e62-adef-f4161d87981a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:19.551681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-263767a5-f230-4e62-adef-f4161d87981a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:19.593955 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c380e352-5429-422d-858e-965dc415894b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:19.602243 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c380e352-5429-422d-858e-965dc415894b tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1514 microversion: 2.1 time: 0.157104 Apr 07 13:31:19.603405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1387/2653] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:19 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:19.705312 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-263767a5-f230-4e62-adef-f4161d87981a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:19.714522 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-263767a5-f230-4e62-adef-f4161d87981a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:19.717055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-263767a5-f230-4e62-adef-f4161d87981a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:19.718358 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-263767a5-f230-4e62-adef-f4161d87981a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.184316 Apr 07 13:31:19.728864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1267/2654] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:19 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:31:20.621307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5c1c0b72-f0db-41be-a427-1019f460fef1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:20.621917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5c1c0b72-f0db-41be-a427-1019f460fef1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:20.645479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c1c0b72-f0db-41be-a427-1019f460fef1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:20.646057 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c1c0b72-f0db-41be-a427-1019f460fef1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:20.647067 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c1c0b72-f0db-41be-a427-1019f460fef1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:20.647678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c1c0b72-f0db-41be-a427-1019f460fef1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:20.738303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-77dd75d4-b2d6-49cc-a02c-0ffd0346062c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:20.738918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-77dd75d4-b2d6-49cc-a02c-0ffd0346062c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:20.745223 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77dd75d4-b2d6-49cc-a02c-0ffd0346062c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:20.745674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77dd75d4-b2d6-49cc-a02c-0ffd0346062c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:20.746443 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77dd75d4-b2d6-49cc-a02c-0ffd0346062c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:20.746879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-77dd75d4-b2d6-49cc-a02c-0ffd0346062c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:20.798100 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5c1c0b72-f0db-41be-a427-1019f460fef1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:20.806183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5c1c0b72-f0db-41be-a427-1019f460fef1 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1514 microversion: 2.1 time: 0.188635 Apr 07 13:31:20.808285 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1388/2655] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:20 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:31:20.916110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-77dd75d4-b2d6-49cc-a02c-0ffd0346062c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:20.923776 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-77dd75d4-b2d6-49cc-a02c-0ffd0346062c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:20.925353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-77dd75d4-b2d6-49cc-a02c-0ffd0346062c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:20.926497 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-77dd75d4-b2d6-49cc-a02c-0ffd0346062c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.192249 Apr 07 13:31:20.927047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1268/2656] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:20 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:31:21.826029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0c876931-937b-4175-838f-26d6e6b77f23 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:21.826642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0c876931-937b-4175-838f-26d6e6b77f23 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:21.833543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c876931-937b-4175-838f-26d6e6b77f23 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:21.833941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c876931-937b-4175-838f-26d6e6b77f23 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:21.834714 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c876931-937b-4175-838f-26d6e6b77f23 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:21.835153 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0c876931-937b-4175-838f-26d6e6b77f23 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:21.945737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b3af4b9c-8699-42c0-9e44-e4abf4b26e1c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:21.946341 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b3af4b9c-8699-42c0-9e44-e4abf4b26e1c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:21.953527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3af4b9c-8699-42c0-9e44-e4abf4b26e1c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:21.953988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3af4b9c-8699-42c0-9e44-e4abf4b26e1c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:21.954771 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3af4b9c-8699-42c0-9e44-e4abf4b26e1c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:21.955207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b3af4b9c-8699-42c0-9e44-e4abf4b26e1c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:22.012004 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0c876931-937b-4175-838f-26d6e6b77f23 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:22.028603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0c876931-937b-4175-838f-26d6e6b77f23 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1514 microversion: 2.1 time: 0.206162 Apr 07 13:31:22.030082 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1389/2657] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:21 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:22.116114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b3af4b9c-8699-42c0-9e44-e4abf4b26e1c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:22.125873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b3af4b9c-8699-42c0-9e44-e4abf4b26e1c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:22.128721 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b3af4b9c-8699-42c0-9e44-e4abf4b26e1c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:22.131026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b3af4b9c-8699-42c0-9e44-e4abf4b26e1c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.189547 Apr 07 13:31:22.132356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1269/2658] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:21 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:23.053985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5fe1fbd9-4792-42d8-ab76-4d1d59475818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:23.054737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5fe1fbd9-4792-42d8-ab76-4d1d59475818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:23.062014 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5fe1fbd9-4792-42d8-ab76-4d1d59475818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:23.062474 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5fe1fbd9-4792-42d8-ab76-4d1d59475818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:23.063257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5fe1fbd9-4792-42d8-ab76-4d1d59475818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:23.063696 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5fe1fbd9-4792-42d8-ab76-4d1d59475818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:23.149662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2a66833e-c6eb-40fa-b58d-154b949df1dd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:23.150232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2a66833e-c6eb-40fa-b58d-154b949df1dd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:23.158027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a66833e-c6eb-40fa-b58d-154b949df1dd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:23.158693 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a66833e-c6eb-40fa-b58d-154b949df1dd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:23.160483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a66833e-c6eb-40fa-b58d-154b949df1dd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:23.161351 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2a66833e-c6eb-40fa-b58d-154b949df1dd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:23.217203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5fe1fbd9-4792-42d8-ab76-4d1d59475818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:23.225166 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5fe1fbd9-4792-42d8-ab76-4d1d59475818 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1514 microversion: 2.1 time: 0.175012 Apr 07 13:31:23.225835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1390/2659] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:23 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:23.325850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2a66833e-c6eb-40fa-b58d-154b949df1dd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:23.334491 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2a66833e-c6eb-40fa-b58d-154b949df1dd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:23.336118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2a66833e-c6eb-40fa-b58d-154b949df1dd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:23.340833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2a66833e-c6eb-40fa-b58d-154b949df1dd tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.191851 Apr 07 13:31:23.340833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1270/2660] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:23 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:24.243127 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c33dbc39-f546-42fb-9a7a-7e103ecf0df4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:24.243725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c33dbc39-f546-42fb-9a7a-7e103ecf0df4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:24.251101 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c33dbc39-f546-42fb-9a7a-7e103ecf0df4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:24.251710 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c33dbc39-f546-42fb-9a7a-7e103ecf0df4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:24.253192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c33dbc39-f546-42fb-9a7a-7e103ecf0df4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:24.254176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c33dbc39-f546-42fb-9a7a-7e103ecf0df4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:24.360407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-dd153b0b-ff32-4329-b28a-3ec66f912b06 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:24.361110 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-dd153b0b-ff32-4329-b28a-3ec66f912b06 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:24.370700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd153b0b-ff32-4329-b28a-3ec66f912b06 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:24.371158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd153b0b-ff32-4329-b28a-3ec66f912b06 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:24.371942 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd153b0b-ff32-4329-b28a-3ec66f912b06 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:24.373835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-dd153b0b-ff32-4329-b28a-3ec66f912b06 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:24.418030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c33dbc39-f546-42fb-9a7a-7e103ecf0df4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:24.430343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c33dbc39-f546-42fb-9a7a-7e103ecf0df4 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1514 microversion: 2.1 time: 0.190813 Apr 07 13:31:24.431197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1391/2661] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:24 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:24.526106 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dd153b0b-ff32-4329-b28a-3ec66f912b06 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:24.536645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dd153b0b-ff32-4329-b28a-3ec66f912b06 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:24.538214 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-dd153b0b-ff32-4329-b28a-3ec66f912b06 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:24.539408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-dd153b0b-ff32-4329-b28a-3ec66f912b06 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.185025 Apr 07 13:31:24.539969 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1271/2662] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:24 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:25.449012 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a9702157-f411-4530-aed4-0447e2347b6d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:25.449649 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a9702157-f411-4530-aed4-0447e2347b6d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:25.456826 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9702157-f411-4530-aed4-0447e2347b6d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:25.457274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9702157-f411-4530-aed4-0447e2347b6d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:25.458026 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9702157-f411-4530-aed4-0447e2347b6d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:25.458462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9702157-f411-4530-aed4-0447e2347b6d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:25.560080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a657b217-7b90-4540-ad67-1850ecd4219a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:25.560624 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a657b217-7b90-4540-ad67-1850ecd4219a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:25.567819 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a657b217-7b90-4540-ad67-1850ecd4219a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:25.568298 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a657b217-7b90-4540-ad67-1850ecd4219a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:25.569060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a657b217-7b90-4540-ad67-1850ecd4219a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:25.569492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a657b217-7b90-4540-ad67-1850ecd4219a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:25.588448 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a9702157-f411-4530-aed4-0447e2347b6d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:25.596762 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a9702157-f411-4530-aed4-0447e2347b6d tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1514 microversion: 2.1 time: 0.150890 Apr 07 13:31:25.597253 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1392/2663] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:25 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:25.704024 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a657b217-7b90-4540-ad67-1850ecd4219a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:25.712349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a657b217-7b90-4540-ad67-1850ecd4219a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:25.713847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a657b217-7b90-4540-ad67-1850ecd4219a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:25.715010 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a657b217-7b90-4540-ad67-1850ecd4219a tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.158818 Apr 07 13:31:25.715564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1272/2664] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:25 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:31:26.614364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a2486eba-b1d9-42f2-bfa4-058c79f6f946 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:26.615041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a2486eba-b1d9-42f2-bfa4-058c79f6f946 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:26.621371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a2486eba-b1d9-42f2-bfa4-058c79f6f946 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:26.621828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a2486eba-b1d9-42f2-bfa4-058c79f6f946 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:26.622593 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a2486eba-b1d9-42f2-bfa4-058c79f6f946 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:26.623029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a2486eba-b1d9-42f2-bfa4-058c79f6f946 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:26.733412 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6293c7a3-65ed-48c2-900a-32f0682e79b0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:26.734150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6293c7a3-65ed-48c2-900a-32f0682e79b0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:26.740900 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6293c7a3-65ed-48c2-900a-32f0682e79b0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:26.741353 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6293c7a3-65ed-48c2-900a-32f0682e79b0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:26.742119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6293c7a3-65ed-48c2-900a-32f0682e79b0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:26.742564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6293c7a3-65ed-48c2-900a-32f0682e79b0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:26.757408 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a2486eba-b1d9-42f2-bfa4-058c79f6f946 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:26.764680 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a2486eba-b1d9-42f2-bfa4-058c79f6f946 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1514 microversion: 2.1 time: 0.154865 Apr 07 13:31:26.765248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1393/2665] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:26 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:26.877845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6293c7a3-65ed-48c2-900a-32f0682e79b0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:26.885548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6293c7a3-65ed-48c2-900a-32f0682e79b0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:26.887046 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6293c7a3-65ed-48c2-900a-32f0682e79b0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:26.888229 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6293c7a3-65ed-48c2-900a-32f0682e79b0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.158723 Apr 07 13:31:26.888791 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1273/2666] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:26 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:31:27.444806 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-efa08e90-4564-498c-a302-10635e155610 req-1464a72b-fcdd-4555-b8b7-863b569cb1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64be8d37-e3f7-4529-874e-a153d5bd8891", "name": "network-vif-deleted", "tag": "77f2ffb5-e169-4ed1-b5d8-e50cd97060c2"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:31:27.455322 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-efa08e90-4564-498c-a302-10635e155610 req-1464a72b-fcdd-4555-b8b7-863b569cb1a2 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:27.455799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-efa08e90-4564-498c-a302-10635e155610 req-1464a72b-fcdd-4555-b8b7-863b569cb1a2 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:27.467517 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-efa08e90-4564-498c-a302-10635e155610 req-1464a72b-fcdd-4555-b8b7-863b569cb1a2 service nova] Creating event network-vif-deleted:77f2ffb5-e169-4ed1-b5d8-e50cd97060c2 for instance 64be8d37-e3f7-4529-874e-a153d5bd8891 on hv-cinder-83694 Apr 07 13:31:27.473219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-efa08e90-4564-498c-a302-10635e155610 req-1464a72b-fcdd-4555-b8b7-863b569cb1a2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036018 Apr 07 13:31:27.473935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1394/2667] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:31:27.781835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9b24571f-4973-4c3f-bd9d-5329b72a0cd8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:27.782394 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9b24571f-4973-4c3f-bd9d-5329b72a0cd8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:27.789555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b24571f-4973-4c3f-bd9d-5329b72a0cd8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:27.790012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b24571f-4973-4c3f-bd9d-5329b72a0cd8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:27.790858 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b24571f-4973-4c3f-bd9d-5329b72a0cd8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:27.791301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b24571f-4973-4c3f-bd9d-5329b72a0cd8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:27.825962 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b24571f-4973-4c3f-bd9d-5329b72a0cd8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:27.832699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9b24571f-4973-4c3f-bd9d-5329b72a0cd8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:27.833130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-9b24571f-4973-4c3f-bd9d-5329b72a0cd8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lazy-loading 'fault' on Instance uuid 64be8d37-e3f7-4529-874e-a153d5bd8891 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:31:27.881655 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9b24571f-4973-4c3f-bd9d-5329b72a0cd8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce952f5fbb249a08c3c103b542c94f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b9990f9e7d4c6aa7f472952d89f94d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:27.890872 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9b24571f-4973-4c3f-bd9d-5329b72a0cd8 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 200 len: 1309 microversion: 2.1 time: 0.112934 Apr 07 13:31:27.891734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1274/2668] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:27 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:31:27.907099 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b71248e9-7031-4ca6-91cf-26153776ac31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:27.909456 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b71248e9-7031-4ca6-91cf-26153776ac31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:27.916175 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b71248e9-7031-4ca6-91cf-26153776ac31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:27.916627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b71248e9-7031-4ca6-91cf-26153776ac31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:27.917416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b71248e9-7031-4ca6-91cf-26153776ac31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:27.917837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b71248e9-7031-4ca6-91cf-26153776ac31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:28.075250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b71248e9-7031-4ca6-91cf-26153776ac31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:28.084596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b71248e9-7031-4ca6-91cf-26153776ac31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:28.086129 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b71248e9-7031-4ca6-91cf-26153776ac31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:28.087292 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b71248e9-7031-4ca6-91cf-26153776ac31 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.184861 Apr 07 13:31:28.087842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1395/2669] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:27 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:28.908776 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7dc25d64-eeac-4189-b431-e70df7113300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:28.909645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7dc25d64-eeac-4189-b431-e70df7113300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] [instance: 64be8d37-e3f7-4529-874e-a153d5bd8891] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:28.915902 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7dc25d64-eeac-4189-b431-e70df7113300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:28.916395 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7dc25d64-eeac-4189-b431-e70df7113300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:28.917164 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7dc25d64-eeac-4189-b431-e70df7113300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:28.917600 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7dc25d64-eeac-4189-b431-e70df7113300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:28.930874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-7dc25d64-eeac-4189-b431-e70df7113300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] HTTP exception thrown: Instance 64be8d37-e3f7-4529-874e-a153d5bd8891 could not be found. Apr 07 13:31:28.931449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7dc25d64-eeac-4189-b431-e70df7113300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] Returning 404 to user: Instance 64be8d37-e3f7-4529-874e-a153d5bd8891 could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:31:28.932300 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7dc25d64-eeac-4189-b431-e70df7113300 tempest-VolumesSnapshotTestJSON-2012738556 tempest-VolumesSnapshotTestJSON-2012738556-project] 10.222.0.15 "GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891" status: 404 len: 111 microversion: 2.1 time: 0.027354 Apr 07 13:31:28.932814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1275/2670] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:28 2022] GET /compute/v2.1/servers/64be8d37-e3f7-4529-874e-a153d5bd8891 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:31:29.106558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9798b5c0-2242-4c27-ada3-ad028ac436db tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:29.107179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9798b5c0-2242-4c27-ada3-ad028ac436db tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:29.114847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9798b5c0-2242-4c27-ada3-ad028ac436db tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:29.115323 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9798b5c0-2242-4c27-ada3-ad028ac436db tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:29.116193 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9798b5c0-2242-4c27-ada3-ad028ac436db tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:29.116634 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9798b5c0-2242-4c27-ada3-ad028ac436db tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:29.262300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9798b5c0-2242-4c27-ada3-ad028ac436db tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:29.270534 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9798b5c0-2242-4c27-ada3-ad028ac436db tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:29.272229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9798b5c0-2242-4c27-ada3-ad028ac436db tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:29.273516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9798b5c0-2242-4c27-ada3-ad028ac436db tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.170741 Apr 07 13:31:29.274072 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1396/2671] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:29 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:30.293726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-78393d10-728e-4dcb-a9fd-552cf5628a55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:30.294258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-78393d10-728e-4dcb-a9fd-552cf5628a55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:30.301315 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-78393d10-728e-4dcb-a9fd-552cf5628a55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:30.302021 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-78393d10-728e-4dcb-a9fd-552cf5628a55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:30.303546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-78393d10-728e-4dcb-a9fd-552cf5628a55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:30.304369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-78393d10-728e-4dcb-a9fd-552cf5628a55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:30.450091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-78393d10-728e-4dcb-a9fd-552cf5628a55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:30.458340 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-78393d10-728e-4dcb-a9fd-552cf5628a55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:30.459840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-78393d10-728e-4dcb-a9fd-552cf5628a55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:30.461031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-78393d10-728e-4dcb-a9fd-552cf5628a55 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.171255 Apr 07 13:31:30.461591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1276/2672] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:30 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:31.479748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-24ee5503-d5d9-4508-b7e2-4cdc41b8fb63 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:31.480394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-24ee5503-d5d9-4508-b7e2-4cdc41b8fb63 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:31.487773 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-24ee5503-d5d9-4508-b7e2-4cdc41b8fb63 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:31.488249 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-24ee5503-d5d9-4508-b7e2-4cdc41b8fb63 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:31.489007 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-24ee5503-d5d9-4508-b7e2-4cdc41b8fb63 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:31.489437 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-24ee5503-d5d9-4508-b7e2-4cdc41b8fb63 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:31.619547 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-24ee5503-d5d9-4508-b7e2-4cdc41b8fb63 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:31.627324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-24ee5503-d5d9-4508-b7e2-4cdc41b8fb63 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:31.629002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-24ee5503-d5d9-4508-b7e2-4cdc41b8fb63 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:31.630160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-24ee5503-d5d9-4508-b7e2-4cdc41b8fb63 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.154229 Apr 07 13:31:31.630723 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1397/2673] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:31 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:32.467164 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-8ba6ecf9-f61f-4563-971d-73bc8f677ff1 req-230d0346-805f-4dba-b8fb-3295e4dd1fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac028ff8-ee5a-47e9-80b2-6633beac4e3f", "name": "network-vif-plugged", "status": "completed", "tag": "10915de2-db85-43a4-a04e-e11c60542301"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:31:32.476359 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-8ba6ecf9-f61f-4563-971d-73bc8f677ff1 req-230d0346-805f-4dba-b8fb-3295e4dd1fdc service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:32.476779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-8ba6ecf9-f61f-4563-971d-73bc8f677ff1 req-230d0346-805f-4dba-b8fb-3295e4dd1fdc service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:32.488332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-8ba6ecf9-f61f-4563-971d-73bc8f677ff1 req-230d0346-805f-4dba-b8fb-3295e4dd1fdc service nova] Creating event network-vif-plugged:10915de2-db85-43a4-a04e-e11c60542301 for instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f on hv-cinder-83694 Apr 07 13:31:32.493416 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-8ba6ecf9-f61f-4563-971d-73bc8f677ff1 req-230d0346-805f-4dba-b8fb-3295e4dd1fdc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030004 Apr 07 13:31:32.494101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1277/2674] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:31:32.649084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-425bf7f2-f228-4bb7-9aca-931a89631911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:32.649733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-425bf7f2-f228-4bb7-9aca-931a89631911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:32.655954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-425bf7f2-f228-4bb7-9aca-931a89631911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:32.656446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-425bf7f2-f228-4bb7-9aca-931a89631911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:32.657206 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-425bf7f2-f228-4bb7-9aca-931a89631911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:32.657642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-425bf7f2-f228-4bb7-9aca-931a89631911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:32.788917 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-425bf7f2-f228-4bb7-9aca-931a89631911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:32.796718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-425bf7f2-f228-4bb7-9aca-931a89631911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:32.798223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-425bf7f2-f228-4bb7-9aca-931a89631911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:32.800021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-425bf7f2-f228-4bb7-9aca-931a89631911 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.154935 Apr 07 13:31:32.800628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1398/2675] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:32 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:33.819504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4db3b675-6cdb-495b-a68d-a0de79319934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:33.820258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4db3b675-6cdb-495b-a68d-a0de79319934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:33.826391 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4db3b675-6cdb-495b-a68d-a0de79319934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:33.826852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4db3b675-6cdb-495b-a68d-a0de79319934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:33.827613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4db3b675-6cdb-495b-a68d-a0de79319934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:33.828047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4db3b675-6cdb-495b-a68d-a0de79319934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:33.961236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4db3b675-6cdb-495b-a68d-a0de79319934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:33.968779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4db3b675-6cdb-495b-a68d-a0de79319934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:33.970256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4db3b675-6cdb-495b-a68d-a0de79319934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:33.971438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4db3b675-6cdb-495b-a68d-a0de79319934 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.157033 Apr 07 13:31:33.972530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1278/2676] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:33 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:34.992094 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-04c0345b-3350-4399-bd99-880f50796ce4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:34.992741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-04c0345b-3350-4399-bd99-880f50796ce4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:35.000165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04c0345b-3350-4399-bd99-880f50796ce4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:35.000627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04c0345b-3350-4399-bd99-880f50796ce4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:35.001433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04c0345b-3350-4399-bd99-880f50796ce4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:35.001877 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-04c0345b-3350-4399-bd99-880f50796ce4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:35.138451 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-04c0345b-3350-4399-bd99-880f50796ce4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:35.147823 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-04c0345b-3350-4399-bd99-880f50796ce4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:35.149365 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-04c0345b-3350-4399-bd99-880f50796ce4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:35.150533 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-04c0345b-3350-4399-bd99-880f50796ce4 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1728 microversion: 2.20 time: 0.164032 Apr 07 13:31:35.151075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1399/2677] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:34 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:31:36.168599 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c8b97d74-0ae7-4ee3-9d1e-622fccd206a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:36.169222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c8b97d74-0ae7-4ee3-9d1e-622fccd206a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:36.176163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8b97d74-0ae7-4ee3-9d1e-622fccd206a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:36.176622 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8b97d74-0ae7-4ee3-9d1e-622fccd206a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:36.177414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8b97d74-0ae7-4ee3-9d1e-622fccd206a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:36.177842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8b97d74-0ae7-4ee3-9d1e-622fccd206a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:36.311368 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c8b97d74-0ae7-4ee3-9d1e-622fccd206a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:36.319847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c8b97d74-0ae7-4ee3-9d1e-622fccd206a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:36.321389 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c8b97d74-0ae7-4ee3-9d1e-622fccd206a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:36.322643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c8b97d74-0ae7-4ee3-9d1e-622fccd206a8 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1715 microversion: 2.20 time: 0.157940 Apr 07 13:31:36.323202 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1279/2678] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:31:36 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:31:58.769759 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ae05191d-8d1f-491b-931d-b30da6d11f83 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:58.770420 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ae05191d-8d1f-491b-931d-b30da6d11f83 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:58.776390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae05191d-8d1f-491b-931d-b30da6d11f83 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:58.776849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae05191d-8d1f-491b-931d-b30da6d11f83 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:58.778087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae05191d-8d1f-491b-931d-b30da6d11f83 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:58.778901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ae05191d-8d1f-491b-931d-b30da6d11f83 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:58.803826 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ae05191d-8d1f-491b-931d-b30da6d11f83 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e/ips" status: 200 len: 150 microversion: 2.1 time: 0.038668 Apr 07 13:31:58.804427 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1400/2679] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Apr 7 13:31:58 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:31:58.815614 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-609ad56a-6e4e-4e55-861b-f8dd58002e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "994242a7-2b62-4bc4-888d-21e86c933d37"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:31:58.817079 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-609ad56a-6e4e-4e55-861b-f8dd58002e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:58.823951 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-609ad56a-6e4e-4e55-861b-f8dd58002e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:58.824438 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-609ad56a-6e4e-4e55-861b-f8dd58002e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:58.825199 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-609ad56a-6e4e-4e55-861b-f8dd58002e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:58.825629 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-609ad56a-6e4e-4e55-861b-f8dd58002e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:58.900695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-609ad56a-6e4e-4e55-861b-f8dd58002e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Invalid volume: volume 994242a7-2b62-4bc4-888d-21e86c933d37 is already attached to instances: ef3f987d-04a9-4057-b8ef-370f57761259 Apr 07 13:31:58.901295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-609ad56a-6e4e-4e55-861b-f8dd58002e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 400 to user: Invalid volume: volume 994242a7-2b62-4bc4-888d-21e86c933d37 is already attached to instances: ef3f987d-04a9-4057-b8ef-370f57761259 {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:31:58.902129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-609ad56a-6e4e-4e55-861b-f8dd58002e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091439 Apr 07 13:31:58.902667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1280/2680] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Apr 7 13:31:58 2022] POST /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:31:58.911719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-28b2000b-049d-4d09-8a2e-54a6b08ee9e5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:58.912254 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-28b2000b-049d-4d09-8a2e-54a6b08ee9e5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:58.918037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-28b2000b-049d-4d09-8a2e-54a6b08ee9e5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:58.918486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-28b2000b-049d-4d09-8a2e-54a6b08ee9e5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:58.919244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-28b2000b-049d-4d09-8a2e-54a6b08ee9e5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:58.919678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-28b2000b-049d-4d09-8a2e-54a6b08ee9e5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:58.942683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-28b2000b-049d-4d09-8a2e-54a6b08ee9e5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:31:59.018893 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-28b2000b-049d-4d09-8a2e-54a6b08ee9e5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 204 len: 0 microversion: 2.1 time: 0.111531 Apr 07 13:31:59.019449 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1401/2681] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:31:58 2022] DELETE /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:31:59.027529 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5f314021-c42f-4f27-b2c6-79944345f786 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:31:59.028181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5f314021-c42f-4f27-b2c6-79944345f786 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:31:59.034968 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f314021-c42f-4f27-b2c6-79944345f786 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:59.035420 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f314021-c42f-4f27-b2c6-79944345f786 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:59.036228 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f314021-c42f-4f27-b2c6-79944345f786 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:31:59.036671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5f314021-c42f-4f27-b2c6-79944345f786 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:31:59.184461 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5f314021-c42f-4f27-b2c6-79944345f786 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:31:59.192404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5f314021-c42f-4f27-b2c6-79944345f786 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1683 microversion: 2.1 time: 0.168555 Apr 07 13:31:59.192973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1281/2682] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:31:59 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:00.211447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6e77f035-d7c1-4675-8d3b-688bd73c03a3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:00.212157 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6e77f035-d7c1-4675-8d3b-688bd73c03a3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:00.218557 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e77f035-d7c1-4675-8d3b-688bd73c03a3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:00.219008 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e77f035-d7c1-4675-8d3b-688bd73c03a3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:00.219768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e77f035-d7c1-4675-8d3b-688bd73c03a3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:00.220709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6e77f035-d7c1-4675-8d3b-688bd73c03a3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:00.355409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6e77f035-d7c1-4675-8d3b-688bd73c03a3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:00.362763 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6e77f035-d7c1-4675-8d3b-688bd73c03a3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1683 microversion: 2.1 time: 0.155584 Apr 07 13:32:00.363319 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1402/2683] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:00 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:01.379701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d285e665-5f95-45ea-a44e-625892e200a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:01.380373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d285e665-5f95-45ea-a44e-625892e200a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:01.386593 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d285e665-5f95-45ea-a44e-625892e200a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:01.387045 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d285e665-5f95-45ea-a44e-625892e200a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:01.387799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d285e665-5f95-45ea-a44e-625892e200a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:01.388260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d285e665-5f95-45ea-a44e-625892e200a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:01.455815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d285e665-5f95-45ea-a44e-625892e200a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:01.463424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d285e665-5f95-45ea-a44e-625892e200a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 200 len: 1615 microversion: 2.1 time: 0.087604 Apr 07 13:32:01.463987 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1282/2684] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:01 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:01.558162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-52a994c9-786f-43a4-b795-51c8449821ca req-90ff5df1-44f6-4961-a10a-d4798906bc49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69bcaba-e90d-43a6-8f4d-5e3edd32358e", "name": "network-vif-deleted", "tag": "8b7f5c35-54de-4636-ba86-2047ee8ec086"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:32:01.567747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-52a994c9-786f-43a4-b795-51c8449821ca req-90ff5df1-44f6-4961-a10a-d4798906bc49 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:01.568237 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-52a994c9-786f-43a4-b795-51c8449821ca req-90ff5df1-44f6-4961-a10a-d4798906bc49 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:01.583433 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-52a994c9-786f-43a4-b795-51c8449821ca req-90ff5df1-44f6-4961-a10a-d4798906bc49 service nova] Creating event network-vif-deleted:8b7f5c35-54de-4636-ba86-2047ee8ec086 for instance e69bcaba-e90d-43a6-8f4d-5e3edd32358e on hv-cinder-83694 Apr 07 13:32:01.588594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-52a994c9-786f-43a4-b795-51c8449821ca req-90ff5df1-44f6-4961-a10a-d4798906bc49 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034681 Apr 07 13:32:01.589979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1403/2685] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:32:02.481100 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-69b0b522-5984-458e-bf31-2764e3e49b15 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:02.481714 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-69b0b522-5984-458e-bf31-2764e3e49b15 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:02.489488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-69b0b522-5984-458e-bf31-2764e3e49b15 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:02.489932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-69b0b522-5984-458e-bf31-2764e3e49b15 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:02.490710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-69b0b522-5984-458e-bf31-2764e3e49b15 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:02.491144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-69b0b522-5984-458e-bf31-2764e3e49b15 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:02.507236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-69b0b522-5984-458e-bf31-2764e3e49b15 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Instance e69bcaba-e90d-43a6-8f4d-5e3edd32358e could not be found. Apr 07 13:32:02.507844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-69b0b522-5984-458e-bf31-2764e3e49b15 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 404 to user: Instance e69bcaba-e90d-43a6-8f4d-5e3edd32358e could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:32:02.508719 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-69b0b522-5984-458e-bf31-2764e3e49b15 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 404 len: 111 microversion: 2.1 time: 0.031560 Apr 07 13:32:02.509279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1283/2686] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:02 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:32:02.518812 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0ae1f20f-aea3-41dc-94cb-c060fbc9cc38 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '.version_select at 0x7fde584744c0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:02.538511 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0ae1f20f-aea3-41dc-94cb-c060fbc9cc38 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790346795" status: 202 len: 0 microversion: 2.1 time: 0.024360 Apr 07 13:32:02.539506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1404/2687] 10.222.0.15 () {58 vars in 1220 bytes} [Thu Apr 7 13:32:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790346795 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:32:03.215240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e88c4598-69db-447e-b604-2ff4206f4f59 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:03.215757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e88c4598-69db-447e-b604-2ff4206f4f59 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:03.221733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e88c4598-69db-447e-b604-2ff4206f4f59 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:03.222181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e88c4598-69db-447e-b604-2ff4206f4f59 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:03.222930 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e88c4598-69db-447e-b604-2ff4206f4f59 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:03.223363 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e88c4598-69db-447e-b604-2ff4206f4f59 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:03.300276 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-e88c4598-69db-447e-b604-2ff4206f4f59 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lazy-loading 'services' on Instance uuid ef3f987d-04a9-4057-b8ef-370f57761259 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:32:03.378311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e88c4598-69db-447e-b604-2ff4206f4f59 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259/os-volume_attachments/994242a7-2b62-4bc4-888d-21e86c933d37" status: 202 len: 0 microversion: 2.1 time: 0.166722 Apr 07 13:32:03.378899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1284/2688] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:32:03 2022] DELETE /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259/os-volume_attachments/994242a7-2b62-4bc4-888d-21e86c933d37 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:32:03.387398 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fd901737-09dc-4a0d-9786-c9ea42cf8f84 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:03.388466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fd901737-09dc-4a0d-9786-c9ea42cf8f84 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:03.395776 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd901737-09dc-4a0d-9786-c9ea42cf8f84 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:03.396296 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd901737-09dc-4a0d-9786-c9ea42cf8f84 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:03.397162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd901737-09dc-4a0d-9786-c9ea42cf8f84 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:03.397598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fd901737-09dc-4a0d-9786-c9ea42cf8f84 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:03.426606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fd901737-09dc-4a0d-9786-c9ea42cf8f84 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Apr 07 13:32:03.427142 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1405/2689] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:32:03 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:32:04.439733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e9034608-b290-41b9-bd7d-c8192da9d8fd tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:04.440860 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e9034608-b290-41b9-bd7d-c8192da9d8fd tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:04.446961 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e9034608-b290-41b9-bd7d-c8192da9d8fd tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:04.447414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e9034608-b290-41b9-bd7d-c8192da9d8fd tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:04.448190 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e9034608-b290-41b9-bd7d-c8192da9d8fd tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:04.448627 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e9034608-b290-41b9-bd7d-c8192da9d8fd tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:04.476202 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e9034608-b290-41b9-bd7d-c8192da9d8fd tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041428 Apr 07 13:32:04.476745 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1285/2690] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:32:04 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 07 13:32:04.530967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-11ac4a3e-877f-44b4-ae58-1ce1ad9f0b22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:04.531479 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-11ac4a3e-877f-44b4-ae58-1ce1ad9f0b22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:04.538516 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11ac4a3e-877f-44b4-ae58-1ce1ad9f0b22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:04.538966 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11ac4a3e-877f-44b4-ae58-1ce1ad9f0b22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:04.539719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11ac4a3e-877f-44b4-ae58-1ce1ad9f0b22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:04.540180 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-11ac4a3e-877f-44b4-ae58-1ce1ad9f0b22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:04.563749 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-11ac4a3e-877f-44b4-ae58-1ce1ad9f0b22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:32:04.638961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-11ac4a3e-877f-44b4-ae58-1ce1ad9f0b22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 204 len: 0 microversion: 2.1 time: 0.111497 Apr 07 13:32:04.639544 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1406/2691] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:32:04 2022] DELETE /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:32:04.649054 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e2cb8dbc-80b2-454d-86a1-b9a5d067fd1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:04.649675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e2cb8dbc-80b2-454d-86a1-b9a5d067fd1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:04.655504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e2cb8dbc-80b2-454d-86a1-b9a5d067fd1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:04.655954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e2cb8dbc-80b2-454d-86a1-b9a5d067fd1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:04.656797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e2cb8dbc-80b2-454d-86a1-b9a5d067fd1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:04.657219 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e2cb8dbc-80b2-454d-86a1-b9a5d067fd1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:04.790565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e2cb8dbc-80b2-454d-86a1-b9a5d067fd1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:04.797892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e2cb8dbc-80b2-454d-86a1-b9a5d067fd1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 200 len: 1680 microversion: 2.1 time: 0.152735 Apr 07 13:32:04.799117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1286/2692] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:04 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:32:05.816042 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fe1142d2-10f0-409e-b1ae-0a063b5afa46 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:05.816818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fe1142d2-10f0-409e-b1ae-0a063b5afa46 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:05.823024 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe1142d2-10f0-409e-b1ae-0a063b5afa46 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:05.823471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe1142d2-10f0-409e-b1ae-0a063b5afa46 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:05.824261 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe1142d2-10f0-409e-b1ae-0a063b5afa46 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:05.824703 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fe1142d2-10f0-409e-b1ae-0a063b5afa46 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:06.063864 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fe1142d2-10f0-409e-b1ae-0a063b5afa46 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:06.071882 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fe1142d2-10f0-409e-b1ae-0a063b5afa46 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 200 len: 1680 microversion: 2.1 time: 0.260802 Apr 07 13:32:06.072494 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1407/2693] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:05 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 1680 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:06.290529 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-c559d275-0fb6-4973-86a1-4c7d79e743f1 req-3d200a8b-6ace-4e86-8418-9d259785d8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3f987d-04a9-4057-b8ef-370f57761259", "name": "network-vif-deleted", "tag": "f60ac850-6e0b-4144-bd3d-3318c926f6ba"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:32:06.300272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-c559d275-0fb6-4973-86a1-4c7d79e743f1 req-3d200a8b-6ace-4e86-8418-9d259785d8bd service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:06.300757 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-c559d275-0fb6-4973-86a1-4c7d79e743f1 req-3d200a8b-6ace-4e86-8418-9d259785d8bd service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:06.319912 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-c559d275-0fb6-4973-86a1-4c7d79e743f1 req-3d200a8b-6ace-4e86-8418-9d259785d8bd service nova] Creating event network-vif-deleted:f60ac850-6e0b-4144-bd3d-3318c926f6ba for instance ef3f987d-04a9-4057-b8ef-370f57761259 on hv-cinder-83694 Apr 07 13:32:06.325467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-c559d275-0fb6-4973-86a1-4c7d79e743f1 req-3d200a8b-6ace-4e86-8418-9d259785d8bd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038415 Apr 07 13:32:06.326369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1287/2694] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:32:07.089160 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a0e5aa60-9591-4598-bc0d-6c269f5f0c89 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:07.089779 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a0e5aa60-9591-4598-bc0d-6c269f5f0c89 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:07.096920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0e5aa60-9591-4598-bc0d-6c269f5f0c89 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:07.097364 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0e5aa60-9591-4598-bc0d-6c269f5f0c89 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:07.098130 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0e5aa60-9591-4598-bc0d-6c269f5f0c89 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:07.098559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a0e5aa60-9591-4598-bc0d-6c269f5f0c89 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:07.112218 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-a0e5aa60-9591-4598-bc0d-6c269f5f0c89 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Instance ef3f987d-04a9-4057-b8ef-370f57761259 could not be found. Apr 07 13:32:07.113128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a0e5aa60-9591-4598-bc0d-6c269f5f0c89 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 404 to user: Instance ef3f987d-04a9-4057-b8ef-370f57761259 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:32:07.113965 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a0e5aa60-9591-4598-bc0d-6c269f5f0c89 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 404 len: 111 microversion: 2.1 time: 0.028671 Apr 07 13:32:07.114524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1408/2695] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:07 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:32:07.123359 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-3e64e2d0-373a-41ca-94ae-2de8517b91ef tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '.version_select at 0x7fde5cd10310>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:07.143430 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-3e64e2d0-373a-41ca-94ae-2de8517b91ef tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391290786" status: 202 len: 0 microversion: 2.1 time: 0.024168 Apr 07 13:32:07.144022 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1288/2696] 10.222.0.15 () {58 vars in 1220 bytes} [Thu Apr 7 13:32:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391290786 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:32:07.776436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a15a2f13-f7d4-4adc-b560-5d471240bda0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: .version_select at 0x7fde583543a0>, body: {"keypair": {"name": "tempest-keypair-929426013"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:32:07.790826 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-a15a2f13-f7d4-4adc-b560-5d471240bda0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:32:07.794575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-a15a2f13-f7d4-4adc-b560-5d471240bda0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for user 16a8cd81c8064dc087a8f735cb0b78eb and project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:32:08.013956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-a15a2f13-f7d4-4adc-b560-5d471240bda0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:32:08.018378 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-a15a2f13-f7d4-4adc-b560-5d471240bda0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for user 16a8cd81c8064dc087a8f735cb0b78eb and project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:32:08.031000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a15a2f13-f7d4-4adc-b560-5d471240bda0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.258558 Apr 07 13:32:08.031599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1409/2697] 10.222.0.15 () {60 vars in 1157 bytes} [Thu Apr 7 13:32:07 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:09.296071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-146103a3-f42d-452b-a6b6-bb88626329a0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:09.296965 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-146103a3-f42d-452b-a6b6-bb88626329a0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:09.304530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-146103a3-f42d-452b-a6b6-bb88626329a0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:09.304988 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-146103a3-f42d-452b-a6b6-bb88626329a0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:09.305772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-146103a3-f42d-452b-a6b6-bb88626329a0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:09.306195 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-146103a3-f42d-452b-a6b6-bb88626329a0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:09.306600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1126015210", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e3eed74-adac-4076-a10b-beef7f6c6aa3"}], "security_groups": [{"name": "tempest-securitygroup--740270979"}], "key_name": "tempest-keypair-929426013", "user_data": "}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:32:09.335404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-146103a3-f42d-452b-a6b6-bb88626329a0 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043796 Apr 07 13:32:09.336561 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1289/2698] 10.222.0.15 () {60 vars in 1342 bytes} [Thu Apr 7 13:32:09 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:09.395349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0ae88b57-a107-4d6a-9627-42044b0b7192 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:09.395935 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0ae88b57-a107-4d6a-9627-42044b0b7192 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:09.401837 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ae88b57-a107-4d6a-9627-42044b0b7192 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:09.402364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ae88b57-a107-4d6a-9627-42044b0b7192 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:09.403132 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ae88b57-a107-4d6a-9627-42044b0b7192 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:09.403606 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0ae88b57-a107-4d6a-9627-42044b0b7192 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:09.412059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.network.neutron [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] validate_networks() for [('3e3eed74-adac-4076-a10b-beef7f6c6aa3', None, None, None, None, None)] {{(pid=116893) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 13:32:09.427870 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0ae88b57-a107-4d6a-9627-42044b0b7192 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Going to try to terminate instance {{(pid=116892) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:32:09.505545 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0ae88b57-a107-4d6a-9627-42044b0b7192 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 204 len: 0 microversion: 2.20 time: 0.114080 Apr 07 13:32:09.506701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1290/2699] 10.222.0.15 () {60 vars in 1279 bytes} [Thu Apr 7 13:32:09 2022] DELETE /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 07 13:32:09.515182 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-bfb45ff8-478c-46cb-8f7c-515724080e92 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:09.515891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-bfb45ff8-478c-46cb-8f7c-515724080e92 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:09.522109 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bfb45ff8-478c-46cb-8f7c-515724080e92 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:09.522520 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bfb45ff8-478c-46cb-8f7c-515724080e92 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:09.523301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bfb45ff8-478c-46cb-8f7c-515724080e92 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:09.523743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-bfb45ff8-478c-46cb-8f7c-515724080e92 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:09.805454 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Flavor limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 13:32:09.805879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Image limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 13:32:09.806356 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Flavor pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 13:32:09.806788 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Image pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 13:32:09.807201 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 13:32:09.816896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:09.817349 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:09.818176 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:09.818610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:09.835791 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:32:09.839719 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for user 16a8cd81c8064dc087a8f735cb0b78eb and project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:32:09.850926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Going to run 1 instances... {{(pid=116893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 13:32:09.853920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 13:32:09.901720 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bfb45ff8-478c-46cb-8f7c-515724080e92 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:09.903209 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3acfc481-d658-4a15-870d-87577196100e tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.600545 Apr 07 13:32:09.909040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1410/2700] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 13:32:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 07 13:32:09.910295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bfb45ff8-478c-46cb-8f7c-515724080e92 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:09.912033 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-bfb45ff8-478c-46cb-8f7c-515724080e92 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:09.913251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-bfb45ff8-478c-46cb-8f7c-515724080e92 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1721 microversion: 2.20 time: 0.402238 Apr 07 13:32:09.913803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1291/2701] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:32:09 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1721 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:32:09.920434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e684ef4c-712f-4deb-a5bc-50f83ede0262 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:09.920434 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e684ef4c-712f-4deb-a5bc-50f83ede0262 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:09.967409 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e684ef4c-712f-4deb-a5bc-50f83ede0262 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:09.974850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e684ef4c-712f-4deb-a5bc-50f83ede0262 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1241 microversion: 2.1 time: 0.064527 Apr 07 13:32:09.975455 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1411/2702] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:09 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:10.933217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-786550aa-f398-47f9-9c48-cc30f975fd80 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:10.933833 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-786550aa-f398-47f9-9c48-cc30f975fd80 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:10.941654 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-786550aa-f398-47f9-9c48-cc30f975fd80 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:10.942154 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-786550aa-f398-47f9-9c48-cc30f975fd80 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:10.943031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-786550aa-f398-47f9-9c48-cc30f975fd80 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:10.943511 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-786550aa-f398-47f9-9c48-cc30f975fd80 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:10.991905 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1ce5b4e3-a462-406f-a216-75c233b53b70 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:10.992558 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1ce5b4e3-a462-406f-a216-75c233b53b70 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:11.006771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ce5b4e3-a462-406f-a216-75c233b53b70 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:11.007233 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ce5b4e3-a462-406f-a216-75c233b53b70 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:11.008026 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ce5b4e3-a462-406f-a216-75c233b53b70 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:11.008524 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1ce5b4e3-a462-406f-a216-75c233b53b70 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:11.094198 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-786550aa-f398-47f9-9c48-cc30f975fd80 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:11.103652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-786550aa-f398-47f9-9c48-cc30f975fd80 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:11.106095 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-786550aa-f398-47f9-9c48-cc30f975fd80 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:11.107234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1ce5b4e3-a462-406f-a216-75c233b53b70 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:11.107777 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-786550aa-f398-47f9-9c48-cc30f975fd80 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1721 microversion: 2.20 time: 0.178148 Apr 07 13:32:11.108899 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1292/2703] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:32:10 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 13:32:11.119109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1ce5b4e3-a462-406f-a216-75c233b53b70 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1293 microversion: 2.1 time: 0.130844 Apr 07 13:32:11.120390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1412/2704] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:10 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1293 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:32:12.128288 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-81085499-196b-44ed-90a4-b87c3a1bc193 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:12.128896 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-81085499-196b-44ed-90a4-b87c3a1bc193 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:12.137838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1e53da4b-4017-4668-a078-d438418804c7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:12.138403 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81085499-196b-44ed-90a4-b87c3a1bc193 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:12.138799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81085499-196b-44ed-90a4-b87c3a1bc193 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:12.139570 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81085499-196b-44ed-90a4-b87c3a1bc193 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:12.139737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1e53da4b-4017-4668-a078-d438418804c7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:12.140409 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-81085499-196b-44ed-90a4-b87c3a1bc193 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:12.146733 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e53da4b-4017-4668-a078-d438418804c7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:12.147392 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e53da4b-4017-4668-a078-d438418804c7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:12.148466 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e53da4b-4017-4668-a078-d438418804c7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:12.148977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e53da4b-4017-4668-a078-d438418804c7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:12.206979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-81085499-196b-44ed-90a4-b87c3a1bc193 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:12.215387 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-81085499-196b-44ed-90a4-b87c3a1bc193 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:12.216944 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-81085499-196b-44ed-90a4-b87c3a1bc193 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1417845e6994b12a81febfff5e63ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd01388259c4fe2be6df63ac77c05c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:12.218121 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-81085499-196b-44ed-90a4-b87c3a1bc193 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 200 len: 1654 microversion: 2.20 time: 0.094579 Apr 07 13:32:12.228293 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1293/2705] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:32:12 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 1654 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 13:32:12.261896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-1e53da4b-4017-4668-a078-d438418804c7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:12.270594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1e53da4b-4017-4668-a078-d438418804c7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1299 microversion: 2.1 time: 0.136911 Apr 07 13:32:12.271174 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1413/2706] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:12 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1299 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:32:12.761849 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-a9b0193b-4138-4aa3-828d-bcba8648afe8 req-3cb582a8-b240-466b-8b6f-fd460fa9b883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac028ff8-ee5a-47e9-80b2-6633beac4e3f", "name": "network-vif-deleted", "tag": "10915de2-db85-43a4-a04e-e11c60542301"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:32:12.778817 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-a9b0193b-4138-4aa3-828d-bcba8648afe8 req-3cb582a8-b240-466b-8b6f-fd460fa9b883 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:12.781112 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-a9b0193b-4138-4aa3-828d-bcba8648afe8 req-3cb582a8-b240-466b-8b6f-fd460fa9b883 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:12.808503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-a9b0193b-4138-4aa3-828d-bcba8648afe8 req-3cb582a8-b240-466b-8b6f-fd460fa9b883 service nova] Creating event network-vif-deleted:10915de2-db85-43a4-a04e-e11c60542301 for instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f on hv-cinder-83694 Apr 07 13:32:12.833652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-a9b0193b-4138-4aa3-828d-bcba8648afe8 req-3cb582a8-b240-466b-8b6f-fd460fa9b883 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083672 Apr 07 13:32:12.835226 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1294/2707] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:32:13.239460 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ff500108-d21f-4fbd-9013-189b3a225a1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:13.240078 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ff500108-d21f-4fbd-9013-189b3a225a1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:13.246711 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff500108-d21f-4fbd-9013-189b3a225a1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:13.247165 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff500108-d21f-4fbd-9013-189b3a225a1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:13.247940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff500108-d21f-4fbd-9013-189b3a225a1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:13.248405 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ff500108-d21f-4fbd-9013-189b3a225a1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:13.281475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-ff500108-d21f-4fbd-9013-189b3a225a1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] HTTP exception thrown: Instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f could not be found. Apr 07 13:32:13.282002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ff500108-d21f-4fbd-9013-189b3a225a1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Returning 404 to user: Instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:32:13.289619 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e1950f2f-3b43-4260-8c6f-c7f4a3c1a099 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:13.290328 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e1950f2f-3b43-4260-8c6f-c7f4a3c1a099 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:13.300831 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ff500108-d21f-4fbd-9013-189b3a225a1d tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 404 len: 111 microversion: 2.20 time: 0.067667 Apr 07 13:32:13.301410 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1414/2708] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:32:13 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:32:13.310731 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a65e6e13-a965-4168-8575-474c2b20a2f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '.version_select at 0x7fde583543a0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:13.312576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1950f2f-3b43-4260-8c6f-c7f4a3c1a099 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:13.314885 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1950f2f-3b43-4260-8c6f-c7f4a3c1a099 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:13.315752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1950f2f-3b43-4260-8c6f-c7f4a3c1a099 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:13.316224 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e1950f2f-3b43-4260-8c6f-c7f4a3c1a099 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:13.334989 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a65e6e13-a965-4168-8575-474c2b20a2f7 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-182696521" status: 204 len: 0 microversion: 2.20 time: 0.028476 Apr 07 13:32:13.338918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1415/2709] 10.222.0.15 () {60 vars in 1258 bytes} [Thu Apr 7 13:32:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-182696521 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 07 13:32:13.555850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e1950f2f-3b43-4260-8c6f-c7f4a3c1a099 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:13.577264 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e1950f2f-3b43-4260-8c6f-c7f4a3c1a099 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1366 microversion: 2.1 time: 0.292296 Apr 07 13:32:13.589784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1295/2710] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:13 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:14.594569 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9ca2d12a-9e64-4873-9a18-ec9a92842a81 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:14.595925 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9ca2d12a-9e64-4873-9a18-ec9a92842a81 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:14.602609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9ca2d12a-9e64-4873-9a18-ec9a92842a81 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:14.603066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9ca2d12a-9e64-4873-9a18-ec9a92842a81 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:14.603833 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9ca2d12a-9e64-4873-9a18-ec9a92842a81 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:14.604346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9ca2d12a-9e64-4873-9a18-ec9a92842a81 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:14.738360 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9ca2d12a-9e64-4873-9a18-ec9a92842a81 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:14.745483 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9ca2d12a-9e64-4873-9a18-ec9a92842a81 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1366 microversion: 2.1 time: 0.155337 Apr 07 13:32:14.746035 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1416/2711] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:14 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:14.869078 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-f9ec9963-11da-4d81-b089-52c466a3b366 req-fa080cdb-0daa-44e3-9323-1e383f2bfea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7ac683-4532-49fa-a88d-3299f1c324d3", "tag": "b0a84d20-dfad-47a4-9796-93f407957e0d"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:32:14.877826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-f9ec9963-11da-4d81-b089-52c466a3b366 req-fa080cdb-0daa-44e3-9323-1e383f2bfea4 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:14.878269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-f9ec9963-11da-4d81-b089-52c466a3b366 req-fa080cdb-0daa-44e3-9323-1e383f2bfea4 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:14.888718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-f9ec9963-11da-4d81-b089-52c466a3b366 req-fa080cdb-0daa-44e3-9323-1e383f2bfea4 service nova] Creating event network-changed:b0a84d20-dfad-47a4-9796-93f407957e0d for instance 7b7ac683-4532-49fa-a88d-3299f1c324d3 on hv-cinder-83694 Apr 07 13:32:14.893638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-f9ec9963-11da-4d81-b089-52c466a3b366 req-fa080cdb-0daa-44e3-9323-1e383f2bfea4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028265 Apr 07 13:32:14.894236 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1296/2712] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:32:15.364055 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3bbc92da-5778-4a0a-92ca-b3464d67d679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:15.364581 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-3bbc92da-5778-4a0a-92ca-b3464d67d679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:15.370306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bbc92da-5778-4a0a-92ca-b3464d67d679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:15.370757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bbc92da-5778-4a0a-92ca-b3464d67d679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:15.371514 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bbc92da-5778-4a0a-92ca-b3464d67d679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:15.371949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-3bbc92da-5778-4a0a-92ca-b3464d67d679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:15.385683 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-3bbc92da-5778-4a0a-92ca-b3464d67d679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] HTTP exception thrown: Instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f could not be found. Apr 07 13:32:15.386275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-3bbc92da-5778-4a0a-92ca-b3464d67d679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Returning 404 to user: Instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:32:15.387107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-3bbc92da-5778-4a0a-92ca-b3464d67d679 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 404 len: 111 microversion: 2.20 time: 0.026928 Apr 07 13:32:15.387658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1417/2713] 10.222.0.15 () {60 vars in 1279 bytes} [Thu Apr 7 13:32:15 2022] DELETE /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:32:15.397488 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2ff73744-f24f-42ed-9ca8-f5fdd97bb58f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:15.398117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2ff73744-f24f-42ed-9ca8-f5fdd97bb58f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: ac028ff8-ee5a-47e9-80b2-6633beac4e3f] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:15.404072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2ff73744-f24f-42ed-9ca8-f5fdd97bb58f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:15.404548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2ff73744-f24f-42ed-9ca8-f5fdd97bb58f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:15.405407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2ff73744-f24f-42ed-9ca8-f5fdd97bb58f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:15.405883 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2ff73744-f24f-42ed-9ca8-f5fdd97bb58f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:15.419747 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-2ff73744-f24f-42ed-9ca8-f5fdd97bb58f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] HTTP exception thrown: Instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f could not be found. Apr 07 13:32:15.420359 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2ff73744-f24f-42ed-9ca8-f5fdd97bb58f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Returning 404 to user: Instance ac028ff8-ee5a-47e9-80b2-6633beac4e3f could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:32:15.421160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2ff73744-f24f-42ed-9ca8-f5fdd97bb58f tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f" status: 404 len: 111 microversion: 2.20 time: 0.028453 Apr 07 13:32:15.421668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1297/2714] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:32:15 2022] GET /compute/v2.1/servers/ac028ff8-ee5a-47e9-80b2-6633beac4e3f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 07 13:32:15.762736 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0831ed21-6150-47c1-9abb-47aa28e05904 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:15.763284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0831ed21-6150-47c1-9abb-47aa28e05904 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:15.769835 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0831ed21-6150-47c1-9abb-47aa28e05904 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:15.770291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0831ed21-6150-47c1-9abb-47aa28e05904 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:15.771084 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0831ed21-6150-47c1-9abb-47aa28e05904 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:15.771497 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0831ed21-6150-47c1-9abb-47aa28e05904 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:15.908501 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0831ed21-6150-47c1-9abb-47aa28e05904 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:15.915884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0831ed21-6150-47c1-9abb-47aa28e05904 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1366 microversion: 2.1 time: 0.157072 Apr 07 13:32:15.916475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1418/2715] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:15 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:16.933357 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4004895d-b169-45e5-b062-5a94a11a298c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:16.934108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4004895d-b169-45e5-b062-5a94a11a298c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:16.940916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4004895d-b169-45e5-b062-5a94a11a298c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:16.941367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4004895d-b169-45e5-b062-5a94a11a298c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:16.942119 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4004895d-b169-45e5-b062-5a94a11a298c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:16.942553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4004895d-b169-45e5-b062-5a94a11a298c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:17.073671 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4004895d-b169-45e5-b062-5a94a11a298c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:17.081491 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4004895d-b169-45e5-b062-5a94a11a298c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1366 microversion: 2.1 time: 0.151940 Apr 07 13:32:17.082048 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1298/2716] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:16 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:18.098811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e5daa25b-68f5-4a02-bac8-8ffc6bc63c5a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:18.099429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e5daa25b-68f5-4a02-bac8-8ffc6bc63c5a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:18.105699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e5daa25b-68f5-4a02-bac8-8ffc6bc63c5a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:18.106152 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e5daa25b-68f5-4a02-bac8-8ffc6bc63c5a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:18.106904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e5daa25b-68f5-4a02-bac8-8ffc6bc63c5a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:18.107345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e5daa25b-68f5-4a02-bac8-8ffc6bc63c5a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:18.242585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e5daa25b-68f5-4a02-bac8-8ffc6bc63c5a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:18.249875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e5daa25b-68f5-4a02-bac8-8ffc6bc63c5a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1366 microversion: 2.1 time: 0.155707 Apr 07 13:32:18.250445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1419/2717] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:18 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:19.266544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-075b4a58-abe7-47f6-af74-06aee4f02cc0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:19.267278 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-075b4a58-abe7-47f6-af74-06aee4f02cc0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:19.273802 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-075b4a58-abe7-47f6-af74-06aee4f02cc0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:19.274263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-075b4a58-abe7-47f6-af74-06aee4f02cc0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:19.275034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-075b4a58-abe7-47f6-af74-06aee4f02cc0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:19.275554 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-075b4a58-abe7-47f6-af74-06aee4f02cc0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:19.405681 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-075b4a58-abe7-47f6-af74-06aee4f02cc0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:19.413641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-075b4a58-abe7-47f6-af74-06aee4f02cc0 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1366 microversion: 2.1 time: 0.150928 Apr 07 13:32:19.414207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1299/2718] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:19 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:19.950841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-47b393b5-5d34-4672-8894-0750324a03cc req-6a59ccee-fd5e-4857-8040-134e7c077d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7ac683-4532-49fa-a88d-3299f1c324d3", "name": "network-vif-plugged", "status": "completed", "tag": "b0a84d20-dfad-47a4-9796-93f407957e0d"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:32:19.960755 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-47b393b5-5d34-4672-8894-0750324a03cc req-6a59ccee-fd5e-4857-8040-134e7c077d6d service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:19.961269 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-47b393b5-5d34-4672-8894-0750324a03cc req-6a59ccee-fd5e-4857-8040-134e7c077d6d service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:19.973330 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-47b393b5-5d34-4672-8894-0750324a03cc req-6a59ccee-fd5e-4857-8040-134e7c077d6d service nova] Creating event network-vif-plugged:b0a84d20-dfad-47a4-9796-93f407957e0d for instance 7b7ac683-4532-49fa-a88d-3299f1c324d3 on hv-cinder-83694 Apr 07 13:32:19.978446 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-47b393b5-5d34-4672-8894-0750324a03cc req-6a59ccee-fd5e-4857-8040-134e7c077d6d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031233 Apr 07 13:32:19.979206 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1420/2719] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:32:20.430503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-408dd4e7-4197-4960-bbe2-6400b3c27143 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:20.431041 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-408dd4e7-4197-4960-bbe2-6400b3c27143 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:20.437296 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-408dd4e7-4197-4960-bbe2-6400b3c27143 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:20.437749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-408dd4e7-4197-4960-bbe2-6400b3c27143 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:20.438676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-408dd4e7-4197-4960-bbe2-6400b3c27143 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:20.439197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-408dd4e7-4197-4960-bbe2-6400b3c27143 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:20.574283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-408dd4e7-4197-4960-bbe2-6400b3c27143 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:20.583027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-408dd4e7-4197-4960-bbe2-6400b3c27143 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1366 microversion: 2.1 time: 0.155922 Apr 07 13:32:20.583148 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1300/2720] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:20 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:21.600996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a8793a4b-44ff-4d55-8b59-95ac3c4a21e8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:21.601741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a8793a4b-44ff-4d55-8b59-95ac3c4a21e8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:21.607749 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a8793a4b-44ff-4d55-8b59-95ac3c4a21e8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:21.608227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a8793a4b-44ff-4d55-8b59-95ac3c4a21e8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:21.608981 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a8793a4b-44ff-4d55-8b59-95ac3c4a21e8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:21.609417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a8793a4b-44ff-4d55-8b59-95ac3c4a21e8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:21.745969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a8793a4b-44ff-4d55-8b59-95ac3c4a21e8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:21.754332 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a8793a4b-44ff-4d55-8b59-95ac3c4a21e8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1366 microversion: 2.1 time: 0.158104 Apr 07 13:32:21.754890 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1421/2721] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:21 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:22.771327 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ad9cac29-dcb0-4cdf-96a1-bd0ad8ce4731 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:22.772057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ad9cac29-dcb0-4cdf-96a1-bd0ad8ce4731 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:22.778322 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad9cac29-dcb0-4cdf-96a1-bd0ad8ce4731 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:22.778776 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad9cac29-dcb0-4cdf-96a1-bd0ad8ce4731 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:22.779551 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad9cac29-dcb0-4cdf-96a1-bd0ad8ce4731 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:22.780012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ad9cac29-dcb0-4cdf-96a1-bd0ad8ce4731 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:23.051217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ad9cac29-dcb0-4cdf-96a1-bd0ad8ce4731 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:32:23.058481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ad9cac29-dcb0-4cdf-96a1-bd0ad8ce4731 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1555 microversion: 2.1 time: 0.291649 Apr 07 13:32:23.059032 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1301/2722] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:32:22 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1555 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:32:23.074501 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-13c07be8-19d8-406d-824d-ac5f78db703f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:23.075000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-13c07be8-19d8-406d-824d-ac5f78db703f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:23.081690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13c07be8-19d8-406d-824d-ac5f78db703f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:23.082143 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13c07be8-19d8-406d-824d-ac5f78db703f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:23.082904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13c07be8-19d8-406d-824d-ac5f78db703f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:23.083343 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-13c07be8-19d8-406d-824d-ac5f78db703f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:23.170113 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-13c07be8-19d8-406d-824d-ac5f78db703f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099487 Apr 07 13:32:23.170714 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1422/2723] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Apr 7 13:32:23 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:32:24.397329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-8bfb917f-d06b-4028-8b69-808435c78ed4 req-ce0ed3e4-bc4e-4204-9afb-b3612af33bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7ac683-4532-49fa-a88d-3299f1c324d3", "tag": "b0a84d20-dfad-47a4-9796-93f407957e0d"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:32:24.405705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-8bfb917f-d06b-4028-8b69-808435c78ed4 req-ce0ed3e4-bc4e-4204-9afb-b3612af33bd5 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:24.406135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-8bfb917f-d06b-4028-8b69-808435c78ed4 req-ce0ed3e4-bc4e-4204-9afb-b3612af33bd5 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:24.417548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-8bfb917f-d06b-4028-8b69-808435c78ed4 req-ce0ed3e4-bc4e-4204-9afb-b3612af33bd5 service nova] Creating event network-changed:b0a84d20-dfad-47a4-9796-93f407957e0d for instance 7b7ac683-4532-49fa-a88d-3299f1c324d3 on hv-cinder-83694 Apr 07 13:32:24.422588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-8bfb917f-d06b-4028-8b69-808435c78ed4 req-ce0ed3e4-bc4e-4204-9afb-b3612af33bd5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029016 Apr 07 13:32:24.423897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1302/2724] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:32:58.305802 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2c93167f-e45d-4ed5-aa0b-0a39b43fb861 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:32:58.306458 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2c93167f-e45d-4ed5-aa0b-0a39b43fb861 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:58.312204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c93167f-e45d-4ed5-aa0b-0a39b43fb861 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:58.313291 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c93167f-e45d-4ed5-aa0b-0a39b43fb861 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:58.314077 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c93167f-e45d-4ed5-aa0b-0a39b43fb861 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:58.314536 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2c93167f-e45d-4ed5-aa0b-0a39b43fb861 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:58.336407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2c93167f-e45d-4ed5-aa0b-0a39b43fb861 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/ips" status: 200 len: 148 microversion: 2.1 time: 0.034948 Apr 07 13:32:58.336955 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1423/2725] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Apr 7 13:32:58 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/ips => generated 148 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:32:59.641459 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1f57ddab-a66c-4ae3-b322-6a1e46388888 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e5d3c1c-321b-4612-bf50-c12f3751f2a1"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:32:59.642617 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1f57ddab-a66c-4ae3-b322-6a1e46388888 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:32:59.648898 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f57ddab-a66c-4ae3-b322-6a1e46388888 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:59.649361 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f57ddab-a66c-4ae3-b322-6a1e46388888 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:59.650128 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f57ddab-a66c-4ae3-b322-6a1e46388888 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:32:59.650572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f57ddab-a66c-4ae3-b322-6a1e46388888 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:32:59.879894 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1f57ddab-a66c-4ae3-b322-6a1e46388888 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242714 Apr 07 13:32:59.880528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1303/2726] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Apr 7 13:32:59 2022] POST /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:33:06.314575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-af735a0f-4688-4197-8399-09d7cb73917c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e5d3c1c-321b-4612-bf50-c12f3751f2a1"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:33:06.315639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-af735a0f-4688-4197-8399-09d7cb73917c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:06.322002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-af735a0f-4688-4197-8399-09d7cb73917c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:06.322461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-af735a0f-4688-4197-8399-09d7cb73917c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:06.323223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-af735a0f-4688-4197-8399-09d7cb73917c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:06.323661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-af735a0f-4688-4197-8399-09d7cb73917c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:06.449424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-af735a0f-4688-4197-8399-09d7cb73917c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Invalid volume: volume 1e5d3c1c-321b-4612-bf50-c12f3751f2a1 is already attached to instances: 7b7ac683-4532-49fa-a88d-3299f1c324d3 Apr 07 13:33:06.450059 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-af735a0f-4688-4197-8399-09d7cb73917c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 400 to user: Invalid volume: volume 1e5d3c1c-321b-4612-bf50-c12f3751f2a1 is already attached to instances: 7b7ac683-4532-49fa-a88d-3299f1c324d3 {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:33:06.450925 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-af735a0f-4688-4197-8399-09d7cb73917c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.140942 Apr 07 13:33:06.451461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1424/2727] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Apr 7 13:33:06 2022] POST /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/os-volume_attachments => generated 174 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:33:06.511604 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4d61b1be-aedb-4ab0-87f3-06ab6db524b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:06.512210 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4d61b1be-aedb-4ab0-87f3-06ab6db524b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:06.518801 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4d61b1be-aedb-4ab0-87f3-06ab6db524b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:06.519260 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4d61b1be-aedb-4ab0-87f3-06ab6db524b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:06.520026 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4d61b1be-aedb-4ab0-87f3-06ab6db524b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:06.520505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4d61b1be-aedb-4ab0-87f3-06ab6db524b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:06.599174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-4d61b1be-aedb-4ab0-87f3-06ab6db524b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lazy-loading 'services' on Instance uuid 7b7ac683-4532-49fa-a88d-3299f1c324d3 {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:33:06.669754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4d61b1be-aedb-4ab0-87f3-06ab6db524b8 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/os-volume_attachments/1e5d3c1c-321b-4612-bf50-c12f3751f2a1" status: 202 len: 0 microversion: 2.1 time: 0.162670 Apr 07 13:33:06.670575 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1304/2728] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:33:06 2022] DELETE /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/os-volume_attachments/1e5d3c1c-321b-4612-bf50-c12f3751f2a1 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:33:06.679741 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-78a19111-07d8-452e-99ed-d31f3f30b52c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:06.680701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-78a19111-07d8-452e-99ed-d31f3f30b52c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:06.687814 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-78a19111-07d8-452e-99ed-d31f3f30b52c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:06.688609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-78a19111-07d8-452e-99ed-d31f3f30b52c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:06.689294 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-78a19111-07d8-452e-99ed-d31f3f30b52c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:06.690298 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-78a19111-07d8-452e-99ed-d31f3f30b52c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:06.722170 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-78a19111-07d8-452e-99ed-d31f3f30b52c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046480 Apr 07 13:33:06.722748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1425/2729] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:33:06 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:33:07.735985 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-0277a362-bb6e-4aef-a65c-4b65542e5bf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:07.737077 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-0277a362-bb6e-4aef-a65c-4b65542e5bf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:07.743576 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0277a362-bb6e-4aef-a65c-4b65542e5bf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:07.744024 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0277a362-bb6e-4aef-a65c-4b65542e5bf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:07.744814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0277a362-bb6e-4aef-a65c-4b65542e5bf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:07.745249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-0277a362-bb6e-4aef-a65c-4b65542e5bf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:07.773108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-0277a362-bb6e-4aef-a65c-4b65542e5bf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043032 Apr 07 13:33:07.773645 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1305/2730] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:33:07 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 07 13:33:07.830928 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-587802ad-26b5-47e2-8036-5f773af2c3a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:07.831411 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-587802ad-26b5-47e2-8036-5f773af2c3a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:07.838552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-587802ad-26b5-47e2-8036-5f773af2c3a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:07.838945 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-587802ad-26b5-47e2-8036-5f773af2c3a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:07.839721 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-587802ad-26b5-47e2-8036-5f773af2c3a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:07.840426 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-587802ad-26b5-47e2-8036-5f773af2c3a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:07.866936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-587802ad-26b5-47e2-8036-5f773af2c3a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:33:07.942486 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-587802ad-26b5-47e2-8036-5f773af2c3a4 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 204 len: 0 microversion: 2.1 time: 0.115503 Apr 07 13:33:07.943109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1426/2731] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:33:07 2022] DELETE /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:33:07.951517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-af9c865e-af28-4e53-9be4-a068971f8e58 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:07.952150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-af9c865e-af28-4e53-9be4-a068971f8e58 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:07.958477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-af9c865e-af28-4e53-9be4-a068971f8e58 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:07.958932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-af9c865e-af28-4e53-9be4-a068971f8e58 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:07.959718 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-af9c865e-af28-4e53-9be4-a068971f8e58 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:07.960190 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-af9c865e-af28-4e53-9be4-a068971f8e58 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:08.097145 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-af9c865e-af28-4e53-9be4-a068971f8e58 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:08.104499 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-af9c865e-af28-4e53-9be4-a068971f8e58 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1679 microversion: 2.1 time: 0.156883 Apr 07 13:33:08.105059 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1306/2732] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:07 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:09.122257 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e297f23d-9a04-46f5-a2bf-853b2d469d73 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:09.122878 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-e297f23d-9a04-46f5-a2bf-853b2d469d73 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:09.129708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e297f23d-9a04-46f5-a2bf-853b2d469d73 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:09.130161 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e297f23d-9a04-46f5-a2bf-853b2d469d73 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:09.130938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e297f23d-9a04-46f5-a2bf-853b2d469d73 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:09.131469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-e297f23d-9a04-46f5-a2bf-853b2d469d73 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:09.264240 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-e297f23d-9a04-46f5-a2bf-853b2d469d73 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:09.273476 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e297f23d-9a04-46f5-a2bf-853b2d469d73 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1679 microversion: 2.1 time: 0.155332 Apr 07 13:33:09.274036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1427/2733] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:09 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:10.292074 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-504e1ed6-c43a-4524-bc11-82fc5f90c246 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:10.292724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-504e1ed6-c43a-4524-bc11-82fc5f90c246 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:10.301792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-504e1ed6-c43a-4524-bc11-82fc5f90c246 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:10.302246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-504e1ed6-c43a-4524-bc11-82fc5f90c246 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:10.303032 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-504e1ed6-c43a-4524-bc11-82fc5f90c246 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:10.303475 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-504e1ed6-c43a-4524-bc11-82fc5f90c246 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:10.305101 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-53157d55-778d-40d3-b0c0-927f63295c2b req-ce165313-e68f-4b51-8c6d-3fbed684c8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7ac683-4532-49fa-a88d-3299f1c324d3", "name": "network-vif-deleted", "tag": "b0a84d20-dfad-47a4-9796-93f407957e0d"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:33:10.316503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-53157d55-778d-40d3-b0c0-927f63295c2b req-ce165313-e68f-4b51-8c6d-3fbed684c8a6 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:10.316948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-53157d55-778d-40d3-b0c0-927f63295c2b req-ce165313-e68f-4b51-8c6d-3fbed684c8a6 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:10.330918 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-53157d55-778d-40d3-b0c0-927f63295c2b req-ce165313-e68f-4b51-8c6d-3fbed684c8a6 service nova] Creating event network-vif-deleted:b0a84d20-dfad-47a4-9796-93f407957e0d for instance 7b7ac683-4532-49fa-a88d-3299f1c324d3 on hv-cinder-83694 Apr 07 13:33:10.336499 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-53157d55-778d-40d3-b0c0-927f63295c2b req-ce165313-e68f-4b51-8c6d-3fbed684c8a6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036829 Apr 07 13:33:10.342394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1428/2734] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:33:10.398487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-504e1ed6-c43a-4524-bc11-82fc5f90c246 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:10.408864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-504e1ed6-c43a-4524-bc11-82fc5f90c246 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 200 len: 1612 microversion: 2.1 time: 0.121761 Apr 07 13:33:10.418556 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1307/2735] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:10 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 1612 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:11.429799 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-675d4cc0-5d0a-4b5a-87db-1bc667e7ca25 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:11.430499 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-675d4cc0-5d0a-4b5a-87db-1bc667e7ca25 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:11.436693 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-675d4cc0-5d0a-4b5a-87db-1bc667e7ca25 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:11.437922 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-675d4cc0-5d0a-4b5a-87db-1bc667e7ca25 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:11.438548 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-675d4cc0-5d0a-4b5a-87db-1bc667e7ca25 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:11.438985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-675d4cc0-5d0a-4b5a-87db-1bc667e7ca25 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:11.451642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-675d4cc0-5d0a-4b5a-87db-1bc667e7ca25 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Instance 7b7ac683-4532-49fa-a88d-3299f1c324d3 could not be found. Apr 07 13:33:11.452247 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-675d4cc0-5d0a-4b5a-87db-1bc667e7ca25 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 404 to user: Instance 7b7ac683-4532-49fa-a88d-3299f1c324d3 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:33:11.453904 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-675d4cc0-5d0a-4b5a-87db-1bc667e7ca25 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 404 len: 111 microversion: 2.1 time: 0.028803 Apr 07 13:33:11.454419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1429/2736] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:11 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:33:11.462670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-284d2034-f2e3-46fd-8804-fe8e651cfff5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '.version_select at 0x7fde5cd3cdc0>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:11.485588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-284d2034-f2e3-46fd-8804-fe8e651cfff5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-929426013" status: 202 len: 0 microversion: 2.1 time: 0.026748 Apr 07 13:33:11.486159 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1308/2737] 10.222.0.15 () {58 vars in 1217 bytes} [Thu Apr 7 13:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-929426013 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:33:12.096545 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cb8c3819-3798-4866-b6ba-02d9243f8e22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: .version_select at 0x7fde583f89d0>, body: {"keypair": {"name": "tempest-keypair-45521615"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:33:12.110255 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-cb8c3819-3798-4866-b6ba-02d9243f8e22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:33:12.113994 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-cb8c3819-3798-4866-b6ba-02d9243f8e22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for user 16a8cd81c8064dc087a8f735cb0b78eb and project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:33:12.235821 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-cb8c3819-3798-4866-b6ba-02d9243f8e22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:33:12.239407 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-cb8c3819-3798-4866-b6ba-02d9243f8e22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for user 16a8cd81c8064dc087a8f735cb0b78eb and project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:33:12.252752 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cb8c3819-3798-4866-b6ba-02d9243f8e22 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.160049 Apr 07 13:33:12.253339 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1430/2738] 10.222.0.15 () {60 vars in 1157 bytes} [Thu Apr 7 13:33:12 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:13.464887 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1882073632", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e3eed74-adac-4076-a10b-beef7f6c6aa3"}], "security_groups": [{"name": "tempest-securitygroup--1087043450"}], "key_name": "tempest-keypair-45521615", "user_data": "}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:33:13.565125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.network.neutron [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] validate_networks() for [('3e3eed74-adac-4076-a10b-beef7f6c6aa3', None, None, None, None, None)] {{(pid=116892) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 13:33:13.966537 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Flavor limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 13:33:13.966966 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Image limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 13:33:13.967449 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Flavor pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 13:33:13.967900 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Image pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 13:33:13.968953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 13:33:13.977729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:13.978187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:13.978992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:13.979435 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:14.000555 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:33:14.004481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Getting quotas for user 16a8cd81c8064dc087a8f735cb0b78eb and project f250cd57cd0e4f5bbc3ca304eecb7e21. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:33:14.016444 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Going to run 1 instances... {{(pid=116892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 13:33:14.018743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 13:33:14.066464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-874da856-ec63-40b1-b35f-af893a831782 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606282 Apr 07 13:33:14.067334 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1309/2739] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 13:33:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 13:33:14.078188 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d452802e-bbbb-439b-b662-44ad83f56673 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:14.078810 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d452802e-bbbb-439b-b662-44ad83f56673 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:14.133236 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d452802e-bbbb-439b-b662-44ad83f56673 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:14.142658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d452802e-bbbb-439b-b662-44ad83f56673 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1240 microversion: 2.1 time: 0.069378 Apr 07 13:33:14.143223 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1431/2740] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:14 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:15.160230 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4ed12dbe-40c2-45d4-9a6e-20a06ecf0b1a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:15.160948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4ed12dbe-40c2-45d4-9a6e-20a06ecf0b1a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:15.167601 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ed12dbe-40c2-45d4-9a6e-20a06ecf0b1a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:15.168174 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ed12dbe-40c2-45d4-9a6e-20a06ecf0b1a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:15.169057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ed12dbe-40c2-45d4-9a6e-20a06ecf0b1a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:15.169596 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4ed12dbe-40c2-45d4-9a6e-20a06ecf0b1a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:15.236288 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4ed12dbe-40c2-45d4-9a6e-20a06ecf0b1a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:15.243514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4ed12dbe-40c2-45d4-9a6e-20a06ecf0b1a tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1298 microversion: 2.1 time: 0.088392 Apr 07 13:33:15.244085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1310/2741] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:15 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:16.261087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d544e98a-1cf0-4476-8cc0-26701a3c2925 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:16.262008 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d544e98a-1cf0-4476-8cc0-26701a3c2925 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:16.269275 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d544e98a-1cf0-4476-8cc0-26701a3c2925 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:16.269730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d544e98a-1cf0-4476-8cc0-26701a3c2925 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:16.270502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d544e98a-1cf0-4476-8cc0-26701a3c2925 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:16.271145 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d544e98a-1cf0-4476-8cc0-26701a3c2925 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:16.381114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-1d635575-0ff5-4145-ad20-a31039540de6 req-b8159296-ba2c-4392-a528-1c261a32cb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c49028-8a42-49ef-9290-0bba9c55a822", "tag": "ebcc38ca-f7e6-4988-9f97-ae3349937509"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:33:16.402847 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-1d635575-0ff5-4145-ad20-a31039540de6 req-b8159296-ba2c-4392-a528-1c261a32cb2e service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:16.403823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-1d635575-0ff5-4145-ad20-a31039540de6 req-b8159296-ba2c-4392-a528-1c261a32cb2e service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:16.423479 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-1d635575-0ff5-4145-ad20-a31039540de6 req-b8159296-ba2c-4392-a528-1c261a32cb2e service nova] Creating event network-changed:ebcc38ca-f7e6-4988-9f97-ae3349937509 for instance e2c49028-8a42-49ef-9290-0bba9c55a822 on hv-cinder-83694 Apr 07 13:33:16.430132 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-1d635575-0ff5-4145-ad20-a31039540de6 req-b8159296-ba2c-4392-a528-1c261a32cb2e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053184 Apr 07 13:33:16.431079 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1311/2742] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:33:16.504714 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d544e98a-1cf0-4476-8cc0-26701a3c2925 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:16.513781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d544e98a-1cf0-4476-8cc0-26701a3c2925 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1366 microversion: 2.1 time: 0.256478 Apr 07 13:33:16.514730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1432/2743] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:16 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:17.532272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-37eb15c1-6740-41fd-9219-6e07258f0ebe tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:17.532978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-37eb15c1-6740-41fd-9219-6e07258f0ebe tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:17.539667 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-37eb15c1-6740-41fd-9219-6e07258f0ebe tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:17.540114 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-37eb15c1-6740-41fd-9219-6e07258f0ebe tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:17.540895 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-37eb15c1-6740-41fd-9219-6e07258f0ebe tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:17.541336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-37eb15c1-6740-41fd-9219-6e07258f0ebe tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:17.684460 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-37eb15c1-6740-41fd-9219-6e07258f0ebe tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:17.692789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-37eb15c1-6740-41fd-9219-6e07258f0ebe tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1366 microversion: 2.1 time: 0.165093 Apr 07 13:33:17.693364 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1312/2744] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:17 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:18.708928 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-ca6d1529-0240-4d1d-a184-fb1f0ee09994 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:18.709526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-ca6d1529-0240-4d1d-a184-fb1f0ee09994 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:18.715790 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ca6d1529-0240-4d1d-a184-fb1f0ee09994 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:18.716280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ca6d1529-0240-4d1d-a184-fb1f0ee09994 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:18.717030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ca6d1529-0240-4d1d-a184-fb1f0ee09994 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:18.717461 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-ca6d1529-0240-4d1d-a184-fb1f0ee09994 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:18.846416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-ca6d1529-0240-4d1d-a184-fb1f0ee09994 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:18.853506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-ca6d1529-0240-4d1d-a184-fb1f0ee09994 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1366 microversion: 2.1 time: 0.148491 Apr 07 13:33:18.854056 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1433/2745] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:18 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:19.870527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-48524937-4b36-4ee3-9f43-99d9ba286834 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:19.871141 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-48524937-4b36-4ee3-9f43-99d9ba286834 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:19.878037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48524937-4b36-4ee3-9f43-99d9ba286834 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:19.878486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48524937-4b36-4ee3-9f43-99d9ba286834 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:19.879240 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48524937-4b36-4ee3-9f43-99d9ba286834 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:19.879675 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-48524937-4b36-4ee3-9f43-99d9ba286834 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:20.008132 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-48524937-4b36-4ee3-9f43-99d9ba286834 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:20.015887 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-48524937-4b36-4ee3-9f43-99d9ba286834 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1366 microversion: 2.1 time: 0.149158 Apr 07 13:33:20.016564 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1313/2746] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:19 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:21.032735 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2ca42a7c-84ad-486f-875a-5d4ffeb6f336 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:21.033284 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2ca42a7c-84ad-486f-875a-5d4ffeb6f336 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:21.039832 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2ca42a7c-84ad-486f-875a-5d4ffeb6f336 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:21.040328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2ca42a7c-84ad-486f-875a-5d4ffeb6f336 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:21.041086 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2ca42a7c-84ad-486f-875a-5d4ffeb6f336 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:21.041521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2ca42a7c-84ad-486f-875a-5d4ffeb6f336 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:21.174250 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-2ca42a7c-84ad-486f-875a-5d4ffeb6f336 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:21.181397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2ca42a7c-84ad-486f-875a-5d4ffeb6f336 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1366 microversion: 2.1 time: 0.152602 Apr 07 13:33:21.181958 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1434/2747] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:21 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:22.198691 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-61547998-b96c-45f0-862f-a8099def061c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:22.199306 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-61547998-b96c-45f0-862f-a8099def061c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:22.206085 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61547998-b96c-45f0-862f-a8099def061c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:22.206550 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61547998-b96c-45f0-862f-a8099def061c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:22.207320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61547998-b96c-45f0-862f-a8099def061c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:22.207762 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-61547998-b96c-45f0-862f-a8099def061c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:22.262884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-eb2bbdf4-c8a7-4895-af4f-a2a78b433ced req-55f9a434-e095-48b7-8718-7e1dc0929ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c49028-8a42-49ef-9290-0bba9c55a822", "name": "network-vif-plugged", "status": "completed", "tag": "ebcc38ca-f7e6-4988-9f97-ae3349937509"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:33:22.272179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-eb2bbdf4-c8a7-4895-af4f-a2a78b433ced req-55f9a434-e095-48b7-8718-7e1dc0929ad4 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:22.272762 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-eb2bbdf4-c8a7-4895-af4f-a2a78b433ced req-55f9a434-e095-48b7-8718-7e1dc0929ad4 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:22.285172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-eb2bbdf4-c8a7-4895-af4f-a2a78b433ced req-55f9a434-e095-48b7-8718-7e1dc0929ad4 service nova] Creating event network-vif-plugged:ebcc38ca-f7e6-4988-9f97-ae3349937509 for instance e2c49028-8a42-49ef-9290-0bba9c55a822 on hv-cinder-83694 Apr 07 13:33:22.290216 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-eb2bbdf4-c8a7-4895-af4f-a2a78b433ced req-55f9a434-e095-48b7-8718-7e1dc0929ad4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031052 Apr 07 13:33:22.290896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1435/2748] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:33:22.349036 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-61547998-b96c-45f0-862f-a8099def061c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:22.357163 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-61547998-b96c-45f0-862f-a8099def061c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1366 microversion: 2.1 time: 0.162235 Apr 07 13:33:22.357845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1314/2749] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:22 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:23.375948 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5c920c66-221a-4a29-803b-f1dd014f3744 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:23.376678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5c920c66-221a-4a29-803b-f1dd014f3744 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:23.383052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c920c66-221a-4a29-803b-f1dd014f3744 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:23.383510 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c920c66-221a-4a29-803b-f1dd014f3744 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:23.384316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c920c66-221a-4a29-803b-f1dd014f3744 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:23.384758 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5c920c66-221a-4a29-803b-f1dd014f3744 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:23.527361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5c920c66-221a-4a29-803b-f1dd014f3744 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:23.537976 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5c920c66-221a-4a29-803b-f1dd014f3744 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1366 microversion: 2.1 time: 0.167231 Apr 07 13:33:23.538540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1436/2750] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:23 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:24.555378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-4de25903-d29c-44eb-9e11-297f57355d1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:24.555998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-4de25903-d29c-44eb-9e11-297f57355d1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:24.562917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4de25903-d29c-44eb-9e11-297f57355d1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:24.563367 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4de25903-d29c-44eb-9e11-297f57355d1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:24.564124 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4de25903-d29c-44eb-9e11-297f57355d1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:24.564587 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-4de25903-d29c-44eb-9e11-297f57355d1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:24.694269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-4de25903-d29c-44eb-9e11-297f57355d1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:33:24.701849 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-4de25903-d29c-44eb-9e11-297f57355d1f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1556 microversion: 2.1 time: 0.150265 Apr 07 13:33:24.702514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1315/2751] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:33:24 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:33:24.718586 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1184acd7-b43d-43e1-9f71-85dd82420c90 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:33:24.719124 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1184acd7-b43d-43e1-9f71-85dd82420c90 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:33:24.725597 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1184acd7-b43d-43e1-9f71-85dd82420c90 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:24.726044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1184acd7-b43d-43e1-9f71-85dd82420c90 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:24.726804 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1184acd7-b43d-43e1-9f71-85dd82420c90 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:24.727239 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1184acd7-b43d-43e1-9f71-85dd82420c90 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:24.814372 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1184acd7-b43d-43e1-9f71-85dd82420c90 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100031 Apr 07 13:33:24.815731 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1437/2752] 10.222.0.15 () {58 vars in 1274 bytes} [Thu Apr 7 13:33:24 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:33:26.328481 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-50a07409-d0ba-47d6-978a-2d36bfad4d3e req-4300bd4e-9af2-46c3-a87d-f4afd610bb38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c49028-8a42-49ef-9290-0bba9c55a822", "tag": "ebcc38ca-f7e6-4988-9f97-ae3349937509"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:33:26.338950 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-50a07409-d0ba-47d6-978a-2d36bfad4d3e req-4300bd4e-9af2-46c3-a87d-f4afd610bb38 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:33:26.339620 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-50a07409-d0ba-47d6-978a-2d36bfad4d3e req-4300bd4e-9af2-46c3-a87d-f4afd610bb38 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:33:26.353592 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-50a07409-d0ba-47d6-978a-2d36bfad4d3e req-4300bd4e-9af2-46c3-a87d-f4afd610bb38 service nova] Creating event network-changed:ebcc38ca-f7e6-4988-9f97-ae3349937509 for instance e2c49028-8a42-49ef-9290-0bba9c55a822 on hv-cinder-83694 Apr 07 13:33:26.360243 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-50a07409-d0ba-47d6-978a-2d36bfad4d3e req-4300bd4e-9af2-46c3-a87d-f4afd610bb38 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034056 Apr 07 13:33:26.361006 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1316/2753] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:00.507439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f1a8ddd0-b862-4df3-8f91-6791dd8f45a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:00.507950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f1a8ddd0-b862-4df3-8f91-6791dd8f45a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:00.513786 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1a8ddd0-b862-4df3-8f91-6791dd8f45a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:00.514241 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1a8ddd0-b862-4df3-8f91-6791dd8f45a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:00.515002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1a8ddd0-b862-4df3-8f91-6791dd8f45a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:00.515442 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f1a8ddd0-b862-4df3-8f91-6791dd8f45a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:00.538373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f1a8ddd0-b862-4df3-8f91-6791dd8f45a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822/ips" status: 200 len: 150 microversion: 2.1 time: 0.035252 Apr 07 13:34:00.539061 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1438/2754] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Apr 7 13:34:00 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:01.842509 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-957812e9-6b85-4fae-b3e6-b08e195c45cb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea6a8c88-0702-49fb-9fe6-ea04e3bbf035"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:34:01.843655 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-957812e9-6b85-4fae-b3e6-b08e195c45cb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:01.850332 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-957812e9-6b85-4fae-b3e6-b08e195c45cb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:01.850581 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-957812e9-6b85-4fae-b3e6-b08e195c45cb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:01.851344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-957812e9-6b85-4fae-b3e6-b08e195c45cb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:01.851780 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-957812e9-6b85-4fae-b3e6-b08e195c45cb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:02.078550 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-957812e9-6b85-4fae-b3e6-b08e195c45cb tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "POST /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239775 Apr 07 13:34:02.079383 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1317/2755] 10.222.0.15 () {60 vars in 1322 bytes} [Thu Apr 7 13:34:01 2022] POST /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:08.591457 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0477e424-81b7-49bc-9446-333072426a67 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:08.591967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0477e424-81b7-49bc-9446-333072426a67 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:08.599220 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0477e424-81b7-49bc-9446-333072426a67 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:08.599671 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0477e424-81b7-49bc-9446-333072426a67 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:08.600459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0477e424-81b7-49bc-9446-333072426a67 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:08.600897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0477e424-81b7-49bc-9446-333072426a67 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:08.676939 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-0477e424-81b7-49bc-9446-333072426a67 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lazy-loading 'services' on Instance uuid e2c49028-8a42-49ef-9290-0bba9c55a822 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:34:08.744658 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0477e424-81b7-49bc-9446-333072426a67 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822/os-volume_attachments/ea6a8c88-0702-49fb-9fe6-ea04e3bbf035" status: 202 len: 0 microversion: 2.1 time: 0.156942 Apr 07 13:34:08.745287 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1439/2756] 10.222.0.15 () {58 vars in 1415 bytes} [Thu Apr 7 13:34:08 2022] DELETE /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822/os-volume_attachments/ea6a8c88-0702-49fb-9fe6-ea04e3bbf035 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:34:08.755725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-183526dd-9980-4b25-b56f-811e56b00a7b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:08.756823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-183526dd-9980-4b25-b56f-811e56b00a7b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:08.763012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-183526dd-9980-4b25-b56f-811e56b00a7b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:08.763777 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-183526dd-9980-4b25-b56f-811e56b00a7b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:08.764637 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-183526dd-9980-4b25-b56f-811e56b00a7b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:08.765077 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-183526dd-9980-4b25-b56f-811e56b00a7b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:08.795772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-183526dd-9980-4b25-b56f-811e56b00a7b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045703 Apr 07 13:34:08.796336 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1318/2757] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:34:08 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:09.808337 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a324c481-a547-4d6a-bfba-ad46b9404df1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:09.809265 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a324c481-a547-4d6a-bfba-ad46b9404df1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:09.817484 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a324c481-a547-4d6a-bfba-ad46b9404df1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:09.817938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a324c481-a547-4d6a-bfba-ad46b9404df1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:09.818698 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a324c481-a547-4d6a-bfba-ad46b9404df1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:09.819135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a324c481-a547-4d6a-bfba-ad46b9404df1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:09.846857 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a324c481-a547-4d6a-bfba-ad46b9404df1 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043317 Apr 07 13:34:09.847397 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1440/2758] 10.222.0.15 () {58 vars in 1301 bytes} [Thu Apr 7 13:34:09 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 07 13:34:09.903890 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-156478a1-fd33-4daf-b751-8a7fb09ca5fc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:09.904513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-156478a1-fd33-4daf-b751-8a7fb09ca5fc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:09.911553 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-156478a1-fd33-4daf-b751-8a7fb09ca5fc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:09.912008 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-156478a1-fd33-4daf-b751-8a7fb09ca5fc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:09.912788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-156478a1-fd33-4daf-b751-8a7fb09ca5fc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:09.913228 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-156478a1-fd33-4daf-b751-8a7fb09ca5fc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:09.936792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-156478a1-fd33-4daf-b751-8a7fb09ca5fc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Going to try to terminate instance {{(pid=116892) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:34:10.011197 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-156478a1-fd33-4daf-b751-8a7fb09ca5fc tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 204 len: 0 microversion: 2.1 time: 0.110544 Apr 07 13:34:10.011901 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1319/2759] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:34:09 2022] DELETE /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:34:10.021107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-59d2797c-ca02-44c8-af7e-f7a4b23f0a3f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:10.021718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-59d2797c-ca02-44c8-af7e-f7a4b23f0a3f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:10.027709 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-59d2797c-ca02-44c8-af7e-f7a4b23f0a3f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:10.028169 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-59d2797c-ca02-44c8-af7e-f7a4b23f0a3f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:10.028932 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-59d2797c-ca02-44c8-af7e-f7a4b23f0a3f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:10.029363 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-59d2797c-ca02-44c8-af7e-f7a4b23f0a3f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:10.164224 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-59d2797c-ca02-44c8-af7e-f7a4b23f0a3f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:10.172107 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-59d2797c-ca02-44c8-af7e-f7a4b23f0a3f tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1681 microversion: 2.1 time: 0.154236 Apr 07 13:34:10.172696 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1441/2760] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:10 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:11.190788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e84235e8-de1f-456f-b9c2-8007810dcc31 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:11.191343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e84235e8-de1f-456f-b9c2-8007810dcc31 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:11.197815 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e84235e8-de1f-456f-b9c2-8007810dcc31 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:11.198254 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e84235e8-de1f-456f-b9c2-8007810dcc31 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:11.199031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e84235e8-de1f-456f-b9c2-8007810dcc31 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:11.199467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e84235e8-de1f-456f-b9c2-8007810dcc31 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:11.335295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e84235e8-de1f-456f-b9c2-8007810dcc31 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:11.342827 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e84235e8-de1f-456f-b9c2-8007810dcc31 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1681 microversion: 2.1 time: 0.156940 Apr 07 13:34:11.343448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1320/2761] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:11 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:12.341520 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-e526492d-eba3-43ac-bd55-ab25f4a35a4b req-ab1e6b3f-7b86-4a77-9562-7f55a55c5d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c49028-8a42-49ef-9290-0bba9c55a822", "name": "network-vif-deleted", "tag": "ebcc38ca-f7e6-4988-9f97-ae3349937509"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:34:12.351467 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-e526492d-eba3-43ac-bd55-ab25f4a35a4b req-ab1e6b3f-7b86-4a77-9562-7f55a55c5d86 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:12.351911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-e526492d-eba3-43ac-bd55-ab25f4a35a4b req-ab1e6b3f-7b86-4a77-9562-7f55a55c5d86 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:12.360404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-147a9207-3f4d-41f3-ac98-2e2540912e5c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:12.361706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-147a9207-3f4d-41f3-ac98-2e2540912e5c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:12.367394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-e526492d-eba3-43ac-bd55-ab25f4a35a4b req-ab1e6b3f-7b86-4a77-9562-7f55a55c5d86 service nova] Creating event network-vif-deleted:ebcc38ca-f7e6-4988-9f97-ae3349937509 for instance e2c49028-8a42-49ef-9290-0bba9c55a822 on hv-cinder-83694 Apr 07 13:34:12.370043 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-147a9207-3f4d-41f3-ac98-2e2540912e5c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:12.370782 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-147a9207-3f4d-41f3-ac98-2e2540912e5c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:12.371839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-147a9207-3f4d-41f3-ac98-2e2540912e5c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:12.372676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-147a9207-3f4d-41f3-ac98-2e2540912e5c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:12.372872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-e526492d-eba3-43ac-bd55-ab25f4a35a4b req-ab1e6b3f-7b86-4a77-9562-7f55a55c5d86 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035321 Apr 07 13:34:12.373473 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1442/2762] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:12.444524 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-147a9207-3f4d-41f3-ac98-2e2540912e5c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a8cd81c8064dc087a8f735cb0b78eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f250cd57cd0e4f5bbc3ca304eecb7e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:12.454121 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-147a9207-3f4d-41f3-ac98-2e2540912e5c tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 200 len: 1325 microversion: 2.1 time: 0.097878 Apr 07 13:34:12.455061 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1321/2763] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:12 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 1325 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:13.473178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bddbe9c6-6398-4c15-a979-a471f7c334ae tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:13.473872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-bddbe9c6-6398-4c15-a979-a471f7c334ae tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:13.481114 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bddbe9c6-6398-4c15-a979-a471f7c334ae tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:13.481559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bddbe9c6-6398-4c15-a979-a471f7c334ae tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:13.482642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bddbe9c6-6398-4c15-a979-a471f7c334ae tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:13.483422 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-bddbe9c6-6398-4c15-a979-a471f7c334ae tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:13.498277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-bddbe9c6-6398-4c15-a979-a471f7c334ae tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Instance e2c49028-8a42-49ef-9290-0bba9c55a822 could not be found. Apr 07 13:34:13.498865 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-bddbe9c6-6398-4c15-a979-a471f7c334ae tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 404 to user: Instance e2c49028-8a42-49ef-9290-0bba9c55a822 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:13.499691 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-bddbe9c6-6398-4c15-a979-a471f7c334ae tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 404 len: 111 microversion: 2.1 time: 0.032191 Apr 07 13:34:13.500750 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1443/2764] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:13 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:34:13.508945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fa5a7d57-a1c5-4ca1-98b1-afdaf9a52db3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '.version_select at 0x7fde5cba93a0>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:13.526130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fa5a7d57-a1c5-4ca1-98b1-afdaf9a52db3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-45521615" status: 202 len: 0 microversion: 2.1 time: 0.020921 Apr 07 13:34:13.526686 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1322/2765] 10.222.0.15 () {58 vars in 1214 bytes} [Thu Apr 7 13:34:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-45521615 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:34:14.363281 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:34:14.363503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:34:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:34:15.251094 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-582ac504-5233-47b8-8465-9b2c680f9e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:15.251662 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-582ac504-5233-47b8-8465-9b2c680f9e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:15.257783 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-582ac504-5233-47b8-8465-9b2c680f9e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:15.258221 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-582ac504-5233-47b8-8465-9b2c680f9e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:15.258967 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-582ac504-5233-47b8-8465-9b2c680f9e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:15.259399 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-582ac504-5233-47b8-8465-9b2c680f9e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:15.272991 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-582ac504-5233-47b8-8465-9b2c680f9e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Instance e2c49028-8a42-49ef-9290-0bba9c55a822 could not be found. Apr 07 13:34:15.273564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-582ac504-5233-47b8-8465-9b2c680f9e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 404 to user: Instance e2c49028-8a42-49ef-9290-0bba9c55a822 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:15.274367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-582ac504-5233-47b8-8465-9b2c680f9e55 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 404 len: 111 microversion: 2.1 time: 0.027495 Apr 07 13:34:15.274875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1444/2766] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:34:15 2022] DELETE /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:34:15.284219 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f0ae12d3-6625-42fa-93a1-d1510e905ff5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:15.284840 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f0ae12d3-6625-42fa-93a1-d1510e905ff5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e2c49028-8a42-49ef-9290-0bba9c55a822] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:15.291284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0ae12d3-6625-42fa-93a1-d1510e905ff5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:15.291740 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0ae12d3-6625-42fa-93a1-d1510e905ff5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:15.292544 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0ae12d3-6625-42fa-93a1-d1510e905ff5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:15.292992 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0ae12d3-6625-42fa-93a1-d1510e905ff5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:15.307308 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-f0ae12d3-6625-42fa-93a1-d1510e905ff5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Instance e2c49028-8a42-49ef-9290-0bba9c55a822 could not be found. Apr 07 13:34:15.307889 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f0ae12d3-6625-42fa-93a1-d1510e905ff5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 404 to user: Instance e2c49028-8a42-49ef-9290-0bba9c55a822 could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:15.308743 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f0ae12d3-6625-42fa-93a1-d1510e905ff5 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822" status: 404 len: 111 microversion: 2.1 time: 0.030100 Apr 07 13:34:15.309269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1323/2767] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:15 2022] GET /compute/v2.1/servers/e2c49028-8a42-49ef-9290-0bba9c55a822 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:34:16.439627 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6ce49803-1a6c-4c30-9294-5372792503e3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:16.440197 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6ce49803-1a6c-4c30-9294-5372792503e3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:16.454155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6ce49803-1a6c-4c30-9294-5372792503e3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:16.454611 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6ce49803-1a6c-4c30-9294-5372792503e3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:16.455509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6ce49803-1a6c-4c30-9294-5372792503e3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:16.455816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6ce49803-1a6c-4c30-9294-5372792503e3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:16.469595 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-6ce49803-1a6c-4c30-9294-5372792503e3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Instance 7b7ac683-4532-49fa-a88d-3299f1c324d3 could not be found. Apr 07 13:34:16.470185 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6ce49803-1a6c-4c30-9294-5372792503e3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 404 to user: Instance 7b7ac683-4532-49fa-a88d-3299f1c324d3 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:16.471010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6ce49803-1a6c-4c30-9294-5372792503e3 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 404 len: 111 microversion: 2.1 time: 0.036927 Apr 07 13:34:16.471594 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1445/2768] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:34:16 2022] DELETE /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:34:16.479462 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f0761dec-7f72-43bc-b9a6-419701667fb2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:16.480071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f0761dec-7f72-43bc-b9a6-419701667fb2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: 7b7ac683-4532-49fa-a88d-3299f1c324d3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:16.487040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0761dec-7f72-43bc-b9a6-419701667fb2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:16.487494 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0761dec-7f72-43bc-b9a6-419701667fb2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:16.488287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0761dec-7f72-43bc-b9a6-419701667fb2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:16.488726 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f0761dec-7f72-43bc-b9a6-419701667fb2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:16.502250 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-f0761dec-7f72-43bc-b9a6-419701667fb2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Instance 7b7ac683-4532-49fa-a88d-3299f1c324d3 could not be found. Apr 07 13:34:16.502844 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f0761dec-7f72-43bc-b9a6-419701667fb2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 404 to user: Instance 7b7ac683-4532-49fa-a88d-3299f1c324d3 could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:16.503668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f0761dec-7f72-43bc-b9a6-419701667fb2 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3" status: 404 len: 111 microversion: 2.1 time: 0.028083 Apr 07 13:34:16.504212 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1324/2769] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:16 2022] GET /compute/v2.1/servers/7b7ac683-4532-49fa-a88d-3299f1c324d3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:34:16.512159 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2d28f14d-c418-44d3-9a0f-ad98a76bddf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:16.512779 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2d28f14d-c418-44d3-9a0f-ad98a76bddf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:16.518909 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2d28f14d-c418-44d3-9a0f-ad98a76bddf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:16.519359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2d28f14d-c418-44d3-9a0f-ad98a76bddf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:16.520111 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2d28f14d-c418-44d3-9a0f-ad98a76bddf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:16.520573 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2d28f14d-c418-44d3-9a0f-ad98a76bddf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:16.535423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-2d28f14d-c418-44d3-9a0f-ad98a76bddf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Instance e69bcaba-e90d-43a6-8f4d-5e3edd32358e could not be found. Apr 07 13:34:16.535997 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2d28f14d-c418-44d3-9a0f-ad98a76bddf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 404 to user: Instance e69bcaba-e90d-43a6-8f4d-5e3edd32358e could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:16.536849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2d28f14d-c418-44d3-9a0f-ad98a76bddf7 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 404 len: 111 microversion: 2.1 time: 0.028726 Apr 07 13:34:16.537368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1446/2770] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:34:16 2022] DELETE /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 07 13:34:16.545125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-089de8ba-b2fc-4d4c-9956-5a250fb2cd8b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:16.545736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-089de8ba-b2fc-4d4c-9956-5a250fb2cd8b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: e69bcaba-e90d-43a6-8f4d-5e3edd32358e] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:16.552388 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-089de8ba-b2fc-4d4c-9956-5a250fb2cd8b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:16.552842 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-089de8ba-b2fc-4d4c-9956-5a250fb2cd8b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:16.553595 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-089de8ba-b2fc-4d4c-9956-5a250fb2cd8b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:16.554030 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-089de8ba-b2fc-4d4c-9956-5a250fb2cd8b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:16.566879 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-089de8ba-b2fc-4d4c-9956-5a250fb2cd8b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Instance e69bcaba-e90d-43a6-8f4d-5e3edd32358e could not be found. Apr 07 13:34:16.567454 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-089de8ba-b2fc-4d4c-9956-5a250fb2cd8b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 404 to user: Instance e69bcaba-e90d-43a6-8f4d-5e3edd32358e could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:16.568314 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-089de8ba-b2fc-4d4c-9956-5a250fb2cd8b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e" status: 404 len: 111 microversion: 2.1 time: 0.026917 Apr 07 13:34:16.568818 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1325/2771] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:16 2022] GET /compute/v2.1/servers/e69bcaba-e90d-43a6-8f4d-5e3edd32358e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:34:17.699022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-39cd8167-8e97-4597-adaf-32bd46e0244b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:17.699522 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-39cd8167-8e97-4597-adaf-32bd46e0244b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:17.705964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39cd8167-8e97-4597-adaf-32bd46e0244b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:17.706416 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39cd8167-8e97-4597-adaf-32bd46e0244b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:17.707172 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39cd8167-8e97-4597-adaf-32bd46e0244b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:17.707604 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-39cd8167-8e97-4597-adaf-32bd46e0244b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:17.721406 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-39cd8167-8e97-4597-adaf-32bd46e0244b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Instance ef3f987d-04a9-4057-b8ef-370f57761259 could not be found. Apr 07 13:34:17.721982 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-39cd8167-8e97-4597-adaf-32bd46e0244b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 404 to user: Instance ef3f987d-04a9-4057-b8ef-370f57761259 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:17.722798 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-39cd8167-8e97-4597-adaf-32bd46e0244b tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 404 len: 111 microversion: 2.1 time: 0.027620 Apr 07 13:34:17.723306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1447/2772] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:34:17 2022] DELETE /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:34:17.731109 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-263571de-bea0-4e64-837d-fa86d1fd84a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:17.731729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-263571de-bea0-4e64-837d-fa86d1fd84a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] [instance: ef3f987d-04a9-4057-b8ef-370f57761259] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:17.738709 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-263571de-bea0-4e64-837d-fa86d1fd84a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:17.739160 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-263571de-bea0-4e64-837d-fa86d1fd84a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:17.739925 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-263571de-bea0-4e64-837d-fa86d1fd84a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:17.740402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-263571de-bea0-4e64-837d-fa86d1fd84a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:17.754145 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-263571de-bea0-4e64-837d-fa86d1fd84a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] HTTP exception thrown: Instance ef3f987d-04a9-4057-b8ef-370f57761259 could not be found. Apr 07 13:34:17.754727 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-263571de-bea0-4e64-837d-fa86d1fd84a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] Returning 404 to user: Instance ef3f987d-04a9-4057-b8ef-370f57761259 could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:17.755549 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-263571de-bea0-4e64-837d-fa86d1fd84a9 tempest-AttachVolumeNegativeTest-197502399 tempest-AttachVolumeNegativeTest-197502399-project] 10.222.0.15 "GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259" status: 404 len: 111 microversion: 2.1 time: 0.028303 Apr 07 13:34:17.756057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1326/2773] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:17 2022] GET /compute/v2.1/servers/ef3f987d-04a9-4057-b8ef-370f57761259 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:34:22.229613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-04b43191-ee04-4809-b1da-647f31622330 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Action: 'create', calling method: .version_select at 0x7fde583f8af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-913921644"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:34:22.501502 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-04b43191-ee04-4809-b1da-647f31622330 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.381679 Apr 07 13:34:22.502391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1448/2774] 10.222.0.15 () {60 vars in 1154 bytes} [Thu Apr 7 13:34:22 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 384 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 07 13:34:22.516196 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ff7ff41c-a505-4d61-943a-da54cc764c64 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde5cd70280>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:22.577099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ff7ff41c-a505-4d61-943a-da54cc764c64 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36" status: 200 len: 344 microversion: 2.1 time: 0.067569 Apr 07 13:34:22.577750 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1327/2775] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 13:34:22 2022] GET /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:34:23.590896 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-283eb49b-0cfd-420c-9715-f7f20a5b2369 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde583993a0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:23.635468 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-283eb49b-0cfd-420c-9715-f7f20a5b2369 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36" status: 200 len: 345 microversion: 2.1 time: 0.048732 Apr 07 13:34:23.636025 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1449/2776] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 13:34:23 2022] GET /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:23.648220 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-666ec248-da3a-4db8-9ae7-46853da771f8 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Action: 'create', calling method: .version_select at 0x7fde5834b8b0>, body: {"snapshot": {"volume_id": "2c4a1e98-c723-447d-a9f7-317076085c36", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-100340483"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:34:23.785147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-666ec248-da3a-4db8-9ae7-46853da771f8 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.141141 Apr 07 13:34:23.785733 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1328/2777] 10.222.0.15 () {60 vars in 1161 bytes} [Thu Apr 7 13:34:23 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:23.795444 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b7eafeb8-1c5e-4bd9-bb37-a0f2326f3810 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde5cd45ca0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:23.826676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b7eafeb8-1c5e-4bd9-bb37-a0f2326f3810 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493" status: 200 len: 286 microversion: 2.1 time: 0.034955 Apr 07 13:34:23.827283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1450/2778] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Apr 7 13:34:23 2022] GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:23.839015 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-410de66f-e83d-4c64-9f4a-a9b20db5bfc6 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde5cd3c430>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:23.872936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-410de66f-e83d-4c64-9f4a-a9b20db5bfc6 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.031784 Apr 07 13:34:23.872936 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1329/2779] 10.222.0.15 () {58 vars in 1139 bytes} [Thu Apr 7 13:34:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:23.877993 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9cecccb4-ebdc-4e31-8c08-5ad475bf1d52 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde5cd45af0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:23.906954 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9cecccb4-ebdc-4e31-8c08-5ad475bf1d52 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493" status: 200 len: 286 microversion: 2.1 time: 0.033439 Apr 07 13:34:23.907566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1451/2780] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Apr 7 13:34:23 2022] GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:24.920568 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-96d57f00-536d-4436-9131-58a661f16d75 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde585119d0>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:24.952475 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-96d57f00-536d-4436-9131-58a661f16d75 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493" status: 200 len: 286 microversion: 2.1 time: 0.037352 Apr 07 13:34:24.953039 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1330/2781] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Apr 7 13:34:24 2022] GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:25.966525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2ca4354b-1c73-45e4-a90a-b4ec591a7bb2 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde583f8c10>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:25.995473 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2ca4354b-1c73-45e4-a90a-b4ec591a7bb2 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493" status: 200 len: 286 microversion: 2.1 time: 0.033077 Apr 07 13:34:25.996032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1452/2782] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Apr 7 13:34:25 2022] GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:27.007618 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6b62a8a1-57f8-42d3-836d-38f917ab13cf tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde5cd10f70>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:27.040772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6b62a8a1-57f8-42d3-836d-38f917ab13cf tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493" status: 200 len: 287 microversion: 2.1 time: 0.037379 Apr 07 13:34:27.041339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1331/2783] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Apr 7 13:34:27 2022] GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:27.052607 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6744501a-d3aa-44dc-b9b9-2cf928d00751 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde583c3ca0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:27.107567 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6744501a-d3aa-44dc-b9b9-2cf928d00751 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493" status: 202 len: 0 microversion: 2.1 time: 0.059971 Apr 07 13:34:27.108135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1453/2784] 10.222.0.15 () {58 vars in 1253 bytes} [Thu Apr 7 13:34:27 2022] DELETE /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:34:27.117060 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-50223ff0-3803-404c-a9c9-07f4c1f550f0 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde5cd10af0>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:27.147986 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-50223ff0-3803-404c-a9c9-07f4c1f550f0 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493" status: 200 len: 286 microversion: 2.1 time: 0.034261 Apr 07 13:34:27.148609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1332/2785] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Apr 7 13:34:27 2022] GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:28.167014 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c9553ea0-265c-4583-bc16-5b277542a81c tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde583683a0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:28.191182 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-c9553ea0-265c-4583-bc16-5b277542a81c tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] HTTP exception thrown: Snapshot 3667b10f-5cd9-498c-8298-08a0d8cab493 could not be found. Apr 07 13:34:28.191771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c9553ea0-265c-4583-bc16-5b277542a81c tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Returning 404 to user: Snapshot 3667b10f-5cd9-498c-8298-08a0d8cab493 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:28.192638 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c9553ea0-265c-4583-bc16-5b277542a81c tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493" status: 404 len: 111 microversion: 2.1 time: 0.029907 Apr 07 13:34:28.193163 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1454/2786] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Apr 7 13:34:28 2022] GET /compute/v2.1/os-snapshots/3667b10f-5cd9-498c-8298-08a0d8cab493 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:34:28.201613 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1829b167-694c-4d6e-bbb4-4ababb2fdafa tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde5834b040>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:28.259327 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1829b167-694c-4d6e-bbb4-4ababb2fdafa tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36" status: 202 len: 0 microversion: 2.1 time: 0.061877 Apr 07 13:34:28.259887 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1333/2787] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Apr 7 13:34:28 2022] DELETE /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:34:28.268171 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9f856aa6-8dad-4b94-a573-a114ab864afe tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde5cd45dc0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:28.315817 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9f856aa6-8dad-4b94-a573-a114ab864afe tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36" status: 200 len: 344 microversion: 2.1 time: 0.051626 Apr 07 13:34:28.316596 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1455/2788] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 13:34:28 2022] GET /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:29.328748 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1ba218c8-b892-4d64-bbc3-a7731a3e0275 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde5cd3cdc0>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:29.355535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-1ba218c8-b892-4d64-bbc3-a7731a3e0275 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] HTTP exception thrown: Volume 2c4a1e98-c723-447d-a9f7-317076085c36 could not be found. Apr 07 13:34:29.356132 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1ba218c8-b892-4d64-bbc3-a7731a3e0275 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Returning 404 to user: Volume 2c4a1e98-c723-447d-a9f7-317076085c36 could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:29.356998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1ba218c8-b892-4d64-bbc3-a7731a3e0275 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36" status: 404 len: 109 microversion: 2.1 time: 0.032636 Apr 07 13:34:29.357539 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1334/2789] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 13:34:29 2022] GET /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:34:29.372158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fa229cfe-1506-405f-99d0-dbc39938d361 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde583c3e50>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:29.398557 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-fa229cfe-1506-405f-99d0-dbc39938d361 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] HTTP exception thrown: Volume 2c4a1e98-c723-447d-a9f7-317076085c36 could not be found. Apr 07 13:34:29.399228 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fa229cfe-1506-405f-99d0-dbc39938d361 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Returning 404 to user: Volume 2c4a1e98-c723-447d-a9f7-317076085c36 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:29.400064 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fa229cfe-1506-405f-99d0-dbc39938d361 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36" status: 404 len: 109 microversion: 2.1 time: 0.032179 Apr 07 13:34:29.400656 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1456/2790] 10.222.0.15 () {58 vars in 1247 bytes} [Thu Apr 7 13:34:29 2022] DELETE /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 07 13:34:29.409329 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f30119b1-2ef9-46e9-b640-d360dd6eda53 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Calling method '.version_select at 0x7fde5834b3a0>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:29.434872 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-f30119b1-2ef9-46e9-b640-d360dd6eda53 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] HTTP exception thrown: Volume 2c4a1e98-c723-447d-a9f7-317076085c36 could not be found. Apr 07 13:34:29.435490 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f30119b1-2ef9-46e9-b640-d360dd6eda53 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] Returning 404 to user: Volume 2c4a1e98-c723-447d-a9f7-317076085c36 could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:29.436339 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f30119b1-2ef9-46e9-b640-d360dd6eda53 tempest-VolumesSnapshotsTestJSON-644293709 tempest-VolumesSnapshotsTestJSON-644293709-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36" status: 404 len: 109 microversion: 2.1 time: 0.031739 Apr 07 13:34:29.436861 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1335/2791] 10.222.0.15 () {58 vars in 1244 bytes} [Thu Apr 7 13:34:29 2022] GET /compute/v2.1/os-volumes/2c4a1e98-c723-447d-a9f7-317076085c36 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:34:36.723891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-781690899", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "networks": [{"uuid": "1ada758d-e2f9-4850-a4f0-2a988c189378"}]}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:34:36.773415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.network.neutron [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] validate_networks() for [('1ada758d-e2f9-4850-a4f0-2a988c189378', None, None, None, None, None)] {{(pid=116893) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 13:34:37.115949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Flavor limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 13:34:37.116475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Image limits 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 13:34:37.116949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Flavor pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 13:34:37.117359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Image pref 0:0:0 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 13:34:37.117767 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.virt.hardware [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 13:34:37.127229 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:37.127686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:37.128510 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:37.128943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:37.145498 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Getting quotas for project 4b1c8f0da3694ca8aaab32b49e100a4e. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:34:37.149319 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Getting quotas for user 48fe2a834eec40369dbc3f40ff0c6ce6 and project 4b1c8f0da3694ca8aaab32b49e100a4e. Resources: {'instances', 'cores', 'ram'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:34:37.160499 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Going to run 1 instances... {{(pid=116893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 13:34:37.162699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 13:34:37.208181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2f837e20-fa8c-4803-9be3-742ac0281264 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489459 Apr 07 13:34:37.208811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1457/2792] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 13:34:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 13:34:37.220845 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-677bc565-1c42-4b20-b041-a8ce7ecf653c tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:37.221549 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-677bc565-1c42-4b20-b041-a8ce7ecf653c tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:37.274519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-677bc565-1c42-4b20-b041-a8ce7ecf653c tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:37.281213 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-677bc565-1c42-4b20-b041-a8ce7ecf653c tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 200 len: 1213 microversion: 2.1 time: 0.066392 Apr 07 13:34:37.281560 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1336/2793] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:37 2022] GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:38.299499 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-98a4bbba-1689-4511-a7ff-7e13fe2e2e05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:38.300756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-98a4bbba-1689-4511-a7ff-7e13fe2e2e05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:38.307341 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98a4bbba-1689-4511-a7ff-7e13fe2e2e05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:38.307797 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98a4bbba-1689-4511-a7ff-7e13fe2e2e05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:38.308607 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98a4bbba-1689-4511-a7ff-7e13fe2e2e05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:38.309041 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-98a4bbba-1689-4511-a7ff-7e13fe2e2e05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:38.398413 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-98a4bbba-1689-4511-a7ff-7e13fe2e2e05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:38.405616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-98a4bbba-1689-4511-a7ff-7e13fe2e2e05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 200 len: 1271 microversion: 2.1 time: 0.111016 Apr 07 13:34:38.406184 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1458/2794] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:38 2022] GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:39.376650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-41a9b4fa-d724-4818-8ff7-99ef336bce47 req-a026d70a-5b79-4ee9-9d63-2392d0b077cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c28d07-de87-4bcb-86bd-93b1d2412e6c", "tag": "e6a4efc9-e94d-4a05-b09c-996f798cda7d"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:34:39.395918 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-41a9b4fa-d724-4818-8ff7-99ef336bce47 req-a026d70a-5b79-4ee9-9d63-2392d0b077cd service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:39.400272 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-41a9b4fa-d724-4818-8ff7-99ef336bce47 req-a026d70a-5b79-4ee9-9d63-2392d0b077cd service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:39.412828 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-41a9b4fa-d724-4818-8ff7-99ef336bce47 req-a026d70a-5b79-4ee9-9d63-2392d0b077cd service nova] Creating event network-changed:e6a4efc9-e94d-4a05-b09c-996f798cda7d for instance 54c28d07-de87-4bcb-86bd-93b1d2412e6c on hv-cinder-83694 Apr 07 13:34:39.423036 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b424a9a0-4cb8-4633-b0cd-55f475734dfe tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:39.423747 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b424a9a0-4cb8-4633-b0cd-55f475734dfe tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:39.427034 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-41a9b4fa-d724-4818-8ff7-99ef336bce47 req-a026d70a-5b79-4ee9-9d63-2392d0b077cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045706 Apr 07 13:34:39.427668 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1337/2795] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:34:39.430762 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b424a9a0-4cb8-4633-b0cd-55f475734dfe tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:39.431205 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b424a9a0-4cb8-4633-b0cd-55f475734dfe tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:39.431960 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b424a9a0-4cb8-4633-b0cd-55f475734dfe tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:39.432421 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b424a9a0-4cb8-4633-b0cd-55f475734dfe tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:39.980412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b424a9a0-4cb8-4633-b0cd-55f475734dfe tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:39.988293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b424a9a0-4cb8-4633-b0cd-55f475734dfe tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 200 len: 1313 microversion: 2.1 time: 0.569396 Apr 07 13:34:39.988855 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1459/2796] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:39 2022] GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 1313 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:41.005979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9064a314-c0e7-4f6c-aa26-ef56cc696a51 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:41.006799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9064a314-c0e7-4f6c-aa26-ef56cc696a51 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:41.013269 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9064a314-c0e7-4f6c-aa26-ef56cc696a51 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:41.013715 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9064a314-c0e7-4f6c-aa26-ef56cc696a51 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:41.014505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9064a314-c0e7-4f6c-aa26-ef56cc696a51 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:41.015037 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9064a314-c0e7-4f6c-aa26-ef56cc696a51 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:41.149144 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9064a314-c0e7-4f6c-aa26-ef56cc696a51 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:41.156502 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9064a314-c0e7-4f6c-aa26-ef56cc696a51 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 200 len: 1313 microversion: 2.1 time: 0.155110 Apr 07 13:34:41.157071 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1338/2797] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:40 2022] GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:42.173469 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-f7f8d693-5088-4c8b-9dc7-ed6dfc7d49ae tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:42.174075 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-f7f8d693-5088-4c8b-9dc7-ed6dfc7d49ae tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:42.180375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7f8d693-5088-4c8b-9dc7-ed6dfc7d49ae tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:42.180828 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7f8d693-5088-4c8b-9dc7-ed6dfc7d49ae tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:42.181582 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7f8d693-5088-4c8b-9dc7-ed6dfc7d49ae tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:42.182019 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-f7f8d693-5088-4c8b-9dc7-ed6dfc7d49ae tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:42.318639 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-f7f8d693-5088-4c8b-9dc7-ed6dfc7d49ae tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:42.325740 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-f7f8d693-5088-4c8b-9dc7-ed6dfc7d49ae tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 200 len: 1313 microversion: 2.1 time: 0.156323 Apr 07 13:34:42.326295 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1460/2798] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:42 2022] GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:43.342948 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-43670fb5-bcc6-4524-b335-0e7622bc10df tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:43.343565 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-43670fb5-bcc6-4524-b335-0e7622bc10df tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:43.350920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43670fb5-bcc6-4524-b335-0e7622bc10df tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:43.351371 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43670fb5-bcc6-4524-b335-0e7622bc10df tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:43.352129 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43670fb5-bcc6-4524-b335-0e7622bc10df tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:43.352588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43670fb5-bcc6-4524-b335-0e7622bc10df tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:43.486779 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-43670fb5-bcc6-4524-b335-0e7622bc10df tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:43.493978 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-43670fb5-bcc6-4524-b335-0e7622bc10df tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 200 len: 1313 microversion: 2.1 time: 0.154856 Apr 07 13:34:43.494535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1339/2799] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:43 2022] GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:44.511470 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-500af826-6273-44ec-955f-dd5373b6dc30 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:44.512071 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-500af826-6273-44ec-955f-dd5373b6dc30 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:44.519081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-500af826-6273-44ec-955f-dd5373b6dc30 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:44.519526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-500af826-6273-44ec-955f-dd5373b6dc30 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:44.520324 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-500af826-6273-44ec-955f-dd5373b6dc30 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:44.520757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-500af826-6273-44ec-955f-dd5373b6dc30 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:44.662293 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-500af826-6273-44ec-955f-dd5373b6dc30 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:44.669987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-500af826-6273-44ec-955f-dd5373b6dc30 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 200 len: 1313 microversion: 2.1 time: 0.162752 Apr 07 13:34:44.670541 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1461/2800] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:44 2022] GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:44.674121 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-ab85ee8d-a233-44a6-93bd-722b61b70131 req-126c5830-2e2c-42c8-a360-6fe394640112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c28d07-de87-4bcb-86bd-93b1d2412e6c", "name": "network-vif-plugged", "status": "completed", "tag": "e6a4efc9-e94d-4a05-b09c-996f798cda7d"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:34:44.682650 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-ab85ee8d-a233-44a6-93bd-722b61b70131 req-126c5830-2e2c-42c8-a360-6fe394640112 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:44.683320 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-ab85ee8d-a233-44a6-93bd-722b61b70131 req-126c5830-2e2c-42c8-a360-6fe394640112 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:44.694334 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-ab85ee8d-a233-44a6-93bd-722b61b70131 req-126c5830-2e2c-42c8-a360-6fe394640112 service nova] Creating event network-vif-plugged:e6a4efc9-e94d-4a05-b09c-996f798cda7d for instance 54c28d07-de87-4bcb-86bd-93b1d2412e6c on hv-cinder-83694 Apr 07 13:34:44.699118 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-ab85ee8d-a233-44a6-93bd-722b61b70131 req-126c5830-2e2c-42c8-a360-6fe394640112 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029712 Apr 07 13:34:44.699700 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1340/2801] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:34:45.686575 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a9bf7c4a-a7de-4d90-afdf-08302bedaf6a tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:45.687186 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a9bf7c4a-a7de-4d90-afdf-08302bedaf6a tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:45.694070 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9bf7c4a-a7de-4d90-afdf-08302bedaf6a tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:45.694521 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9bf7c4a-a7de-4d90-afdf-08302bedaf6a tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:45.695274 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9bf7c4a-a7de-4d90-afdf-08302bedaf6a tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:45.695707 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a9bf7c4a-a7de-4d90-afdf-08302bedaf6a tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:45.828847 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a9bf7c4a-a7de-4d90-afdf-08302bedaf6a tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:45.836969 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a9bf7c4a-a7de-4d90-afdf-08302bedaf6a tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 200 len: 1313 microversion: 2.1 time: 0.154165 Apr 07 13:34:45.837526 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1462/2802] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:45 2022] GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:46.854710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-06f0f269-39ad-42be-9819-a4ae4c1696ff tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:46.855433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-06f0f269-39ad-42be-9819-a4ae4c1696ff tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:46.862087 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06f0f269-39ad-42be-9819-a4ae4c1696ff tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:46.862538 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06f0f269-39ad-42be-9819-a4ae4c1696ff tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:46.863283 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06f0f269-39ad-42be-9819-a4ae4c1696ff tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:46.863724 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-06f0f269-39ad-42be-9819-a4ae4c1696ff tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:46.998546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-06f0f269-39ad-42be-9819-a4ae4c1696ff tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:47.006689 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-06f0f269-39ad-42be-9819-a4ae4c1696ff tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 200 len: 1497 microversion: 2.1 time: 0.156585 Apr 07 13:34:47.007246 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1341/2803] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:46 2022] GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:47.382892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5d290dc4-b092-4b5a-8de1-073db91026c3 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:47.383381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5d290dc4-b092-4b5a-8de1-073db91026c3 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:47.389572 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5d290dc4-b092-4b5a-8de1-073db91026c3 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:47.390019 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5d290dc4-b092-4b5a-8de1-073db91026c3 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:47.390766 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5d290dc4-b092-4b5a-8de1-073db91026c3 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:47.391194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5d290dc4-b092-4b5a-8de1-073db91026c3 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:47.415283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5d290dc4-b092-4b5a-8de1-073db91026c3 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:34:47.489390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5d290dc4-b092-4b5a-8de1-073db91026c3 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 204 len: 0 microversion: 2.1 time: 0.109733 Apr 07 13:34:47.490013 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1463/2804] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:34:47 2022] DELETE /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:34:47.498625 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2ac151ad-9ee6-4aba-b903-cfb7ffd58b31 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:47.499268 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2ac151ad-9ee6-4aba-b903-cfb7ffd58b31 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:47.505744 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2ac151ad-9ee6-4aba-b903-cfb7ffd58b31 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:47.506191 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2ac151ad-9ee6-4aba-b903-cfb7ffd58b31 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:47.506953 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2ac151ad-9ee6-4aba-b903-cfb7ffd58b31 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:47.507386 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2ac151ad-9ee6-4aba-b903-cfb7ffd58b31 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:47.638391 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2ac151ad-9ee6-4aba-b903-cfb7ffd58b31 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:47.645736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2ac151ad-9ee6-4aba-b903-cfb7ffd58b31 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 200 len: 1503 microversion: 2.1 time: 0.151093 Apr 07 13:34:47.646295 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1342/2805] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:47 2022] GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:34:48.663488 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cb4d93f0-8847-4749-a325-bb670dbe660d tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:48.664278 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cb4d93f0-8847-4749-a325-bb670dbe660d tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:48.670497 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cb4d93f0-8847-4749-a325-bb670dbe660d tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:48.670943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cb4d93f0-8847-4749-a325-bb670dbe660d tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:48.671688 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cb4d93f0-8847-4749-a325-bb670dbe660d tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:48.672120 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cb4d93f0-8847-4749-a325-bb670dbe660d tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:48.839431 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cb4d93f0-8847-4749-a325-bb670dbe660d tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:48.847429 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cb4d93f0-8847-4749-a325-bb670dbe660d tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 200 len: 1503 microversion: 2.1 time: 0.188033 Apr 07 13:34:48.848000 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1464/2806] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:48 2022] GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:49.261484 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-93f32b66-541c-407e-9a3d-b5ed481c148e req-ca41f68b-cdaa-4639-9800-1e74a4b7291e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c28d07-de87-4bcb-86bd-93b1d2412e6c", "name": "network-vif-deleted", "tag": "e6a4efc9-e94d-4a05-b09c-996f798cda7d"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:34:49.270413 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-93f32b66-541c-407e-9a3d-b5ed481c148e req-ca41f68b-cdaa-4639-9800-1e74a4b7291e service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:49.270865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-93f32b66-541c-407e-9a3d-b5ed481c148e req-ca41f68b-cdaa-4639-9800-1e74a4b7291e service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:49.285921 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-93f32b66-541c-407e-9a3d-b5ed481c148e req-ca41f68b-cdaa-4639-9800-1e74a4b7291e service nova] Creating event network-vif-deleted:e6a4efc9-e94d-4a05-b09c-996f798cda7d for instance 54c28d07-de87-4bcb-86bd-93b1d2412e6c on hv-cinder-83694 Apr 07 13:34:49.290477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-93f32b66-541c-407e-9a3d-b5ed481c148e req-ca41f68b-cdaa-4639-9800-1e74a4b7291e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032783 Apr 07 13:34:49.291057 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1343/2807] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:49.864319 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-dfc762e8-9b50-4ad5-ae03-18dad79ef058 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:49.864943 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-dfc762e8-9b50-4ad5-ae03-18dad79ef058 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: 54c28d07-de87-4bcb-86bd-93b1d2412e6c] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:49.871389 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dfc762e8-9b50-4ad5-ae03-18dad79ef058 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:49.871841 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dfc762e8-9b50-4ad5-ae03-18dad79ef058 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:49.872686 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dfc762e8-9b50-4ad5-ae03-18dad79ef058 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:49.873316 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dfc762e8-9b50-4ad5-ae03-18dad79ef058 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:49.886393 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-dfc762e8-9b50-4ad5-ae03-18dad79ef058 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] HTTP exception thrown: Instance 54c28d07-de87-4bcb-86bd-93b1d2412e6c could not be found. Apr 07 13:34:49.887121 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-dfc762e8-9b50-4ad5-ae03-18dad79ef058 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Returning 404 to user: Instance 54c28d07-de87-4bcb-86bd-93b1d2412e6c could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:34:49.888060 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-dfc762e8-9b50-4ad5-ae03-18dad79ef058 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c" status: 404 len: 111 microversion: 2.1 time: 0.027722 Apr 07 13:34:49.888775 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1465/2808] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:49 2022] GET /compute/v2.1/servers/54c28d07-de87-4bcb-86bd-93b1d2412e6c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:34:49.941897 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1284364880", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452", "networks": [{"uuid": "1ada758d-e2f9-4850-a4f0-2a988c189378"}]}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:34:49.993221 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.network.neutron [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] validate_networks() for [('1ada758d-e2f9-4850-a4f0-2a988c189378', None, None, None, None, None)] {{(pid=116892) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 13:34:50.326753 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Flavor limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 13:34:50.327378 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Image limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 13:34:50.327678 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Flavor pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 13:34:50.328089 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Image pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 13:34:50.328533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 13:34:50.338492 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:50.338945 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:50.339747 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:50.340208 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:50.356480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Getting quotas for project 4b1c8f0da3694ca8aaab32b49e100a4e. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:34:50.361054 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Getting quotas for user 48fe2a834eec40369dbc3f40ff0c6ce6 and project 4b1c8f0da3694ca8aaab32b49e100a4e. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:34:50.371741 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Going to run 1 instances... {{(pid=116892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 13:34:50.374068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 13:34:50.418304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1f6dccab-bf72-4cf9-afef-b9d47bb03f05 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.481813 Apr 07 13:34:50.418949 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1344/2809] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 13:34:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 13:34:50.430135 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-49da5b80-1662-4fc3-891f-41994d127d07 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:50.430744 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-49da5b80-1662-4fc3-891f-41994d127d07 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:50.482929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-49da5b80-1662-4fc3-891f-41994d127d07 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:50.490264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-49da5b80-1662-4fc3-891f-41994d127d07 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 200 len: 1214 microversion: 2.1 time: 0.064140 Apr 07 13:34:50.490834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1466/2810] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:50 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:51.507805 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1e0bc94f-7e5a-4819-8b5f-889e42cde84c tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:51.508452 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1e0bc94f-7e5a-4819-8b5f-889e42cde84c tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:51.514920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e0bc94f-7e5a-4819-8b5f-889e42cde84c tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:51.515374 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e0bc94f-7e5a-4819-8b5f-889e42cde84c tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:51.516884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e0bc94f-7e5a-4819-8b5f-889e42cde84c tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:51.517591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1e0bc94f-7e5a-4819-8b5f-889e42cde84c tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:51.584157 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1e0bc94f-7e5a-4819-8b5f-889e42cde84c tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:51.591426 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1e0bc94f-7e5a-4819-8b5f-889e42cde84c tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 200 len: 1272 microversion: 2.1 time: 0.087984 Apr 07 13:34:51.592225 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1345/2811] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:51 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:52.538194 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-1cc2f51e-6126-4f83-8f4b-6f0d3c383513 req-f4678186-4533-49db-8d88-2221f0868bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b030e550-f8cb-4465-a4fc-eae429ada5f4", "tag": "5b8791ce-3670-4dbd-8820-65648727fb11"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:34:52.564390 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-1cc2f51e-6126-4f83-8f4b-6f0d3c383513 req-f4678186-4533-49db-8d88-2221f0868bf0 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:52.564928 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-1cc2f51e-6126-4f83-8f4b-6f0d3c383513 req-f4678186-4533-49db-8d88-2221f0868bf0 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:52.576346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-1cc2f51e-6126-4f83-8f4b-6f0d3c383513 req-f4678186-4533-49db-8d88-2221f0868bf0 service nova] Creating event network-changed:5b8791ce-3670-4dbd-8820-65648727fb11 for instance b030e550-f8cb-4465-a4fc-eae429ada5f4 on hv-cinder-83694 Apr 07 13:34:52.582589 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-1cc2f51e-6126-4f83-8f4b-6f0d3c383513 req-f4678186-4533-49db-8d88-2221f0868bf0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048830 Apr 07 13:34:52.584264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1467/2812] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:52.607797 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1efdc71c-3bf2-4f53-a13a-7f8b70b664a5 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:52.608448 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1efdc71c-3bf2-4f53-a13a-7f8b70b664a5 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:52.615312 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1efdc71c-3bf2-4f53-a13a-7f8b70b664a5 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:52.615772 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1efdc71c-3bf2-4f53-a13a-7f8b70b664a5 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:52.616591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1efdc71c-3bf2-4f53-a13a-7f8b70b664a5 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:52.617063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1efdc71c-3bf2-4f53-a13a-7f8b70b664a5 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:52.751108 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-1efdc71c-3bf2-4f53-a13a-7f8b70b664a5 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:52.758517 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1efdc71c-3bf2-4f53-a13a-7f8b70b664a5 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 200 len: 1314 microversion: 2.1 time: 0.154543 Apr 07 13:34:52.759091 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1346/2813] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:52 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:53.775189 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-29c661db-e84d-47fe-9f5f-f67718cd8ea2 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:53.775891 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-29c661db-e84d-47fe-9f5f-f67718cd8ea2 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:53.782599 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-29c661db-e84d-47fe-9f5f-f67718cd8ea2 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:53.783051 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-29c661db-e84d-47fe-9f5f-f67718cd8ea2 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:53.784076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-29c661db-e84d-47fe-9f5f-f67718cd8ea2 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:53.784543 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-29c661db-e84d-47fe-9f5f-f67718cd8ea2 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:54.023856 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-29c661db-e84d-47fe-9f5f-f67718cd8ea2 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:54.031708 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-29c661db-e84d-47fe-9f5f-f67718cd8ea2 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 200 len: 1314 microversion: 2.1 time: 0.260564 Apr 07 13:34:54.033268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1468/2814] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:53 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:55.049421 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-46276566-d215-49ac-9ff0-7564bc353668 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:55.050028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-46276566-d215-49ac-9ff0-7564bc353668 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:55.056346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-46276566-d215-49ac-9ff0-7564bc353668 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:55.056801 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-46276566-d215-49ac-9ff0-7564bc353668 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:55.057562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-46276566-d215-49ac-9ff0-7564bc353668 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:55.057998 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-46276566-d215-49ac-9ff0-7564bc353668 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:55.194997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-46276566-d215-49ac-9ff0-7564bc353668 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:55.202130 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-46276566-d215-49ac-9ff0-7564bc353668 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 200 len: 1314 microversion: 2.1 time: 0.156767 Apr 07 13:34:55.202690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1347/2815] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:55 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:34:56.218624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c759d99b-11a2-4682-8aaf-115a681d22eb tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:56.219850 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c759d99b-11a2-4682-8aaf-115a681d22eb tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:56.226346 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c759d99b-11a2-4682-8aaf-115a681d22eb tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:56.226805 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c759d99b-11a2-4682-8aaf-115a681d22eb tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:56.227566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c759d99b-11a2-4682-8aaf-115a681d22eb tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:56.228002 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c759d99b-11a2-4682-8aaf-115a681d22eb tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:56.363199 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c759d99b-11a2-4682-8aaf-115a681d22eb tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:56.370419 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c759d99b-11a2-4682-8aaf-115a681d22eb tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 200 len: 1314 microversion: 2.1 time: 0.155864 Apr 07 13:34:56.370979 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1469/2816] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:56 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:57.386934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ff6e9615-fb27-418f-8d39-4681d3ab8682 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:57.387546 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ff6e9615-fb27-418f-8d39-4681d3ab8682 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:57.394076 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff6e9615-fb27-418f-8d39-4681d3ab8682 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:57.394527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff6e9615-fb27-418f-8d39-4681d3ab8682 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:57.395287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff6e9615-fb27-418f-8d39-4681d3ab8682 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:57.395729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ff6e9615-fb27-418f-8d39-4681d3ab8682 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:57.523398 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ff6e9615-fb27-418f-8d39-4681d3ab8682 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:57.530574 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ff6e9615-fb27-418f-8d39-4681d3ab8682 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 200 len: 1314 microversion: 2.1 time: 0.147457 Apr 07 13:34:57.531142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1348/2817] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:57 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:58.548642 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5b265246-720b-45cb-a298-8cea5b2f9376 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:58.549424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5b265246-720b-45cb-a298-8cea5b2f9376 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:58.555700 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b265246-720b-45cb-a298-8cea5b2f9376 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:58.556178 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b265246-720b-45cb-a298-8cea5b2f9376 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:58.556940 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b265246-720b-45cb-a298-8cea5b2f9376 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:58.557371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5b265246-720b-45cb-a298-8cea5b2f9376 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:58.692941 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5b265246-720b-45cb-a298-8cea5b2f9376 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:58.700373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5b265246-720b-45cb-a298-8cea5b2f9376 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 200 len: 1314 microversion: 2.1 time: 0.156257 Apr 07 13:34:58.700938 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1470/2818] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:58 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:34:58.772994 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-4b933122-d4a4-4b4e-a3ee-f30205607c14 req-5310cbfa-a18f-4c14-ab21-b7250446c3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b030e550-f8cb-4465-a4fc-eae429ada5f4", "name": "network-vif-plugged", "status": "completed", "tag": "5b8791ce-3670-4dbd-8820-65648727fb11"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:34:58.782763 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-4b933122-d4a4-4b4e-a3ee-f30205607c14 req-5310cbfa-a18f-4c14-ab21-b7250446c3cf service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:58.783142 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-4b933122-d4a4-4b4e-a3ee-f30205607c14 req-5310cbfa-a18f-4c14-ab21-b7250446c3cf service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:58.794480 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-4b933122-d4a4-4b4e-a3ee-f30205607c14 req-5310cbfa-a18f-4c14-ab21-b7250446c3cf service nova] Creating event network-vif-plugged:5b8791ce-3670-4dbd-8820-65648727fb11 for instance b030e550-f8cb-4465-a4fc-eae429ada5f4 on hv-cinder-83694 Apr 07 13:34:58.799404 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-4b933122-d4a4-4b4e-a3ee-f30205607c14 req-5310cbfa-a18f-4c14-ab21-b7250446c3cf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029945 Apr 07 13:34:58.799932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1349/2819] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:34:59.717818 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-fdc96726-89a1-4c92-af4f-1f3ec81f64c8 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:34:59.718430 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-fdc96726-89a1-4c92-af4f-1f3ec81f64c8 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:34:59.725246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fdc96726-89a1-4c92-af4f-1f3ec81f64c8 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:59.725699 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fdc96726-89a1-4c92-af4f-1f3ec81f64c8 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:59.726459 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fdc96726-89a1-4c92-af4f-1f3ec81f64c8 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:34:59.726897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-fdc96726-89a1-4c92-af4f-1f3ec81f64c8 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:34:59.859027 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-fdc96726-89a1-4c92-af4f-1f3ec81f64c8 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:34:59.866986 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-fdc96726-89a1-4c92-af4f-1f3ec81f64c8 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 200 len: 1314 microversion: 2.1 time: 0.152936 Apr 07 13:34:59.867542 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1471/2820] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:34:59 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:35:00.885141 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b8445c18-5dec-4e4f-bac8-4d3686360c69 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:00.885835 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b8445c18-5dec-4e4f-bac8-4d3686360c69 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:00.891900 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b8445c18-5dec-4e4f-bac8-4d3686360c69 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:00.892382 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b8445c18-5dec-4e4f-bac8-4d3686360c69 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:00.893135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b8445c18-5dec-4e4f-bac8-4d3686360c69 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:00.893567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b8445c18-5dec-4e4f-bac8-4d3686360c69 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:01.027572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b8445c18-5dec-4e4f-bac8-4d3686360c69 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:35:01.035352 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b8445c18-5dec-4e4f-bac8-4d3686360c69 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 200 len: 1498 microversion: 2.1 time: 0.154978 Apr 07 13:35:01.035915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1350/2821] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:35:00 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:35:01.438564 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-1e9353f7-55f4-4edd-869d-b3627256dc68 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:01.439112 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1e9353f7-55f4-4edd-869d-b3627256dc68 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:01.445519 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e9353f7-55f4-4edd-869d-b3627256dc68 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:01.445963 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e9353f7-55f4-4edd-869d-b3627256dc68 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:01.446712 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e9353f7-55f4-4edd-869d-b3627256dc68 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:01.447141 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-1e9353f7-55f4-4edd-869d-b3627256dc68 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:01.471203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-1e9353f7-55f4-4edd-869d-b3627256dc68 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:35:01.547303 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-1e9353f7-55f4-4edd-869d-b3627256dc68 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 204 len: 0 microversion: 2.1 time: 0.112753 Apr 07 13:35:01.548200 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1472/2822] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:35:01 2022] DELETE /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:35:01.556803 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c41d006b-ac13-40e9-ba26-b9dfcccdc8c9 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:01.557425 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c41d006b-ac13-40e9-ba26-b9dfcccdc8c9 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:01.564098 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c41d006b-ac13-40e9-ba26-b9dfcccdc8c9 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:01.564573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c41d006b-ac13-40e9-ba26-b9dfcccdc8c9 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:01.565344 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c41d006b-ac13-40e9-ba26-b9dfcccdc8c9 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:01.565785 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c41d006b-ac13-40e9-ba26-b9dfcccdc8c9 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:01.695192 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c41d006b-ac13-40e9-ba26-b9dfcccdc8c9 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:35:01.702424 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c41d006b-ac13-40e9-ba26-b9dfcccdc8c9 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 200 len: 1504 microversion: 2.1 time: 0.150117 Apr 07 13:35:01.702991 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1351/2823] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:35:01 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:35:02.721952 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d08768ae-d13d-4172-b153-32e9ddf46b77 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:02.722568 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d08768ae-d13d-4172-b153-32e9ddf46b77 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:02.728760 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d08768ae-d13d-4172-b153-32e9ddf46b77 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:02.729212 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d08768ae-d13d-4172-b153-32e9ddf46b77 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:02.729957 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d08768ae-d13d-4172-b153-32e9ddf46b77 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:02.730385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d08768ae-d13d-4172-b153-32e9ddf46b77 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:02.897155 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d08768ae-d13d-4172-b153-32e9ddf46b77 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fe2a834eec40369dbc3f40ff0c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1c8f0da3694ca8aaab32b49e100a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:35:02.905471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d08768ae-d13d-4172-b153-32e9ddf46b77 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 200 len: 1504 microversion: 2.1 time: 0.188811 Apr 07 13:35:02.906037 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1473/2824] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:35:02 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:35:03.314399 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-d7915269-5d49-469d-90de-ddf93729d216 req-1c34f524-5c0c-4cb3-a8ca-65e191350526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b030e550-f8cb-4465-a4fc-eae429ada5f4", "name": "network-vif-deleted", "tag": "5b8791ce-3670-4dbd-8820-65648727fb11"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:35:03.324638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-d7915269-5d49-469d-90de-ddf93729d216 req-1c34f524-5c0c-4cb3-a8ca-65e191350526 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:03.325066 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-d7915269-5d49-469d-90de-ddf93729d216 req-1c34f524-5c0c-4cb3-a8ca-65e191350526 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:03.337666 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-d7915269-5d49-469d-90de-ddf93729d216 req-1c34f524-5c0c-4cb3-a8ca-65e191350526 service nova] Creating event network-vif-deleted:5b8791ce-3670-4dbd-8820-65648727fb11 for instance b030e550-f8cb-4465-a4fc-eae429ada5f4 on hv-cinder-83694 Apr 07 13:35:03.343406 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-d7915269-5d49-469d-90de-ddf93729d216 req-1c34f524-5c0c-4cb3-a8ca-65e191350526 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033425 Apr 07 13:35:03.343973 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1352/2825] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:35:03.923661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c5055825-214c-4147-be38-02f2b3013709 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:03.924326 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c5055825-214c-4147-be38-02f2b3013709 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] [instance: b030e550-f8cb-4465-a4fc-eae429ada5f4] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:03.930585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c5055825-214c-4147-be38-02f2b3013709 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:03.931038 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c5055825-214c-4147-be38-02f2b3013709 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:03.931800 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c5055825-214c-4147-be38-02f2b3013709 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:03.932280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c5055825-214c-4147-be38-02f2b3013709 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:03.945571 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-c5055825-214c-4147-be38-02f2b3013709 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] HTTP exception thrown: Instance b030e550-f8cb-4465-a4fc-eae429ada5f4 could not be found. Apr 07 13:35:03.946152 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c5055825-214c-4147-be38-02f2b3013709 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] Returning 404 to user: Instance b030e550-f8cb-4465-a4fc-eae429ada5f4 could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:35:03.946977 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c5055825-214c-4147-be38-02f2b3013709 tempest-VolumesActionsTest-1353552762 tempest-VolumesActionsTest-1353552762-project] 10.222.0.15 "GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4" status: 404 len: 111 microversion: 2.1 time: 0.027734 Apr 07 13:35:03.947499 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1474/2826] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:35:03 2022] GET /compute/v2.1/servers/b030e550-f8cb-4465-a4fc-eae429ada5f4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:35:33.079934 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e21f046e-dee1-4afa-8a42-8659369bbdf6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:33.080822 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e21f046e-dee1-4afa-8a42-8659369bbdf6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:33.087077 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e21f046e-dee1-4afa-8a42-8659369bbdf6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:33.087540 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e21f046e-dee1-4afa-8a42-8659369bbdf6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:33.088356 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e21f046e-dee1-4afa-8a42-8659369bbdf6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:33.088816 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e21f046e-dee1-4afa-8a42-8659369bbdf6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:33.115031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e21f046e-dee1-4afa-8a42-8659369bbdf6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Going to try to terminate instance {{(pid=116892) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:35:33.209507 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e21f046e-dee1-4afa-8a42-8659369bbdf6 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 204 len: 0 microversion: 2.1 time: 0.133933 Apr 07 13:35:33.210293 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1353/2827] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:35:33 2022] DELETE /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:35:33.218510 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cc6e875f-11c1-4d56-86fc-1da280df40f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:33.219136 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cc6e875f-11c1-4d56-86fc-1da280df40f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:33.225280 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cc6e875f-11c1-4d56-86fc-1da280df40f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:33.225737 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cc6e875f-11c1-4d56-86fc-1da280df40f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:33.226495 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cc6e875f-11c1-4d56-86fc-1da280df40f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:33.226939 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cc6e875f-11c1-4d56-86fc-1da280df40f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:33.361926 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cc6e875f-11c1-4d56-86fc-1da280df40f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:35:33.369509 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cc6e875f-11c1-4d56-86fc-1da280df40f2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1507 microversion: 2.1 time: 0.154797 Apr 07 13:35:33.370067 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1475/2828] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:35:33 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:35:34.233427 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-a57bd398-3fdf-42c0-ba3f-92a14eb23977 req-cd4d2d9c-4927-43c5-9fa1-326f9863c510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac775a7-260a-4442-b7d0-b6d3c331cab3", "name": "network-vif-deleted", "tag": "002ea713-425e-4572-a58f-da5d59ab058d"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:35:34.245793 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-a57bd398-3fdf-42c0-ba3f-92a14eb23977 req-cd4d2d9c-4927-43c5-9fa1-326f9863c510 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:34.246519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-a57bd398-3fdf-42c0-ba3f-92a14eb23977 req-cd4d2d9c-4927-43c5-9fa1-326f9863c510 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:34.261379 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-a57bd398-3fdf-42c0-ba3f-92a14eb23977 req-cd4d2d9c-4927-43c5-9fa1-326f9863c510 service nova] Creating event network-vif-deleted:002ea713-425e-4572-a58f-da5d59ab058d for instance 9ac775a7-260a-4442-b7d0-b6d3c331cab3 on hv-cinder-83694 Apr 07 13:35:34.267279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-a57bd398-3fdf-42c0-ba3f-92a14eb23977 req-cd4d2d9c-4927-43c5-9fa1-326f9863c510 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039008 Apr 07 13:35:34.269303 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1354/2829] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:35:34.386753 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-19e07544-aed1-4d6a-96ec-7f5f87cc2055 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:34.387366 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-19e07544-aed1-4d6a-96ec-7f5f87cc2055 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:34.394387 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19e07544-aed1-4d6a-96ec-7f5f87cc2055 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:34.394837 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19e07544-aed1-4d6a-96ec-7f5f87cc2055 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:34.395603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19e07544-aed1-4d6a-96ec-7f5f87cc2055 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:34.396042 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19e07544-aed1-4d6a-96ec-7f5f87cc2055 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:34.425884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19e07544-aed1-4d6a-96ec-7f5f87cc2055 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:34.426259 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-19e07544-aed1-4d6a-96ec-7f5f87cc2055 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:34.426711 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-19e07544-aed1-4d6a-96ec-7f5f87cc2055 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'fault' on Instance uuid 9ac775a7-260a-4442-b7d0-b6d3c331cab3 {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:35:34.473724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-19e07544-aed1-4d6a-96ec-7f5f87cc2055 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:35:34.481080 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-19e07544-aed1-4d6a-96ec-7f5f87cc2055 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 200 len: 1312 microversion: 2.1 time: 0.098122 Apr 07 13:35:34.481657 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1476/2830] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:35:34 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:35:35.506801 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6307fc36-bfb1-4df9-9c61-84ed7a08afc2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:35.507508 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6307fc36-bfb1-4df9-9c61-84ed7a08afc2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: 9ac775a7-260a-4442-b7d0-b6d3c331cab3] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:35.514064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6307fc36-bfb1-4df9-9c61-84ed7a08afc2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:35.514523 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6307fc36-bfb1-4df9-9c61-84ed7a08afc2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:35.515220 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6307fc36-bfb1-4df9-9c61-84ed7a08afc2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:35.515649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6307fc36-bfb1-4df9-9c61-84ed7a08afc2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:35.529549 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-6307fc36-bfb1-4df9-9c61-84ed7a08afc2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] HTTP exception thrown: Instance 9ac775a7-260a-4442-b7d0-b6d3c331cab3 could not be found. Apr 07 13:35:35.530138 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6307fc36-bfb1-4df9-9c61-84ed7a08afc2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Returning 404 to user: Instance 9ac775a7-260a-4442-b7d0-b6d3c331cab3 could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:35:35.530954 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6307fc36-bfb1-4df9-9c61-84ed7a08afc2 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3" status: 404 len: 111 microversion: 2.1 time: 0.028795 Apr 07 13:35:35.531490 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1355/2831] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:35:35 2022] GET /compute/v2.1/servers/9ac775a7-260a-4442-b7d0-b6d3c331cab3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:35:35.540824 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-2042b3ba-569c-4152-af65-e93da40456d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:35.541307 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2042b3ba-569c-4152-af65-e93da40456d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:35.547357 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2042b3ba-569c-4152-af65-e93da40456d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:35.547807 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2042b3ba-569c-4152-af65-e93da40456d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:35.548587 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2042b3ba-569c-4152-af65-e93da40456d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:35.549655 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-2042b3ba-569c-4152-af65-e93da40456d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:35.573647 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-2042b3ba-569c-4152-af65-e93da40456d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Going to try to terminate instance {{(pid=116893) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:35:35.661091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-2042b3ba-569c-4152-af65-e93da40456d3 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 204 len: 0 microversion: 2.1 time: 0.123406 Apr 07 13:35:35.661732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1477/2832] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:35:35 2022] DELETE /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:35:35.670376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-6274400c-0da9-4e96-9268-851d14226365 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:35.671098 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-6274400c-0da9-4e96-9268-851d14226365 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:35.677800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6274400c-0da9-4e96-9268-851d14226365 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:35.678331 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6274400c-0da9-4e96-9268-851d14226365 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:35.679242 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6274400c-0da9-4e96-9268-851d14226365 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:35.679809 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-6274400c-0da9-4e96-9268-851d14226365 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:35.817284 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-6274400c-0da9-4e96-9268-851d14226365 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:35:35.824924 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-6274400c-0da9-4e96-9268-851d14226365 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1520 microversion: 2.1 time: 0.158421 Apr 07 13:35:35.825485 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1356/2833] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:35:35 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:35:36.514290 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-ce746a25-b1d5-4db4-adb9-217463f1ca83 req-ca071a8e-6314-4808-9546-972bab2c42c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9feccee-a82e-4fcb-9293-a464dc5601cc", "name": "network-vif-deleted", "tag": "e3cb46e9-846c-4fff-b3fc-2991ef26b32f"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:35:36.525624 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-ce746a25-b1d5-4db4-adb9-217463f1ca83 req-ca071a8e-6314-4808-9546-972bab2c42c1 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:36.526260 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-ce746a25-b1d5-4db4-adb9-217463f1ca83 req-ca071a8e-6314-4808-9546-972bab2c42c1 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:36.539146 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-ce746a25-b1d5-4db4-adb9-217463f1ca83 req-ca071a8e-6314-4808-9546-972bab2c42c1 service nova] Creating event network-vif-deleted:e3cb46e9-846c-4fff-b3fc-2991ef26b32f for instance a9feccee-a82e-4fcb-9293-a464dc5601cc on hv-cinder-83694 Apr 07 13:35:36.544916 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-ce746a25-b1d5-4db4-adb9-217463f1ca83 req-ca071a8e-6314-4808-9546-972bab2c42c1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034939 Apr 07 13:35:36.545527 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1478/2834] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:35:36.842788 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-43013ca6-3334-4b63-b354-6b5a0bd31fbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:36.843456 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-43013ca6-3334-4b63-b354-6b5a0bd31fbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:36.852983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43013ca6-3334-4b63-b354-6b5a0bd31fbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:36.853838 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43013ca6-3334-4b63-b354-6b5a0bd31fbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:36.854694 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43013ca6-3334-4b63-b354-6b5a0bd31fbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:36.855206 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43013ca6-3334-4b63-b354-6b5a0bd31fbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:36.896311 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43013ca6-3334-4b63-b354-6b5a0bd31fbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:36.896792 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-43013ca6-3334-4b63-b354-6b5a0bd31fbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:36.897535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.objects.instance [None req-43013ca6-3334-4b63-b354-6b5a0bd31fbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lazy-loading 'fault' on Instance uuid a9feccee-a82e-4fcb-9293-a464dc5601cc {{(pid=116892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:35:36.943451 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-43013ca6-3334-4b63-b354-6b5a0bd31fbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8802ee1876204b2c85b9e54ec50d30f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ec87d1b5e4245aa75e1990d2f3139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:35:36.951136 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-43013ca6-3334-4b63-b354-6b5a0bd31fbc tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 200 len: 1311 microversion: 2.1 time: 0.112355 Apr 07 13:35:36.951811 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1357/2835] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:35:36 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:35:37.969268 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6f1c5756-a39e-4ec9-9b6a-df60a6d59174 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:35:37.969885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6f1c5756-a39e-4ec9-9b6a-df60a6d59174 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] [instance: a9feccee-a82e-4fcb-9293-a464dc5601cc] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:35:37.976525 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f1c5756-a39e-4ec9-9b6a-df60a6d59174 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:37.976966 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f1c5756-a39e-4ec9-9b6a-df60a6d59174 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:37.977725 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f1c5756-a39e-4ec9-9b6a-df60a6d59174 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:35:37.978158 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6f1c5756-a39e-4ec9-9b6a-df60a6d59174 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:35:37.990690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-6f1c5756-a39e-4ec9-9b6a-df60a6d59174 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] HTTP exception thrown: Instance a9feccee-a82e-4fcb-9293-a464dc5601cc could not be found. Apr 07 13:35:37.991269 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6f1c5756-a39e-4ec9-9b6a-df60a6d59174 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] Returning 404 to user: Instance a9feccee-a82e-4fcb-9293-a464dc5601cc could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:35:37.992073 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6f1c5756-a39e-4ec9-9b6a-df60a6d59174 tempest-ServerRescueNegativeTestJSON-1853268720 tempest-ServerRescueNegativeTestJSON-1853268720-project] 10.222.0.15 "GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc" status: 404 len: 111 microversion: 2.1 time: 0.027070 Apr 07 13:35:37.992617 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1479/2836] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:35:37 2022] GET /compute/v2.1/servers/a9feccee-a82e-4fcb-9293-a464dc5601cc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:36:13.869366 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:36:13.869956 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:36:15.369216 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1986940293", "imageRef": "8ef641e1-462f-4579-b0cb-086d7095921d", "flavorRef": "452"}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:36:15.417841 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.network.neutron [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] validate_networks() for None {{(pid=116892) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 13:36:15.918725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Flavor limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 13:36:15.919150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Image limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 13:36:15.919646 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Flavor pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 13:36:15.920055 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Image pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 13:36:15.920572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 13:36:15.930218 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:15.930662 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:15.931454 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:15.931888 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:15.948113 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Getting quotas for project 7ed867c12a2541e490c3841cedf99388. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:36:15.951886 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Getting quotas for user febe819ef8444832a74b5aac39c84403 and project 7ed867c12a2541e490c3841cedf99388. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:36:15.962229 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Going to run 1 instances... {{(pid=116892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 13:36:15.964433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ef641e1-462f-4579-b0cb-086d7095921d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 13:36:16.009087 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c8ccc5d8-451c-4833-a94e-b0c4668fb064 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643691 Apr 07 13:36:16.009911 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1358/2837] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 13:36:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 13:36:16.020884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c0764324-e8ab-49bc-a349-977d8287ff16 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:16.022368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c0764324-e8ab-49bc-a349-977d8287ff16 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:16.079435 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c0764324-e8ab-49bc-a349-977d8287ff16 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febe819ef8444832a74b5aac39c84403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed867c12a2541e490c3841cedf99388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:36:16.086276 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c0764324-e8ab-49bc-a349-977d8287ff16 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 200 len: 1215 microversion: 2.1 time: 0.069658 Apr 07 13:36:16.086844 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1480/2838] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:36:16 2022] GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:36:17.103411 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-e71744ad-15dd-4e4e-8d09-eff2c100a6a3 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:17.104263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-e71744ad-15dd-4e4e-8d09-eff2c100a6a3 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:17.110812 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e71744ad-15dd-4e4e-8d09-eff2c100a6a3 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:17.111552 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e71744ad-15dd-4e4e-8d09-eff2c100a6a3 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:17.112652 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e71744ad-15dd-4e4e-8d09-eff2c100a6a3 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:17.113232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-e71744ad-15dd-4e4e-8d09-eff2c100a6a3 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:17.180313 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-e71744ad-15dd-4e4e-8d09-eff2c100a6a3 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febe819ef8444832a74b5aac39c84403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed867c12a2541e490c3841cedf99388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:36:17.193712 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-e71744ad-15dd-4e4e-8d09-eff2c100a6a3 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 200 len: 1273 microversion: 2.1 time: 0.094587 Apr 07 13:36:17.194289 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1359/2839] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:36:17 2022] GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:36:18.213959 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9537c281-da72-4859-8774-148728c170ff tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:18.215181 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9537c281-da72-4859-8774-148728c170ff tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:18.223116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9537c281-da72-4859-8774-148728c170ff tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:18.223559 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9537c281-da72-4859-8774-148728c170ff tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:18.224373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9537c281-da72-4859-8774-148728c170ff tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:18.224968 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-9537c281-da72-4859-8774-148728c170ff tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:18.489912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9537c281-da72-4859-8774-148728c170ff tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febe819ef8444832a74b5aac39c84403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed867c12a2541e490c3841cedf99388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:36:18.497217 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9537c281-da72-4859-8774-148728c170ff tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 200 len: 1315 microversion: 2.1 time: 0.287087 Apr 07 13:36:18.497781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1481/2840] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:36:18 2022] GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:36:19.007535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-8841de56-4b06-4d4f-a907-698418db23b5 req-cad27dec-d248-4a2e-a23b-99b8e6215ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c7557a-eaa7-43cb-b369-f4ea8d5a79e8", "tag": "0cc6ff58-2e02-4ccc-b369-58c72abe1a95"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:36:19.015880 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-8841de56-4b06-4d4f-a907-698418db23b5 req-cad27dec-d248-4a2e-a23b-99b8e6215ab5 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:19.016612 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-8841de56-4b06-4d4f-a907-698418db23b5 req-cad27dec-d248-4a2e-a23b-99b8e6215ab5 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:19.030535 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-8841de56-4b06-4d4f-a907-698418db23b5 req-cad27dec-d248-4a2e-a23b-99b8e6215ab5 service nova] Creating event network-changed:0cc6ff58-2e02-4ccc-b369-58c72abe1a95 for instance 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 on hv-cinder-83694 Apr 07 13:36:19.036591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-8841de56-4b06-4d4f-a907-698418db23b5 req-cad27dec-d248-4a2e-a23b-99b8e6215ab5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182273 Apr 07 13:36:19.037548 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1360/2841] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:36:19.513921 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b783e379-af55-49b2-950b-93caa2e1c734 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:19.514528 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b783e379-af55-49b2-950b-93caa2e1c734 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:19.521467 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b783e379-af55-49b2-950b-93caa2e1c734 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:19.521910 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b783e379-af55-49b2-950b-93caa2e1c734 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:19.522661 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b783e379-af55-49b2-950b-93caa2e1c734 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:19.523091 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b783e379-af55-49b2-950b-93caa2e1c734 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:19.656475 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b783e379-af55-49b2-950b-93caa2e1c734 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febe819ef8444832a74b5aac39c84403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed867c12a2541e490c3841cedf99388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:36:19.663911 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b783e379-af55-49b2-950b-93caa2e1c734 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 200 len: 1315 microversion: 2.1 time: 0.153781 Apr 07 13:36:19.664615 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1482/2842] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:36:19 2022] GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:36:20.681414 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-95e6e141-f235-43f9-9f72-ad11091d33c4 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:20.682120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-95e6e141-f235-43f9-9f72-ad11091d33c4 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:20.688586 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-95e6e141-f235-43f9-9f72-ad11091d33c4 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:20.689047 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-95e6e141-f235-43f9-9f72-ad11091d33c4 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:20.690505 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-95e6e141-f235-43f9-9f72-ad11091d33c4 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:20.690946 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-95e6e141-f235-43f9-9f72-ad11091d33c4 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:20.838993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-95e6e141-f235-43f9-9f72-ad11091d33c4 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febe819ef8444832a74b5aac39c84403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed867c12a2541e490c3841cedf99388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:36:20.846502 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-95e6e141-f235-43f9-9f72-ad11091d33c4 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 200 len: 1315 microversion: 2.1 time: 0.169582 Apr 07 13:36:20.847101 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1361/2843] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:36:20 2022] GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:36:21.863150 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-690c0e6c-236c-400d-8364-54075f3d7433 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:21.863756 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-690c0e6c-236c-400d-8364-54075f3d7433 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:21.869930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-690c0e6c-236c-400d-8364-54075f3d7433 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:21.870379 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-690c0e6c-236c-400d-8364-54075f3d7433 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:21.871128 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-690c0e6c-236c-400d-8364-54075f3d7433 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:21.871557 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-690c0e6c-236c-400d-8364-54075f3d7433 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:22.007192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-690c0e6c-236c-400d-8364-54075f3d7433 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febe819ef8444832a74b5aac39c84403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed867c12a2541e490c3841cedf99388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:36:22.014849 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-690c0e6c-236c-400d-8364-54075f3d7433 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 200 len: 1315 microversion: 2.1 time: 0.156090 Apr 07 13:36:22.015411 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1483/2844] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:36:21 2022] GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:36:23.032319 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-557b1437-77ac-418d-9a3b-e1ce5e0eeac6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:23.033690 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-557b1437-77ac-418d-9a3b-e1ce5e0eeac6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:23.040464 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-557b1437-77ac-418d-9a3b-e1ce5e0eeac6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:23.040915 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-557b1437-77ac-418d-9a3b-e1ce5e0eeac6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:23.041708 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-557b1437-77ac-418d-9a3b-e1ce5e0eeac6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:23.042147 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-557b1437-77ac-418d-9a3b-e1ce5e0eeac6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:23.181736 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-557b1437-77ac-418d-9a3b-e1ce5e0eeac6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febe819ef8444832a74b5aac39c84403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed867c12a2541e490c3841cedf99388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:36:23.189754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-557b1437-77ac-418d-9a3b-e1ce5e0eeac6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 200 len: 1315 microversion: 2.1 time: 0.160891 Apr 07 13:36:23.190447 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1362/2845] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:36:23 2022] GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:36:23.450903 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-da349f46-23f0-488e-9d6d-63866b820b77 req-43f1f3e3-44f4-4a7f-8009-5cf8d5f032f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c7557a-eaa7-43cb-b369-f4ea8d5a79e8", "name": "network-vif-plugged", "status": "completed", "tag": "0cc6ff58-2e02-4ccc-b369-58c72abe1a95"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:36:23.459598 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-da349f46-23f0-488e-9d6d-63866b820b77 req-43f1f3e3-44f4-4a7f-8009-5cf8d5f032f9 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:23.460043 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-da349f46-23f0-488e-9d6d-63866b820b77 req-43f1f3e3-44f4-4a7f-8009-5cf8d5f032f9 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:23.471203 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-da349f46-23f0-488e-9d6d-63866b820b77 req-43f1f3e3-44f4-4a7f-8009-5cf8d5f032f9 service nova] Creating event network-vif-plugged:0cc6ff58-2e02-4ccc-b369-58c72abe1a95 for instance 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 on hv-cinder-83694 Apr 07 13:36:23.476234 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-da349f46-23f0-488e-9d6d-63866b820b77 req-43f1f3e3-44f4-4a7f-8009-5cf8d5f032f9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091512 Apr 07 13:36:23.476816 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1484/2846] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:36:24.211068 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5dc7726c-853f-46fb-bdd5-b237b6486516 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:24.211597 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5dc7726c-853f-46fb-bdd5-b237b6486516 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:24.217893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5dc7726c-853f-46fb-bdd5-b237b6486516 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:24.218340 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5dc7726c-853f-46fb-bdd5-b237b6486516 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:24.219094 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5dc7726c-853f-46fb-bdd5-b237b6486516 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:24.219528 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5dc7726c-853f-46fb-bdd5-b237b6486516 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:24.352705 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5dc7726c-853f-46fb-bdd5-b237b6486516 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febe819ef8444832a74b5aac39c84403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed867c12a2541e490c3841cedf99388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:36:24.359878 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5dc7726c-853f-46fb-bdd5-b237b6486516 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 200 len: 1315 microversion: 2.1 time: 0.152786 Apr 07 13:36:24.360468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1363/2847] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:36:24 2022] GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:36:25.379630 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-206cd79d-4dde-4555-a5fe-f337d840297d tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:25.380368 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-206cd79d-4dde-4555-a5fe-f337d840297d tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:25.386553 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-206cd79d-4dde-4555-a5fe-f337d840297d tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:25.387008 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-206cd79d-4dde-4555-a5fe-f337d840297d tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:25.387789 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-206cd79d-4dde-4555-a5fe-f337d840297d tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:25.388231 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-206cd79d-4dde-4555-a5fe-f337d840297d tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:25.542487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-206cd79d-4dde-4555-a5fe-f337d840297d tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febe819ef8444832a74b5aac39c84403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed867c12a2541e490c3841cedf99388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:36:25.550473 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-206cd79d-4dde-4555-a5fe-f337d840297d tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 200 len: 1465 microversion: 2.1 time: 0.176934 Apr 07 13:36:25.551030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1485/2848] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:36:25 2022] GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 1465 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:36:25.589497 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-926d01cf-f62b-4513-8312-c2dd099b4ddd tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:25.590067 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-926d01cf-f62b-4513-8312-c2dd099b4ddd tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:25.596478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-926d01cf-f62b-4513-8312-c2dd099b4ddd tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:25.596929 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-926d01cf-f62b-4513-8312-c2dd099b4ddd tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:25.597701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-926d01cf-f62b-4513-8312-c2dd099b4ddd tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:25.598135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-926d01cf-f62b-4513-8312-c2dd099b4ddd tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:25.621670 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-926d01cf-f62b-4513-8312-c2dd099b4ddd tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Going to try to terminate instance {{(pid=116892) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:36:25.694571 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-926d01cf-f62b-4513-8312-c2dd099b4ddd tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "DELETE /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 204 len: 0 microversion: 2.1 time: 0.108467 Apr 07 13:36:25.695107 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1364/2849] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:36:25 2022] DELETE /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:36:25.704985 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6bf5c136-30a8-41ac-946c-1a11926377ba tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:25.705653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6bf5c136-30a8-41ac-946c-1a11926377ba tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:25.711497 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bf5c136-30a8-41ac-946c-1a11926377ba tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:25.711946 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bf5c136-30a8-41ac-946c-1a11926377ba tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:25.712730 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bf5c136-30a8-41ac-946c-1a11926377ba tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:25.713161 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6bf5c136-30a8-41ac-946c-1a11926377ba tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:25.843600 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6bf5c136-30a8-41ac-946c-1a11926377ba tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febe819ef8444832a74b5aac39c84403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed867c12a2541e490c3841cedf99388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:36:25.851834 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6bf5c136-30a8-41ac-946c-1a11926377ba tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 200 len: 1471 microversion: 2.1 time: 0.152161 Apr 07 13:36:25.852431 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1486/2850] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:36:25 2022] GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:36:26.869093 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ac23ed4f-7178-4185-8092-c5be6daa5122 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:26.869826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ac23ed4f-7178-4185-8092-c5be6daa5122 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:26.876043 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac23ed4f-7178-4185-8092-c5be6daa5122 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:26.877125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac23ed4f-7178-4185-8092-c5be6daa5122 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:26.878095 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac23ed4f-7178-4185-8092-c5be6daa5122 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:26.878540 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac23ed4f-7178-4185-8092-c5be6daa5122 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:27.012577 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ac23ed4f-7178-4185-8092-c5be6daa5122 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febe819ef8444832a74b5aac39c84403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed867c12a2541e490c3841cedf99388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:36:27.019839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ac23ed4f-7178-4185-8092-c5be6daa5122 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 200 len: 1471 microversion: 2.1 time: 0.154876 Apr 07 13:36:27.020436 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1365/2851] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:36:26 2022] GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:36:27.453206 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-7033dd34-5551-48b4-b9fb-1922ad2f2ab2 req-490adec0-97d0-4a0c-b82f-5bfa50f85f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c7557a-eaa7-43cb-b369-f4ea8d5a79e8", "name": "network-vif-deleted", "tag": "0cc6ff58-2e02-4ccc-b369-58c72abe1a95"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:36:27.462606 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-7033dd34-5551-48b4-b9fb-1922ad2f2ab2 req-490adec0-97d0-4a0c-b82f-5bfa50f85f46 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:27.463052 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-7033dd34-5551-48b4-b9fb-1922ad2f2ab2 req-490adec0-97d0-4a0c-b82f-5bfa50f85f46 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:27.475631 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-7033dd34-5551-48b4-b9fb-1922ad2f2ab2 req-490adec0-97d0-4a0c-b82f-5bfa50f85f46 service nova] Creating event network-vif-deleted:0cc6ff58-2e02-4ccc-b369-58c72abe1a95 for instance 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 on hv-cinder-83694 Apr 07 13:36:27.481066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-7033dd34-5551-48b4-b9fb-1922ad2f2ab2 req-490adec0-97d0-4a0c-b82f-5bfa50f85f46 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032108 Apr 07 13:36:27.481667 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1487/2852] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:36:28.038334 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1b5594bf-050c-4193-a850-9934c7670cf6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:36:28.038881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-1b5594bf-050c-4193-a850-9934c7670cf6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] [instance: 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:36:28.045195 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b5594bf-050c-4193-a850-9934c7670cf6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:28.045649 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b5594bf-050c-4193-a850-9934c7670cf6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:28.046415 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b5594bf-050c-4193-a850-9934c7670cf6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:36:28.046864 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-1b5594bf-050c-4193-a850-9934c7670cf6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:36:28.059850 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-1b5594bf-050c-4193-a850-9934c7670cf6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] HTTP exception thrown: Instance 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 could not be found. Apr 07 13:36:28.060467 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-1b5594bf-050c-4193-a850-9934c7670cf6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] Returning 404 to user: Instance 24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:36:28.061287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-1b5594bf-050c-4193-a850-9934c7670cf6 tempest-VolumesNegativeTest-57984534 tempest-VolumesNegativeTest-57984534-project] 10.222.0.15 "GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8" status: 404 len: 111 microversion: 2.1 time: 0.026974 Apr 07 13:36:28.061826 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1366/2853] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:36:28 2022] GET /compute/v2.1/servers/24c7557a-eaa7-43cb-b369-f4ea8d5a79e8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:37:34.372381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:37:34.372947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:37:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:38:15.663246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-23bae5f0-07dc-42c1-b436-0c2f72baf674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:38:15.664073 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-23bae5f0-07dc-42c1-b436-0c2f72baf674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:38:15.671242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-23bae5f0-07dc-42c1-b436-0c2f72baf674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:38:15.671690 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-23bae5f0-07dc-42c1-b436-0c2f72baf674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:38:15.672478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-23bae5f0-07dc-42c1-b436-0c2f72baf674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:38:15.672912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-23bae5f0-07dc-42c1-b436-0c2f72baf674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:38:15.686666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.wsgi [None req-23bae5f0-07dc-42c1-b436-0c2f72baf674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] HTTP exception thrown: Instance 58c9a464-496a-4aa9-80dd-f9ec66f515ae could not be found. Apr 07 13:38:15.687248 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-23bae5f0-07dc-42c1-b436-0c2f72baf674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Returning 404 to user: Instance 58c9a464-496a-4aa9-80dd-f9ec66f515ae could not be found. {{(pid=116893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:38:15.688067 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-23bae5f0-07dc-42c1-b436-0c2f72baf674 tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "DELETE /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 404 len: 111 microversion: 2.20 time: 0.032116 Apr 07 13:38:15.688628 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1488/2854] 10.222.0.15 () {60 vars in 1279 bytes} [Thu Apr 7 13:38:15 2022] DELETE /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:38:15.695122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1c3cdca7-a1e1-4bad-8562-26189d5eea42] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 07 13:38:15.698829 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d28eda7f-c027-4b0f-8021-01e02cdea34c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:38:15.699469 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d28eda7f-c027-4b0f-8021-01e02cdea34c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] [instance: 58c9a464-496a-4aa9-80dd-f9ec66f515ae] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:38:15.705279 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d28eda7f-c027-4b0f-8021-01e02cdea34c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:38:15.705725 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d28eda7f-c027-4b0f-8021-01e02cdea34c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:38:15.706478 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d28eda7f-c027-4b0f-8021-01e02cdea34c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:38:15.706910 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d28eda7f-c027-4b0f-8021-01e02cdea34c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:38:15.720072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-d28eda7f-c027-4b0f-8021-01e02cdea34c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] HTTP exception thrown: Instance 58c9a464-496a-4aa9-80dd-f9ec66f515ae could not be found. Apr 07 13:38:15.720674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d28eda7f-c027-4b0f-8021-01e02cdea34c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] Returning 404 to user: Instance 58c9a464-496a-4aa9-80dd-f9ec66f515ae could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:38:15.721476 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d28eda7f-c027-4b0f-8021-01e02cdea34c tempest-AttachVolumeShelveTestJSON-2006475916 tempest-AttachVolumeShelveTestJSON-2006475916-project] 10.222.0.15 "GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae" status: 404 len: 111 microversion: 2.20 time: 0.028328 Apr 07 13:38:15.721979 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1367/2855] 10.222.0.15 () {60 vars in 1276 bytes} [Thu Apr 7 13:38:15 2022] GET /compute/v2.1/servers/58c9a464-496a-4aa9-80dd-f9ec66f515ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 07 13:39:17.101996 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9992f9c0-fb79-4e47-8dbf-1dacf4cd77a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Action: 'create', calling method: .version_select at 0x7fde585ebf70>, body: {"keypair": {"name": "tempest-TestShelveInstance-740580355"}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:39:17.116386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-9992f9c0-fb79-4e47-8dbf-1dacf4cd77a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Getting quotas for project 4bb1b00a427444a88b63e834a0401f67. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:39:17.120371 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-9992f9c0-fb79-4e47-8dbf-1dacf4cd77a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Getting quotas for user 1b16fe3b852343f3b165c60c2490203c and project 4bb1b00a427444a88b63e834a0401f67. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:39:17.132781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9992f9c0-fb79-4e47-8dbf-1dacf4cd77a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [f7793111-5e24-4c61-81a5-3ac1da0c3d2c] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 07 13:39:18.141666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [None req-9992f9c0-fb79-4e47-8dbf-1dacf4cd77a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [f7793111-5e24-4c61-81a5-3ac1da0c3d2c] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 55606. Apr 07 13:39:18.581386 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-9992f9c0-fb79-4e47-8dbf-1dacf4cd77a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Getting quotas for project 4bb1b00a427444a88b63e834a0401f67. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:39:18.585011 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.quota [None req-9992f9c0-fb79-4e47-8dbf-1dacf4cd77a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Getting quotas for user 1b16fe3b852343f3b165c60c2490203c and project 4bb1b00a427444a88b63e834a0401f67. Resources: {'key_pairs'} {{(pid=116893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:39:18.597871 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9992f9c0-fb79-4e47-8dbf-1dacf4cd77a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 1.663807 Apr 07 13:39:18.598367 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1489/2856] 10.222.0.15 () {60 vars in 1157 bytes} [Thu Apr 7 13:39:16 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:32.645486 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:39:32.645982 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:39:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:39:34.131292 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:39:34.131931 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:39:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:39:35.768778 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1976399579", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-740580355", "security_groups": [{"name": "tempest-secgroup-smoke-1650021252"}], "networks": [{"uuid": "5ad4cf65-cab6-422f-82fd-ae2ff4418ca4"}], "block_device_mapping_v2": [{"uuid": "db37278e-2b86-4d68-a449-f72f359efef2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:39:35.790933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] [1c3cdca7-a1e1-4bad-8562-26189d5eea42] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 55732. Apr 07 13:39:35.976468 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.network.neutron [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] validate_networks() for [('5ad4cf65-cab6-422f-82fd-ae2ff4418ca4', None, None, None, None, None)] {{(pid=116892) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 13:39:36.459330 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Flavor limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 13:39:36.459784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Image limits 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 13:39:36.460301 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Flavor pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 13:39:36.460713 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Image pref 0:0:0 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 13:39:36.461122 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.virt.hardware [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 13:39:36.470028 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:36.470473 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:36.471262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:36.471729 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:36.488514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Getting quotas for project 4bb1b00a427444a88b63e834a0401f67. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 13:39:36.492382 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.quota [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Getting quotas for user 1b16fe3b852343f3b165c60c2490203c and project 4bb1b00a427444a88b63e834a0401f67. Resources: {'instances', 'cores', 'ram'} {{(pid=116892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 13:39:36.544300 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:39:36.544781 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:39:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:39:36.551688 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Going to run 1 instances... {{(pid=116892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 13:39:36.553784 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db37278e-2b86-4d68-a449-f72f359efef2',volume_size=None,volume_type=None)] {{(pid=116892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 13:39:36.716521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7e0e2e5d-d910-4f68-8de7-1def22b0f37f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.953335 Apr 07 13:39:36.717881 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1368/2857] 10.222.0.15 () {60 vars in 1146 bytes} [Thu Apr 7 13:39:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 13:39:36.729439 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-9822d134-e372-46b2-be99-b2795ef3d691 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:36.730096 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-9822d134-e372-46b2-be99-b2795ef3d691 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:36.852273 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-9822d134-e372-46b2-be99-b2795ef3d691 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:36.860034 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-9822d134-e372-46b2-be99-b2795ef3d691 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1088 microversion: 2.1 time: 0.136193 Apr 07 13:39:36.860623 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1490/2858] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:36 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1088 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:37.878081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f10e470d-1019-4e23-a55e-193b87b93718 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:37.879754 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f10e470d-1019-4e23-a55e-193b87b93718 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:37.885937 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f10e470d-1019-4e23-a55e-193b87b93718 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:37.886390 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f10e470d-1019-4e23-a55e-193b87b93718 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:37.887158 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f10e470d-1019-4e23-a55e-193b87b93718 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:37.887591 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f10e470d-1019-4e23-a55e-193b87b93718 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:37.951080 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f10e470d-1019-4e23-a55e-193b87b93718 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:37.959594 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f10e470d-1019-4e23-a55e-193b87b93718 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1204 microversion: 2.1 time: 0.086399 Apr 07 13:39:37.960193 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1369/2859] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:37 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1204 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:38.977879 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-55d15a6e-4623-4c2e-a698-7d5d991dd4e5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:38.978487 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-55d15a6e-4623-4c2e-a698-7d5d991dd4e5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:38.987436 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55d15a6e-4623-4c2e-a698-7d5d991dd4e5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:38.987793 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55d15a6e-4623-4c2e-a698-7d5d991dd4e5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:38.988778 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55d15a6e-4623-4c2e-a698-7d5d991dd4e5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:38.989109 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-55d15a6e-4623-4c2e-a698-7d5d991dd4e5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:39.003261 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-9f615a23-0e74-4d42-ab3d-ae8c1c8fdc05 req-7a01f301-62c2-4cab-a8bb-dd0a04373c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f1a430f-5add-4ec9-ad7e-4c7c541a597d", "tag": "b63f349b-2a65-4ea0-ae51-4775408f87c5"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:39:39.013507 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-9f615a23-0e74-4d42-ab3d-ae8c1c8fdc05 req-7a01f301-62c2-4cab-a8bb-dd0a04373c69 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:39.017839 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-9f615a23-0e74-4d42-ab3d-ae8c1c8fdc05 req-7a01f301-62c2-4cab-a8bb-dd0a04373c69 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:39.031734 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-9f615a23-0e74-4d42-ab3d-ae8c1c8fdc05 req-7a01f301-62c2-4cab-a8bb-dd0a04373c69 service nova] Creating event network-changed:b63f349b-2a65-4ea0-ae51-4775408f87c5 for instance 7f1a430f-5add-4ec9-ad7e-4c7c541a597d on hv-cinder-83694 Apr 07 13:39:39.035749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: ERROR oslo.messaging._drivers.impl_rabbit [req-9f615a23-0e74-4d42-ab3d-ae8c1c8fdc05 req-7a01f301-62c2-4cab-a8bb-dd0a04373c69 service nova] [a38ff888-b787-4fbe-aab2-751add62668c] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 07 13:39:39.243021 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-55d15a6e-4623-4c2e-a698-7d5d991dd4e5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:39.251570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-55d15a6e-4623-4c2e-a698-7d5d991dd4e5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1260 microversion: 2.1 time: 0.277573 Apr 07 13:39:39.252167 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1491/2860] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:38 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1260 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:40.043093 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [req-9f615a23-0e74-4d42-ab3d-ae8c1c8fdc05 req-7a01f301-62c2-4cab-a8bb-dd0a04373c69 service nova] [a38ff888-b787-4fbe-aab2-751add62668c] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 55770. Apr 07 13:39:40.047584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-9f615a23-0e74-4d42-ab3d-ae8c1c8fdc05 req-7a01f301-62c2-4cab-a8bb-dd0a04373c69 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.050670 Apr 07 13:39:40.048297 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1370/2861] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:39:40.267603 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-6459d13e-242d-418c-a2a9-e527c59a3711 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:40.268242 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-6459d13e-242d-418c-a2a9-e527c59a3711 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:40.274462 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6459d13e-242d-418c-a2a9-e527c59a3711 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:40.274907 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6459d13e-242d-418c-a2a9-e527c59a3711 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:40.276204 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6459d13e-242d-418c-a2a9-e527c59a3711 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:40.276643 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-6459d13e-242d-418c-a2a9-e527c59a3711 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:40.492761 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-6459d13e-242d-418c-a2a9-e527c59a3711 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:40.501009 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-6459d13e-242d-418c-a2a9-e527c59a3711 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1260 microversion: 2.1 time: 0.237200 Apr 07 13:39:40.501570 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1492/2862] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:40 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:41.518653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f842b0a2-7bae-4143-b362-d5d7be1158c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:41.519350 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f842b0a2-7bae-4143-b362-d5d7be1158c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:41.525583 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f842b0a2-7bae-4143-b362-d5d7be1158c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:41.526031 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f842b0a2-7bae-4143-b362-d5d7be1158c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:41.526793 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f842b0a2-7bae-4143-b362-d5d7be1158c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:41.527232 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f842b0a2-7bae-4143-b362-d5d7be1158c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:41.665494 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f842b0a2-7bae-4143-b362-d5d7be1158c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:41.674765 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f842b0a2-7bae-4143-b362-d5d7be1158c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1260 microversion: 2.1 time: 0.161118 Apr 07 13:39:41.675324 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1371/2863] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:41 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:42.694074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-c2240a46-2c69-46c6-bbd9-346f638e2cf2 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:42.694697 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-c2240a46-2c69-46c6-bbd9-346f638e2cf2 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:42.702264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2240a46-2c69-46c6-bbd9-346f638e2cf2 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:42.702264 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2240a46-2c69-46c6-bbd9-346f638e2cf2 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:42.703445 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2240a46-2c69-46c6-bbd9-346f638e2cf2 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:42.703884 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-c2240a46-2c69-46c6-bbd9-346f638e2cf2 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:42.847305 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-c2240a46-2c69-46c6-bbd9-346f638e2cf2 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:42.854471 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-c2240a46-2c69-46c6-bbd9-346f638e2cf2 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1260 microversion: 2.1 time: 0.165843 Apr 07 13:39:42.855029 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1493/2864] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:42 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:43.871020 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-5d6848da-2613-456a-be92-fe2e06fd1426 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:43.871641 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-5d6848da-2613-456a-be92-fe2e06fd1426 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:43.878701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d6848da-2613-456a-be92-fe2e06fd1426 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:43.879150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d6848da-2613-456a-be92-fe2e06fd1426 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:43.879916 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d6848da-2613-456a-be92-fe2e06fd1426 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:43.880382 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-5d6848da-2613-456a-be92-fe2e06fd1426 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:44.016181 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-5d6848da-2613-456a-be92-fe2e06fd1426 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:44.023510 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-5d6848da-2613-456a-be92-fe2e06fd1426 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1260 microversion: 2.1 time: 0.156328 Apr 07 13:39:44.024064 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1372/2865] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:43 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:45.040613 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-702011fa-d80c-49d4-a42d-9a8c324889f8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:45.041244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-702011fa-d80c-49d4-a42d-9a8c324889f8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:45.047949 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-702011fa-d80c-49d4-a42d-9a8c324889f8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:45.048441 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-702011fa-d80c-49d4-a42d-9a8c324889f8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:45.049244 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-702011fa-d80c-49d4-a42d-9a8c324889f8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:45.049678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-702011fa-d80c-49d4-a42d-9a8c324889f8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:45.181507 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-702011fa-d80c-49d4-a42d-9a8c324889f8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:45.189270 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-702011fa-d80c-49d4-a42d-9a8c324889f8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1260 microversion: 2.1 time: 0.152437 Apr 07 13:39:45.189829 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1494/2866] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:45 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:46.206349 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7aa66c33-102e-49ff-8be3-94867375d095 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:46.206960 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7aa66c33-102e-49ff-8be3-94867375d095 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:46.213308 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7aa66c33-102e-49ff-8be3-94867375d095 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:46.213761 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7aa66c33-102e-49ff-8be3-94867375d095 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:46.214521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7aa66c33-102e-49ff-8be3-94867375d095 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:46.214963 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7aa66c33-102e-49ff-8be3-94867375d095 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:46.346653 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7aa66c33-102e-49ff-8be3-94867375d095 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:46.353905 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7aa66c33-102e-49ff-8be3-94867375d095 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1260 microversion: 2.1 time: 0.151375 Apr 07 13:39:46.354463 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1373/2867] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:46 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:47.370415 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-5ddb6c12-354a-4597-a375-8af09df65a8e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:47.371026 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-5ddb6c12-354a-4597-a375-8af09df65a8e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:47.377478 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5ddb6c12-354a-4597-a375-8af09df65a8e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:47.377930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5ddb6c12-354a-4597-a375-8af09df65a8e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:47.378678 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5ddb6c12-354a-4597-a375-8af09df65a8e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:47.379108 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-5ddb6c12-354a-4597-a375-8af09df65a8e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:47.512655 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-5ddb6c12-354a-4597-a375-8af09df65a8e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:47.520329 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-5ddb6c12-354a-4597-a375-8af09df65a8e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1260 microversion: 2.1 time: 0.153703 Apr 07 13:39:47.520881 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1495/2868] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:47 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:48.538063 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-9fccec67-005d-486d-8b25-5ceab87df863 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:48.538608 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-9fccec67-005d-486d-8b25-5ceab87df863 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:48.544908 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9fccec67-005d-486d-8b25-5ceab87df863 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:48.545355 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9fccec67-005d-486d-8b25-5ceab87df863 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:48.546127 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9fccec67-005d-486d-8b25-5ceab87df863 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:48.546567 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-9fccec67-005d-486d-8b25-5ceab87df863 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:48.681607 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-9fccec67-005d-486d-8b25-5ceab87df863 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:48.689457 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-9fccec67-005d-486d-8b25-5ceab87df863 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1260 microversion: 2.1 time: 0.155524 Apr 07 13:39:48.690230 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1374/2869] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:48 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:49.706359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-dae7e648-e79d-439f-bb40-8be8849d392b tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:49.706964 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-dae7e648-e79d-439f-bb40-8be8849d392b tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:49.713312 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dae7e648-e79d-439f-bb40-8be8849d392b tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:49.713757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dae7e648-e79d-439f-bb40-8be8849d392b tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:49.714503 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dae7e648-e79d-439f-bb40-8be8849d392b tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:49.714930 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-dae7e648-e79d-439f-bb40-8be8849d392b tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:49.857190 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-dae7e648-e79d-439f-bb40-8be8849d392b tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:49.864995 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-dae7e648-e79d-439f-bb40-8be8849d392b tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1260 microversion: 2.1 time: 0.163099 Apr 07 13:39:49.865552 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1496/2870] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:49 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:50.452103 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-c6d78e9d-613e-480e-a2ad-1b7dd62eb57e req-e0a81e78-2ad2-4501-93d9-76e5556dbbcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1a430f-5add-4ec9-ad7e-4c7c541a597d", "name": "network-vif-plugged", "status": "completed", "tag": "b63f349b-2a65-4ea0-ae51-4775408f87c5"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:39:50.460572 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-c6d78e9d-613e-480e-a2ad-1b7dd62eb57e req-e0a81e78-2ad2-4501-93d9-76e5556dbbcf service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:50.461072 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-c6d78e9d-613e-480e-a2ad-1b7dd62eb57e req-e0a81e78-2ad2-4501-93d9-76e5556dbbcf service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:50.472623 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-c6d78e9d-613e-480e-a2ad-1b7dd62eb57e req-e0a81e78-2ad2-4501-93d9-76e5556dbbcf service nova] Creating event network-vif-plugged:b63f349b-2a65-4ea0-ae51-4775408f87c5 for instance 7f1a430f-5add-4ec9-ad7e-4c7c541a597d on hv-cinder-83694 Apr 07 13:39:50.477573 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-c6d78e9d-613e-480e-a2ad-1b7dd62eb57e req-e0a81e78-2ad2-4501-93d9-76e5556dbbcf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029165 Apr 07 13:39:50.478170 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1375/2871] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:39:50.881403 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-53b54d0f-e19d-497a-aac2-ec94f1b225a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:50.882008 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-53b54d0f-e19d-497a-aac2-ec94f1b225a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:50.888277 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53b54d0f-e19d-497a-aac2-ec94f1b225a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:50.888724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53b54d0f-e19d-497a-aac2-ec94f1b225a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:50.889485 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53b54d0f-e19d-497a-aac2-ec94f1b225a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:50.889912 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-53b54d0f-e19d-497a-aac2-ec94f1b225a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:51.023040 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-53b54d0f-e19d-497a-aac2-ec94f1b225a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:51.030842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-53b54d0f-e19d-497a-aac2-ec94f1b225a7 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1260 microversion: 2.1 time: 0.153238 Apr 07 13:39:51.031401 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1497/2872] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:50 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:52.049922 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a37a3fc9-c169-479f-9583-a775fdc3d32a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:52.050628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a37a3fc9-c169-479f-9583-a775fdc3d32a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:52.057156 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a37a3fc9-c169-479f-9583-a775fdc3d32a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:52.057609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a37a3fc9-c169-479f-9583-a775fdc3d32a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:52.058373 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a37a3fc9-c169-479f-9583-a775fdc3d32a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:52.058799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a37a3fc9-c169-479f-9583-a775fdc3d32a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:52.197299 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a37a3fc9-c169-479f-9583-a775fdc3d32a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:52.204868 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a37a3fc9-c169-479f-9583-a775fdc3d32a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1444 microversion: 2.1 time: 0.161724 Apr 07 13:39:52.205433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1376/2873] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:52 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:52.220768 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d59a357f-6ea8-4210-b72a-c1fb105f9629 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:39:52.221381 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d59a357f-6ea8-4210-b72a-c1fb105f9629 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:39:52.227205 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d59a357f-6ea8-4210-b72a-c1fb105f9629 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:52.227653 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d59a357f-6ea8-4210-b72a-c1fb105f9629 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:52.228443 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d59a357f-6ea8-4210-b72a-c1fb105f9629 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:52.228875 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d59a357f-6ea8-4210-b72a-c1fb105f9629 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:52.359116 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d59a357f-6ea8-4210-b72a-c1fb105f9629 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:39:52.366394 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d59a357f-6ea8-4210-b72a-c1fb105f9629 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1444 microversion: 2.1 time: 0.149653 Apr 07 13:39:52.366955 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1498/2874] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:39:52 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:39:54.090497 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-eb1e7dab-07c2-423c-9358-82a5e72b718c req-7bd3b6b1-a0ba-4d73-912e-26798bd7327d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f1a430f-5add-4ec9-ad7e-4c7c541a597d", "tag": "b63f349b-2a65-4ea0-ae51-4775408f87c5"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:39:54.098865 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-eb1e7dab-07c2-423c-9358-82a5e72b718c req-7bd3b6b1-a0ba-4d73-912e-26798bd7327d service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:39:54.099263 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-eb1e7dab-07c2-423c-9358-82a5e72b718c req-7bd3b6b1-a0ba-4d73-912e-26798bd7327d service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:39:54.110504 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-eb1e7dab-07c2-423c-9358-82a5e72b718c req-7bd3b6b1-a0ba-4d73-912e-26798bd7327d service nova] Creating event network-changed:b63f349b-2a65-4ea0-ae51-4775408f87c5 for instance 7f1a430f-5add-4ec9-ad7e-4c7c541a597d on hv-cinder-83694 Apr 07 13:39:54.115669 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-eb1e7dab-07c2-423c-9358-82a5e72b718c req-7bd3b6b1-a0ba-4d73-912e-26798bd7327d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091611 Apr 07 13:39:54.116513 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1377/2875] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:40:54.380685 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:40:54.381294 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:40:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:41:49.345219 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7de43ba-a497-4d62-95ca-11d7fc769a17] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 07 13:41:49.349537 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-27254f01-e1b3-4c2a-9049-cfa2a61d2007 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:41:49.350062 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-27254f01-e1b3-4c2a-9049-cfa2a61d2007 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:41:49.355935 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27254f01-e1b3-4c2a-9049-cfa2a61d2007 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:49.356423 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27254f01-e1b3-4c2a-9049-cfa2a61d2007 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:49.357179 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27254f01-e1b3-4c2a-9049-cfa2a61d2007 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:49.357609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-27254f01-e1b3-4c2a-9049-cfa2a61d2007 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:49.378863 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.objects.instance [None req-27254f01-e1b3-4c2a-9049-cfa2a61d2007 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lazy-loading 'flavor' on Instance uuid 7f1a430f-5add-4ec9-ad7e-4c7c541a597d {{(pid=116893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 13:41:49.450567 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-27254f01-e1b3-4c2a-9049-cfa2a61d2007 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "POST /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d/action" status: 202 len: 0 microversion: 2.1 time: 0.107181 Apr 07 13:41:49.451400 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1499/2876] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 13:41:49 2022] POST /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:41:49.461891 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-33bb869c-9041-4d1b-a10b-fe36bd7ad608 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:41:49.462588 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-33bb869c-9041-4d1b-a10b-fe36bd7ad608 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:41:49.468628 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-33bb869c-9041-4d1b-a10b-fe36bd7ad608 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:49.469099 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-33bb869c-9041-4d1b-a10b-fe36bd7ad608 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:49.470150 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-33bb869c-9041-4d1b-a10b-fe36bd7ad608 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:49.470519 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-33bb869c-9041-4d1b-a10b-fe36bd7ad608 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:49.608634 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-33bb869c-9041-4d1b-a10b-fe36bd7ad608 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:41:49.616983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-33bb869c-9041-4d1b-a10b-fe36bd7ad608 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.161240 Apr 07 13:41:49.617566 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1378/2877] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:41:49 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:41:50.634694 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-05bff6f7-e6a9-42fd-aff7-b5716e32ca13 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:41:50.635388 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-05bff6f7-e6a9-42fd-aff7-b5716e32ca13 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:41:50.647227 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7de43ba-a497-4d62-95ca-11d7fc769a17] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 55842. Apr 07 13:41:50.648960 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-05bff6f7-e6a9-42fd-aff7-b5716e32ca13 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:50.649417 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-05bff6f7-e6a9-42fd-aff7-b5716e32ca13 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:50.650187 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-05bff6f7-e6a9-42fd-aff7-b5716e32ca13 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:50.650629 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-05bff6f7-e6a9-42fd-aff7-b5716e32ca13 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:50.783718 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-05bff6f7-e6a9-42fd-aff7-b5716e32ca13 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:41:50.792018 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-05bff6f7-e6a9-42fd-aff7-b5716e32ca13 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.161469 Apr 07 13:41:50.792609 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1500/2878] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:41:50 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:41:51.809116 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-fca6ace9-1156-455a-9d98-995fdf7e5b58 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:41:51.809799 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-fca6ace9-1156-455a-9d98-995fdf7e5b58 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:41:51.816257 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fca6ace9-1156-455a-9d98-995fdf7e5b58 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:51.816707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fca6ace9-1156-455a-9d98-995fdf7e5b58 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:51.817466 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fca6ace9-1156-455a-9d98-995fdf7e5b58 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:51.817971 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-fca6ace9-1156-455a-9d98-995fdf7e5b58 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:51.952202 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-fca6ace9-1156-455a-9d98-995fdf7e5b58 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:41:51.960189 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-fca6ace9-1156-455a-9d98-995fdf7e5b58 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.154843 Apr 07 13:41:51.960749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1379/2879] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:41:51 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:41:52.977544 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-67aef50f-4684-4716-861f-772cf05c16a5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:41:52.978162 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-67aef50f-4684-4716-861f-772cf05c16a5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:41:52.984465 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-67aef50f-4684-4716-861f-772cf05c16a5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:52.984919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-67aef50f-4684-4716-861f-772cf05c16a5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:52.985679 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-67aef50f-4684-4716-861f-772cf05c16a5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:52.986117 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-67aef50f-4684-4716-861f-772cf05c16a5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:53.118771 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-67aef50f-4684-4716-861f-772cf05c16a5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:41:53.126087 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-67aef50f-4684-4716-861f-772cf05c16a5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.152975 Apr 07 13:41:53.126637 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1501/2880] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:41:52 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:41:54.142874 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f31ec79e-5918-4cee-a613-98125884d15a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:41:54.143408 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f31ec79e-5918-4cee-a613-98125884d15a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:41:54.149920 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f31ec79e-5918-4cee-a613-98125884d15a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:54.150375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f31ec79e-5918-4cee-a613-98125884d15a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:54.151141 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f31ec79e-5918-4cee-a613-98125884d15a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:54.151585 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f31ec79e-5918-4cee-a613-98125884d15a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:54.282730 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-f31ec79e-5918-4cee-a613-98125884d15a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:41:54.290789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f31ec79e-5918-4cee-a613-98125884d15a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.151808 Apr 07 13:41:54.291346 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1380/2881] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:41:54 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:41:55.308035 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-946606e9-0401-45c8-8127-ae60b4258db5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:41:55.308666 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-946606e9-0401-45c8-8127-ae60b4258db5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:41:55.314973 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-946606e9-0401-45c8-8127-ae60b4258db5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:55.315420 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-946606e9-0401-45c8-8127-ae60b4258db5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:55.316192 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-946606e9-0401-45c8-8127-ae60b4258db5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:55.316625 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-946606e9-0401-45c8-8127-ae60b4258db5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:55.452636 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-946606e9-0401-45c8-8127-ae60b4258db5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:41:55.460515 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-946606e9-0401-45c8-8127-ae60b4258db5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.156269 Apr 07 13:41:55.461076 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1502/2882] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:41:55 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:41:56.477503 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-d7b4cc04-1b6d-44d3-a71a-5ee7dad61934 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:41:56.478098 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-d7b4cc04-1b6d-44d3-a71a-5ee7dad61934 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:41:56.484372 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d7b4cc04-1b6d-44d3-a71a-5ee7dad61934 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:56.484823 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d7b4cc04-1b6d-44d3-a71a-5ee7dad61934 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:56.485582 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d7b4cc04-1b6d-44d3-a71a-5ee7dad61934 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:56.486016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-d7b4cc04-1b6d-44d3-a71a-5ee7dad61934 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:56.618938 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-d7b4cc04-1b6d-44d3-a71a-5ee7dad61934 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:41:56.626343 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-d7b4cc04-1b6d-44d3-a71a-5ee7dad61934 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.152787 Apr 07 13:41:56.627190 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1381/2883] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:41:56 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:41:57.643839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0020402d-6a15-45c6-938d-f6382469c8c6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:41:57.644468 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0020402d-6a15-45c6-938d-f6382469c8c6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:41:57.651101 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0020402d-6a15-45c6-938d-f6382469c8c6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:57.651546 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0020402d-6a15-45c6-938d-f6382469c8c6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:57.652320 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0020402d-6a15-45c6-938d-f6382469c8c6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:57.652751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0020402d-6a15-45c6-938d-f6382469c8c6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:57.793873 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0020402d-6a15-45c6-938d-f6382469c8c6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:41:57.801238 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0020402d-6a15-45c6-938d-f6382469c8c6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.161190 Apr 07 13:41:57.801803 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1503/2884] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:41:57 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:41:58.818400 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-c26e00a9-9677-4cfd-9b60-c2cff815949f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:41:58.819012 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-c26e00a9-9677-4cfd-9b60-c2cff815949f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:41:58.825325 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c26e00a9-9677-4cfd-9b60-c2cff815949f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:58.825773 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c26e00a9-9677-4cfd-9b60-c2cff815949f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:58.826527 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c26e00a9-9677-4cfd-9b60-c2cff815949f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:41:58.826964 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-c26e00a9-9677-4cfd-9b60-c2cff815949f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:41:59.198893 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-c26e00a9-9677-4cfd-9b60-c2cff815949f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:41:59.206120 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-c26e00a9-9677-4cfd-9b60-c2cff815949f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.392003 Apr 07 13:41:59.206674 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1382/2885] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:41:58 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:42:00.225424 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-906e8159-c4db-4655-a2da-0a96869e025e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:42:00.226030 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-906e8159-c4db-4655-a2da-0a96869e025e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:00.232361 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-906e8159-c4db-4655-a2da-0a96869e025e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:00.232811 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-906e8159-c4db-4655-a2da-0a96869e025e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:00.233566 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-906e8159-c4db-4655-a2da-0a96869e025e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:00.234001 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-906e8159-c4db-4655-a2da-0a96869e025e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:00.370644 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-906e8159-c4db-4655-a2da-0a96869e025e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:42:00.377853 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-906e8159-c4db-4655-a2da-0a96869e025e tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.156851 Apr 07 13:42:00.378414 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1504/2886] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:42:00 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:42:01.395207 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-161a4fd9-0a5b-4910-b1fe-c61a5b2e2ffd tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:42:01.395851 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-161a4fd9-0a5b-4910-b1fe-c61a5b2e2ffd tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:01.402154 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-161a4fd9-0a5b-4910-b1fe-c61a5b2e2ffd tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:01.402602 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-161a4fd9-0a5b-4910-b1fe-c61a5b2e2ffd tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:01.403375 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-161a4fd9-0a5b-4910-b1fe-c61a5b2e2ffd tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:01.403789 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-161a4fd9-0a5b-4910-b1fe-c61a5b2e2ffd tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:01.534970 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-161a4fd9-0a5b-4910-b1fe-c61a5b2e2ffd tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:42:01.542873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-161a4fd9-0a5b-4910-b1fe-c61a5b2e2ffd tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.151481 Apr 07 13:42:01.543433 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1383/2887] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:42:01 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:42:02.560306 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-0fddc537-f754-45d5-a691-d59b90abfeff tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:42:02.560919 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-0fddc537-f754-45d5-a691-d59b90abfeff tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:02.567153 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0fddc537-f754-45d5-a691-d59b90abfeff tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:02.567610 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0fddc537-f754-45d5-a691-d59b90abfeff tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:02.568892 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0fddc537-f754-45d5-a691-d59b90abfeff tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:02.569328 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-0fddc537-f754-45d5-a691-d59b90abfeff tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:02.702044 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-0fddc537-f754-45d5-a691-d59b90abfeff tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:42:02.709375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-0fddc537-f754-45d5-a691-d59b90abfeff tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1510 microversion: 2.1 time: 0.152966 Apr 07 13:42:02.709936 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1505/2888] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:42:02 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:42:02.725706 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-f62968fa-e78d-4f28-9f49-7560e503d2b5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:42:02.726274 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-f62968fa-e78d-4f28-9f49-7560e503d2b5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:02.732609 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f62968fa-e78d-4f28-9f49-7560e503d2b5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:02.733065 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f62968fa-e78d-4f28-9f49-7560e503d2b5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:02.733852 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f62968fa-e78d-4f28-9f49-7560e503d2b5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:02.734287 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-f62968fa-e78d-4f28-9f49-7560e503d2b5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:02.820699 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-f62968fa-e78d-4f28-9f49-7560e503d2b5 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "POST /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d/action" status: 202 len: 0 microversion: 2.1 time: 0.099211 Apr 07 13:42:02.821222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1384/2889] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Apr 7 13:42:02 2022] POST /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:42:02.829115 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-4f97110d-a168-4c8e-aab5-23cdddd2a871 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:42:02.829757 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-4f97110d-a168-4c8e-aab5-23cdddd2a871 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:02.836235 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f97110d-a168-4c8e-aab5-23cdddd2a871 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:02.836689 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f97110d-a168-4c8e-aab5-23cdddd2a871 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:02.837447 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f97110d-a168-4c8e-aab5-23cdddd2a871 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:02.837885 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-4f97110d-a168-4c8e-aab5-23cdddd2a871 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:02.975648 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-4f97110d-a168-4c8e-aab5-23cdddd2a871 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:42:02.983010 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-4f97110d-a168-4c8e-aab5-23cdddd2a871 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1518 microversion: 2.1 time: 0.157716 Apr 07 13:42:02.983845 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1506/2890] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:42:02 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:42:04.001102 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-ac5df56c-5b31-4726-8d1a-d404b153b6c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:42:04.001710 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-ac5df56c-5b31-4726-8d1a-d404b153b6c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:04.011537 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac5df56c-5b31-4726-8d1a-d404b153b6c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:04.012016 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac5df56c-5b31-4726-8d1a-d404b153b6c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:04.012814 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac5df56c-5b31-4726-8d1a-d404b153b6c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:04.013251 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-ac5df56c-5b31-4726-8d1a-d404b153b6c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:04.150140 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-ac5df56c-5b31-4726-8d1a-d404b153b6c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:42:04.157648 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-ac5df56c-5b31-4726-8d1a-d404b153b6c8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1520 microversion: 2.1 time: 0.160791 Apr 07 13:42:04.158211 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1385/2891] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:42:03 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:42:05.097340 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-cba2d747-171e-47a9-854c-ca4c73d4b833 req-fcf71c32-b329-4f12-88d7-79b52caafd5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1a430f-5add-4ec9-ad7e-4c7c541a597d", "name": "network-vif-unplugged", "status": "completed", "tag": "b63f349b-2a65-4ea0-ae51-4775408f87c5"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:42:05.105897 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-cba2d747-171e-47a9-854c-ca4c73d4b833 req-fcf71c32-b329-4f12-88d7-79b52caafd5e service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:05.106348 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-cba2d747-171e-47a9-854c-ca4c73d4b833 req-fcf71c32-b329-4f12-88d7-79b52caafd5e service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:05.117088 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-cba2d747-171e-47a9-854c-ca4c73d4b833 req-fcf71c32-b329-4f12-88d7-79b52caafd5e service nova] Creating event network-vif-unplugged:b63f349b-2a65-4ea0-ae51-4775408f87c5 for instance 7f1a430f-5add-4ec9-ad7e-4c7c541a597d on hv-cinder-83694 Apr 07 13:42:05.122202 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-cba2d747-171e-47a9-854c-ca4c73d4b833 req-fcf71c32-b329-4f12-88d7-79b52caafd5e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082804 Apr 07 13:42:05.122375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1507/2892] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:42:05.175135 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b9fda637-14a1-4007-806b-76ba89ad450c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:42:05.175746 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b9fda637-14a1-4007-806b-76ba89ad450c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:05.182273 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9fda637-14a1-4007-806b-76ba89ad450c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:05.182727 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9fda637-14a1-4007-806b-76ba89ad450c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:05.183487 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9fda637-14a1-4007-806b-76ba89ad450c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:05.183932 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b9fda637-14a1-4007-806b-76ba89ad450c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:05.313584 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-b9fda637-14a1-4007-806b-76ba89ad450c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:42:05.320967 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b9fda637-14a1-4007-806b-76ba89ad450c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1576 microversion: 2.1 time: 0.149587 Apr 07 13:42:05.321530 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1386/2893] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:42:05 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:42:06.339676 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-414d02f9-a0fc-4bbd-bd27-533932b834b8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:42:06.340391 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-414d02f9-a0fc-4bbd-bd27-533932b834b8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:06.346412 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-414d02f9-a0fc-4bbd-bd27-533932b834b8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:06.346858 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-414d02f9-a0fc-4bbd-bd27-533932b834b8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:06.347601 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-414d02f9-a0fc-4bbd-bd27-533932b834b8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:06.348032 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-414d02f9-a0fc-4bbd-bd27-533932b834b8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:06.484066 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-414d02f9-a0fc-4bbd-bd27-533932b834b8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:42:06.492081 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-414d02f9-a0fc-4bbd-bd27-533932b834b8 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1576 microversion: 2.1 time: 0.157038 Apr 07 13:42:06.492674 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1508/2894] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:42:06 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:42:07.509187 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-aab855a8-ac23-4314-8d3a-054df3f97c08 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:42:07.509809 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-aab855a8-ac23-4314-8d3a-054df3f97c08 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:07.515755 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aab855a8-ac23-4314-8d3a-054df3f97c08 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:07.516239 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aab855a8-ac23-4314-8d3a-054df3f97c08 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:07.517002 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aab855a8-ac23-4314-8d3a-054df3f97c08 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:07.517442 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-aab855a8-ac23-4314-8d3a-054df3f97c08 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:07.655219 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-aab855a8-ac23-4314-8d3a-054df3f97c08 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:42:07.665805 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-aab855a8-ac23-4314-8d3a-054df3f97c08 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1576 microversion: 2.1 time: 0.160608 Apr 07 13:42:07.666376 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1387/2895] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:42:07 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:42:08.685246 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-a30efc92-f253-4f9d-b1e4-b59524d2b27c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:42:08.685872 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-a30efc92-f253-4f9d-b1e4-b59524d2b27c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:08.692404 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a30efc92-f253-4f9d-b1e4-b59524d2b27c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:08.692867 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a30efc92-f253-4f9d-b1e4-b59524d2b27c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:08.693924 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a30efc92-f253-4f9d-b1e4-b59524d2b27c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:08.696616 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-a30efc92-f253-4f9d-b1e4-b59524d2b27c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:08.837987 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-a30efc92-f253-4f9d-b1e4-b59524d2b27c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:42:08.845362 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-a30efc92-f253-4f9d-b1e4-b59524d2b27c tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1576 microversion: 2.1 time: 0.165598 Apr 07 13:42:08.845929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1509/2896] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:42:08 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:42:09.862737 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-a0232ac5-a8c8-4258-8b44-bff34fdca5ce tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:42:09.863385 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-a0232ac5-a8c8-4258-8b44-bff34fdca5ce tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:09.869676 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0232ac5-a8c8-4258-8b44-bff34fdca5ce tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:09.870125 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0232ac5-a8c8-4258-8b44-bff34fdca5ce tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:09.870892 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0232ac5-a8c8-4258-8b44-bff34fdca5ce tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:09.871333 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-a0232ac5-a8c8-4258-8b44-bff34fdca5ce tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:10.017471 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-a0232ac5-a8c8-4258-8b44-bff34fdca5ce tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:42:10.025521 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-a0232ac5-a8c8-4258-8b44-bff34fdca5ce tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1576 microversion: 2.1 time: 0.166613 Apr 07 13:42:10.026081 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1388/2897] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:42:09 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:42:11.042900 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-b64583a1-49c3-4050-9ccb-8c925f5d70d6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:42:11.043506 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-b64583a1-49c3-4050-9ccb-8c925f5d70d6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:11.049838 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b64583a1-49c3-4050-9ccb-8c925f5d70d6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:11.050283 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b64583a1-49c3-4050-9ccb-8c925f5d70d6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:11.051043 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b64583a1-49c3-4050-9ccb-8c925f5d70d6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:11.051474 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-b64583a1-49c3-4050-9ccb-8c925f5d70d6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:11.188955 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-b64583a1-49c3-4050-9ccb-8c925f5d70d6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:42:11.196842 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-b64583a1-49c3-4050-9ccb-8c925f5d70d6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1576 microversion: 2.1 time: 0.158026 Apr 07 13:42:11.197585 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1510/2898] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:42:11 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:42:12.214707 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-2af4b71a-04f1-45e4-9928-3e74a988dbf6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:42:12.215323 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-2af4b71a-04f1-45e4-9928-3e74a988dbf6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:42:12.221800 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2af4b71a-04f1-45e4-9928-3e74a988dbf6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:12.222258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2af4b71a-04f1-45e4-9928-3e74a988dbf6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:12.223027 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2af4b71a-04f1-45e4-9928-3e74a988dbf6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:12.223471 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-2af4b71a-04f1-45e4-9928-3e74a988dbf6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:12.361117 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-2af4b71a-04f1-45e4-9928-3e74a988dbf6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:42:12.368695 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-2af4b71a-04f1-45e4-9928-3e74a988dbf6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1563 microversion: 2.1 time: 0.157845 Apr 07 13:42:12.369258 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1389/2899] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:42:12 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:42:15.170839 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-0f3caa9f-b095-4f8d-80ca-79954d407eff req-101eb931-fad5-4936-9480-526c0237cbda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1a430f-5add-4ec9-ad7e-4c7c541a597d", "name": "network-vif-plugged", "status": "completed", "tag": "b63f349b-2a65-4ea0-ae51-4775408f87c5"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:42:15.181336 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-0f3caa9f-b095-4f8d-80ca-79954d407eff req-101eb931-fad5-4936-9480-526c0237cbda service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:42:15.181947 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-0f3caa9f-b095-4f8d-80ca-79954d407eff req-101eb931-fad5-4936-9480-526c0237cbda service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:42:15.192751 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-0f3caa9f-b095-4f8d-80ca-79954d407eff req-101eb931-fad5-4936-9480-526c0237cbda service nova] Creating event network-vif-plugged:b63f349b-2a65-4ea0-ae51-4775408f87c5 for instance 7f1a430f-5add-4ec9-ad7e-4c7c541a597d on hv-cinder-83694 Apr 07 13:42:15.197929 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-0f3caa9f-b095-4f8d-80ca-79954d407eff req-101eb931-fad5-4936-9480-526c0237cbda service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030815 Apr 07 13:42:15.198724 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1511/2900] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:42:54.139698 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:42:54.140304 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:42:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:43:03.453749 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:43:03.454450 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:43:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:43:29.096040 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7fdf287a-ba6f-451f-9f04-89d9d6ab4b8d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:43:29.096701 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7fdf287a-ba6f-451f-9f04-89d9d6ab4b8d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:43:29.102873 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7fdf287a-ba6f-451f-9f04-89d9d6ab4b8d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:43:29.103872 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7fdf287a-ba6f-451f-9f04-89d9d6ab4b8d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:43:29.104731 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7fdf287a-ba6f-451f-9f04-89d9d6ab4b8d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:43:29.105369 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7fdf287a-ba6f-451f-9f04-89d9d6ab4b8d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:43:29.131023 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7fdf287a-ba6f-451f-9f04-89d9d6ab4b8d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Going to try to terminate instance {{(pid=116892) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 13:43:29.189373 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [req-325245cb-5f30-4b5e-97c5-84392e9d8827 req-de7b15d9-01f1-4e7d-81c2-22867ca9b8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f1a430f-5add-4ec9-ad7e-4c7c541a597d", "tag": "b63f349b-2a65-4ea0-ae51-4775408f87c5"}]} {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:43:29.201540 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-325245cb-5f30-4b5e-97c5-84392e9d8827 req-de7b15d9-01f1-4e7d-81c2-22867ca9b8a0 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:43:29.202950 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [req-325245cb-5f30-4b5e-97c5-84392e9d8827 req-de7b15d9-01f1-4e7d-81c2-22867ca9b8a0 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:43:29.216183 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.compute.server_external_events [req-325245cb-5f30-4b5e-97c5-84392e9d8827 req-de7b15d9-01f1-4e7d-81c2-22867ca9b8a0 service nova] Creating event network-changed:b63f349b-2a65-4ea0-ae51-4775408f87c5 for instance 7f1a430f-5add-4ec9-ad7e-4c7c541a597d on hv-cinder-83694 Apr 07 13:43:29.219249 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7fdf287a-ba6f-451f-9f04-89d9d6ab4b8d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 204 len: 0 microversion: 2.1 time: 0.127817 Apr 07 13:43:29.220202 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1390/2901] 10.222.0.15 () {58 vars in 1238 bytes} [Thu Apr 7 13:43:29 2022] DELETE /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 13:43:29.226382 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [req-325245cb-5f30-4b5e-97c5-84392e9d8827 req-de7b15d9-01f1-4e7d-81c2-22867ca9b8a0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132614 Apr 07 13:43:29.227669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1512/2902] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 13:43:29.229015 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-7ffa3c4d-abea-42e8-b22c-387d2034a84a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:43:29.230518 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-7ffa3c4d-abea-42e8-b22c-387d2034a84a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:43:29.237217 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7ffa3c4d-abea-42e8-b22c-387d2034a84a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:43:29.237673 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7ffa3c4d-abea-42e8-b22c-387d2034a84a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:43:29.238483 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7ffa3c4d-abea-42e8-b22c-387d2034a84a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:43:29.238917 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-7ffa3c4d-abea-42e8-b22c-387d2034a84a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:43:29.388997 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.policy [None req-7ffa3c4d-abea-42e8-b22c-387d2034a84a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116892) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:43:29.396477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-7ffa3c4d-abea-42e8-b22c-387d2034a84a tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.171612 Apr 07 13:43:29.397052 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1391/2903] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:43:29 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:43:30.414345 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-d699fc94-0895-40e1-8572-c5890ce25b7f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:43:30.414961 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-d699fc94-0895-40e1-8572-c5890ce25b7f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:43:30.423006 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d699fc94-0895-40e1-8572-c5890ce25b7f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:43:30.423464 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d699fc94-0895-40e1-8572-c5890ce25b7f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:43:30.424263 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d699fc94-0895-40e1-8572-c5890ce25b7f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:43:30.424701 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-d699fc94-0895-40e1-8572-c5890ce25b7f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:43:30.577748 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-d699fc94-0895-40e1-8572-c5890ce25b7f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:43:30.585074 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-d699fc94-0895-40e1-8572-c5890ce25b7f tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1569 microversion: 2.1 time: 0.174984 Apr 07 13:43:30.585641 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1513/2904] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:43:30 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 13:43:31.333643 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [req-b634eeb3-9042-4a1b-b78e-6cc11c96b55e req-834a755b-2b3c-47f5-a9ad-cfd21c1b2e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1a430f-5add-4ec9-ad7e-4c7c541a597d", "name": "network-vif-deleted", "tag": "b63f349b-2a65-4ea0-ae51-4775408f87c5"}]} {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 13:43:31.343752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-b634eeb3-9042-4a1b-b78e-6cc11c96b55e req-834a755b-2b3c-47f5-a9ad-cfd21c1b2e13 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:43:31.344256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [req-b634eeb3-9042-4a1b-b78e-6cc11c96b55e req-834a755b-2b3c-47f5-a9ad-cfd21c1b2e13 service nova] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:43:31.356752 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.compute.server_external_events [req-b634eeb3-9042-4a1b-b78e-6cc11c96b55e req-834a755b-2b3c-47f5-a9ad-cfd21c1b2e13 service nova] Creating event network-vif-deleted:b63f349b-2a65-4ea0-ae51-4775408f87c5 for instance 7f1a430f-5add-4ec9-ad7e-4c7c541a597d on hv-cinder-83694 Apr 07 13:43:31.361679 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [req-b634eeb3-9042-4a1b-b78e-6cc11c96b55e req-834a755b-2b3c-47f5-a9ad-cfd21c1b2e13 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031659 Apr 07 13:43:31.362262 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1392/2905] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Apr 7 13:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 13:43:31.602848 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-cce0ffd4-b5b0-43d4-87b6-faebcfbcbee6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:43:31.603530 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.compute.api [None req-cce0ffd4-b5b0-43d4-87b6-faebcfbcbee6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116893) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:43:31.610549 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cce0ffd4-b5b0-43d4-87b6-faebcfbcbee6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:43:31.610999 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cce0ffd4-b5b0-43d4-87b6-faebcfbcbee6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:43:31.611901 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cce0ffd4-b5b0-43d4-87b6-faebcfbcbee6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:43:31.612366 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG oslo_concurrency.lockutils [None req-cce0ffd4-b5b0-43d4-87b6-faebcfbcbee6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:43:31.693311 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.policy [None req-cce0ffd4-b5b0-43d4-87b6-faebcfbcbee6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b16fe3b852343f3b165c60c2490203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb1b00a427444a88b63e834a0401f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116893) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 13:43:31.702344 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-cce0ffd4-b5b0-43d4-87b6-faebcfbcbee6 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 200 len: 1219 microversion: 2.1 time: 0.103291 Apr 07 13:43:31.702920 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1514/2906] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:43:31 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 13:43:32.720533 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b6ec421c-6a80-4ee0-a55b-c4d25efde52d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '>' {{(pid=116892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:43:32.721222 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.compute.api [None req-b6ec421c-6a80-4ee0-a55b-c4d25efde52d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [instance: 7f1a430f-5add-4ec9-ad7e-4c7c541a597d] Fetching instance by UUID {{(pid=116892) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 13:43:32.727256 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6ec421c-6a80-4ee0-a55b-c4d25efde52d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:43:32.727703 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6ec421c-6a80-4ee0-a55b-c4d25efde52d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:43:32.728514 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6ec421c-6a80-4ee0-a55b-c4d25efde52d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 13:43:32.728951 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG oslo_concurrency.lockutils [None req-b6ec421c-6a80-4ee0-a55b-c4d25efde52d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Lock "6788c331-568d-4778-a900-8ed7ce0b05bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 13:43:32.741500 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.wsgi [None req-b6ec421c-6a80-4ee0-a55b-c4d25efde52d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] HTTP exception thrown: Instance 7f1a430f-5add-4ec9-ad7e-4c7c541a597d could not be found. Apr 07 13:43:32.742079 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: DEBUG nova.api.openstack.wsgi [None req-b6ec421c-6a80-4ee0-a55b-c4d25efde52d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Returning 404 to user: Instance 7f1a430f-5add-4ec9-ad7e-4c7c541a597d could not be found. {{(pid=116892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 13:43:32.742884 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO nova.api.openstack.requestlog [None req-b6ec421c-6a80-4ee0-a55b-c4d25efde52d tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d" status: 404 len: 111 microversion: 2.1 time: 0.026981 Apr 07 13:43:32.743402 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: [pid: 116892|app: 0|req: 1393/2907] 10.222.0.15 () {58 vars in 1235 bytes} [Thu Apr 7 13:43:32 2022] GET /compute/v2.1/servers/7f1a430f-5add-4ec9-ad7e-4c7c541a597d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 13:43:32.899022 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: DEBUG nova.api.openstack.wsgi [None req-e5c827f6-bcac-488c-b511-e2cc8181abb1 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] Calling method '.version_select at 0x7fde583ea3a0>' {{(pid=116893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 13:43:32.902876 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5c827f6-bcac-488c-b511-e2cc8181abb1 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [f7793111-5e24-4c61-81a5-3ac1da0c3d2c] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 07 13:43:33.910732 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5c827f6-bcac-488c-b511-e2cc8181abb1 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] [f7793111-5e24-4c61-81a5-3ac1da0c3d2c] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 55986. Apr 07 13:43:33.932787 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO nova.api.openstack.requestlog [None req-e5c827f6-bcac-488c-b511-e2cc8181abb1 tempest-TestShelveInstance-997504589 tempest-TestShelveInstance-997504589-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-740580355" status: 202 len: 0 microversion: 2.1 time: 1.037203 Apr 07 13:43:33.933375 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: [pid: 116893|app: 0|req: 1515/2908] 10.222.0.15 () {58 vars in 1250 bytes} [Thu Apr 7 13:43:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-740580355 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 13:44:14.389674 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:44:14.390385 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:44:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:44:32.655407 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:44:32.655995 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:44:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:46:14.147933 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:46:14.148638 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:46:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:46:16.559669 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:46:16.560359 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:46:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:46:23.461983 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:46:23.462562 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:46:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:47:34.397774 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:47:34.398418 dv-cinder-836944-2-iscsi devstack@n-api.service[116893]: Thu Apr 7 13:47:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 13:47:52.663477 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 13:47:52.663993 dv-cinder-836944-2-iscsi devstack@n-api.service[116892]: Thu Apr 7 13:47:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!